2024-05-06T13:46:24.918 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-06T13:46:24.919 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --description upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --verbose --name teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404 -- /home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404/orig.config.yaml 2024-05-06T13:46:24.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-06T13:46:25.066 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404 branch: main description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7690404' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.1 ' name: teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 04416f48efe02891b265c07b4f38b46e422bbef9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 04416f48efe02891b265c07b4f38b46e422bbef9 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 04416f48efe02891b265c07b4f38b46e422bbef9 owner: scheduled_teuthology@teuthology priority: 850 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2645 sha1: 04416f48efe02891b265c07b4f38b46e422bbef9 sleep_before_teardown: 0 subset: 20/32 suite: upgrade suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_04416f48efe02891b265c07b4f38b46e422bbef9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 04416f48efe02891b265c07b4f38b46e422bbef9 targets: smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEM7TqFYTn6jZl6NzBaN5kml7UKdGgr0nYLQBUkktArt3PDEdf2CgH5UroQ30mAKAL+TCOZBK4TFi9Ocqkeu4zU= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJZLQFnblTUrCxwbEoGBe/6+Dt5sbmnxuyeLuXT1uGm4mYTt2ixPYLp7R2rj5qR8/OXEWu00W65W5Ile+YW28yo= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.1 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.1 roleless: true - print: '**** done end installing v18.2.1 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-04_03:08:13 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-05-06T13:46:25.066 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_04416f48efe02891b265c07b4f38b46e422bbef9/qa; will attempt to use it 2024-05-06T13:46:25.125 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_04416f48efe02891b265c07b4f38b46e422bbef9/qa/tasks 2024-05-06T13:46:25.125 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-06T13:46:25.127 INFO:teuthology.task.internal:Checking packages... 2024-05-06T13:46:25.152 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '04416f48efe02891b265c07b4f38b46e422bbef9' 2024-05-06T13:46:25.153 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-06T13:46:25.153 INFO:teuthology.packaging:ref: None 2024-05-06T13:46:25.153 INFO:teuthology.packaging:tag: None 2024-05-06T13:46:25.153 INFO:teuthology.packaging:branch: main 2024-05-06T13:46:25.153 INFO:teuthology.packaging:sha1: 04416f48efe02891b265c07b4f38b46e422bbef9 2024-05-06T13:46:25.153 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-05-06T13:46:25.378 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3509.g16021434 2024-05-06T13:46:25.380 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-06T13:46:25.386 INFO:teuthology.task.internal:no buildpackages task found 2024-05-06T13:46:25.386 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-06T13:46:25.411 INFO:teuthology.task.internal:Saving configuration 2024-05-06T13:46:25.431 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-06T13:46:25.439 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-06T13:46:25.461 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 13:41:28.469451', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEM7TqFYTn6jZl6NzBaN5kml7UKdGgr0nYLQBUkktArt3PDEdf2CgH5UroQ30mAKAL+TCOZBK4TFi9Ocqkeu4zU='} 2024-05-06T13:46:25.479 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 13:41:28.468127', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJZLQFnblTUrCxwbEoGBe/6+Dt5sbmnxuyeLuXT1uGm4mYTt2ixPYLp7R2rj5qR8/OXEWu00W65W5Ile+YW28yo='} 2024-05-06T13:46:25.479 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-06T13:46:25.486 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-05-06T13:46:25.487 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-05-06T13:46:25.487 INFO:teuthology.run_tasks:Running task console_log... 2024-05-06T13:46:25.564 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1fcf92e0d0>, signals=[15]) 2024-05-06T13:46:25.565 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-06T13:46:25.571 INFO:teuthology.task.internal:Opening connections... 2024-05-06T13:46:25.572 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-05-06T13:46:25.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T13:46:25.654 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-05-06T13:46:25.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T13:46:25.733 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-06T13:46:25.742 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-05-06T13:46:25.760 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-05-06T13:46:25.760 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-05-06T13:46:25.819 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-05-06T13:46:25.819 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-05-06T13:46:25.819 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-05-06T13:46:25.819 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-05-06T13:46:25.819 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-05-06T13:46:25.819 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-05-06T13:46:25.819 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-06T13:46:25.819 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-05-06T13:46:25.819 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-05-06T13:46:25.820 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-06T13:46:25.820 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-05-06T13:46:25.820 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-06T13:46:25.820 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-06T13:46:25.820 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-06T13:46:25.820 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-05-06T13:46:25.842 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-05-06T13:46:25.860 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-05-06T13:46:25.861 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-05-06T13:46:25.917 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-05-06T13:46:25.917 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-05-06T13:46:25.917 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-05-06T13:46:25.918 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-05-06T13:46:25.918 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-05-06T13:46:25.918 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-05-06T13:46:25.918 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-06T13:46:25.918 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-05-06T13:46:25.918 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-05-06T13:46:25.918 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-06T13:46:25.918 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-05-06T13:46:25.918 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-06T13:46:25.918 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-06T13:46:25.918 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-06T13:46:25.919 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-05-06T13:46:25.942 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-06T13:46:25.953 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-06T13:46:25.961 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-06T13:46:25.961 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-05-06T13:46:25.964 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-05-06T13:46:25.979 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-06T13:46:25.987 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-06T13:46:25.987 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-05-06T13:46:26.020 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-05-06T13:46:26.133 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-06T13:46:26.189 INFO:teuthology.run_tasks:Running task kernel... 2024-05-06T13:46:26.209 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-06T13:46:26.209 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-06T13:46:26.209 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-06T13:46:26.210 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-06T13:46:26.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T13:46:26.226 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-05-06T13:46:26.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T13:46:26.227 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-05-06T13:46:26.283 INFO:teuthology.orchestra.run.smithi123.stdout:5.14.0-437.el9.x86_64 2024-05-06T13:46:26.283 INFO:teuthology.task.kernel:Running kernel on smithi123: 5.14.0-437.el9.x86_64 2024-05-06T13:46:26.284 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum install -y kernel 2024-05-06T13:46:26.285 INFO:teuthology.orchestra.run.smithi174.stdout:5.14.0-437.el9.x86_64 2024-05-06T13:46:26.285 INFO:teuthology.task.kernel:Running kernel on smithi174: 5.14.0-437.el9.x86_64 2024-05-06T13:46:26.285 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum install -y kernel 2024-05-06T13:46:28.904 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 8.1 MB/s | 8.0 MB 00:00 2024-05-06T13:46:30.705 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-05-06T13:46:32.221 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 8.0 MB 00:04 2024-05-06T13:46:35.139 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.2 MB 00:00 2024-05-06T13:46:36.881 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 16 kB 00:00 2024-05-06T13:46:38.124 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-05-06T13:46:42.820 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 2.0 MB/s | 19 MB 00:09 2024-05-06T13:46:43.157 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-05-06T13:46:45.063 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-06T13:46:45.063 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-06T13:46:45.158 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:46:45.159 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-05-06T13:46:45.160 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:46:45.276 DEBUG:teuthology.orchestra.run.smithi123:> echo no | sudo yum reinstall kernel || true 2024-05-06T13:46:45.775 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:02 ago on Mon 06 May 2024 01:46:43 PM UTC. 2024-05-06T13:46:45.895 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:46:45.905 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:46:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-05-06T13:46:45.905 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:46:45.905 INFO:teuthology.orchestra.run.smithi123.stdout:Reinstalling: 2024-05-06T13:46:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-05-06T13:46:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:46:45.905 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:46:45.905 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:46:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:46:45.905 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 255 k 2024-05-06T13:46:45.905 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 0 2024-05-06T13:46:45.906 INFO:teuthology.orchestra.run.smithi123.stderr:Operation aborted. 2024-05-06T13:46:45.989 INFO:teuthology.orchestra.run.smithi123.stdout:Is this ok [y/N]: 2024-05-06T13:46:45.990 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum reinstall -y kernel || true 2024-05-06T13:46:46.483 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:03 ago on Mon 06 May 2024 01:46:43 PM UTC. 2024-05-06T13:46:46.599 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:46:46.599 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:46:46.600 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-05-06T13:46:46.600 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:46:46.600 INFO:teuthology.orchestra.run.smithi123.stdout:Reinstalling: 2024-05-06T13:46:46.600 INFO:teuthology.orchestra.run.smithi123.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-05-06T13:46:46.600 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:46:46.600 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:46:46.600 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:46:46.600 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:46:46.600 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 255 k 2024-05-06T13:46:46.600 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 0 2024-05-06T13:46:46.600 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.8 MB/s | 255 kB 00:00 2024-05-06T13:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout:Total 622 kB/s | 255 kB 00:00 2024-05-06T13:46:47.029 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:46:47.198 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:46:47.198 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:46:47.203 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:46:47.204 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:46:47.346 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:46:47.387 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 6.2 MB 00:00 2024-05-06T13:46:47.418 INFO:teuthology.orchestra.run.smithi123.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-05-06T13:46:47.418 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-05-06T13:46:48.070 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-05-06T13:46:48.070 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-05-06T13:46:48.765 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-05-06T13:46:48.765 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:46:48.765 INFO:teuthology.orchestra.run.smithi123.stdout:Reinstalled: 2024-05-06T13:46:48.765 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-5.14.0-437.el9.x86_64 2024-05-06T13:46:48.765 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:46:48.765 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:46:48.940 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2024-05-06T13:46:48.987 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-5.14.0-437.el9.x86_64 2024-05-06T13:46:48.987 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-05-06T13:46:48.987 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-06T13:46:48.987 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-05-06T13:46:48.987 DEBUG:teuthology.orchestra.run.smithi123:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-06T13:46:49.025 INFO:teuthology.orchestra.run.smithi123.stdout:ttyS1 2024-05-06T13:46:49.045 DEBUG:teuthology.parallel:result is None 2024-05-06T13:46:49.221 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 16 kB 00:00 2024-05-06T13:46:51.225 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-06T13:46:56.339 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-05-06T13:46:58.162 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-06T13:46:58.162 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-06T13:46:58.252 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:46:58.253 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do. 2024-05-06T13:46:58.253 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:46:58.378 DEBUG:teuthology.orchestra.run.smithi174:> echo no | sudo yum reinstall kernel || true 2024-05-06T13:46:58.877 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:02 ago on Mon 06 May 2024 01:46:56 PM UTC. 2024-05-06T13:46:59.000 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:46:59.011 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:46:59.012 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-05-06T13:46:59.012 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:46:59.012 INFO:teuthology.orchestra.run.smithi174.stdout:Reinstalling: 2024-05-06T13:46:59.012 INFO:teuthology.orchestra.run.smithi174.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-05-06T13:46:59.012 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:46:59.012 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:46:59.012 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:46:59.012 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:46:59.012 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 255 k 2024-05-06T13:46:59.012 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 0 2024-05-06T13:46:59.013 INFO:teuthology.orchestra.run.smithi174.stderr:Operation aborted. 2024-05-06T13:46:59.070 INFO:teuthology.orchestra.run.smithi174.stdout:Is this ok [y/N]: 2024-05-06T13:46:59.071 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum reinstall -y kernel || true 2024-05-06T13:46:59.572 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:03 ago on Mon 06 May 2024 01:46:56 PM UTC. 2024-05-06T13:46:59.689 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:46:59.690 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:46:59.690 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-05-06T13:46:59.690 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:46:59.690 INFO:teuthology.orchestra.run.smithi174.stdout:Reinstalling: 2024-05-06T13:46:59.690 INFO:teuthology.orchestra.run.smithi174.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-05-06T13:46:59.690 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:46:59.690 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:46:59.690 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:46:59.691 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:46:59.691 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 255 k 2024-05-06T13:46:59.691 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 0 2024-05-06T13:46:59.691 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:47:00.133 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.5 MB/s | 255 kB 00:00 2024-05-06T13:47:00.133 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:47:00.133 INFO:teuthology.orchestra.run.smithi174.stdout:Total 575 kB/s | 255 kB 00:00 2024-05-06T13:47:00.151 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:47:00.343 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:47:00.344 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:47:00.348 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:47:00.349 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:47:00.471 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:47:00.576 INFO:teuthology.orchestra.run.smithi174.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-05-06T13:47:00.576 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-05-06T13:47:01.297 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-05-06T13:47:01.297 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-05-06T13:47:02.016 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-05-06T13:47:02.016 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:47:02.016 INFO:teuthology.orchestra.run.smithi174.stdout:Reinstalled: 2024-05-06T13:47:02.016 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-5.14.0-437.el9.x86_64 2024-05-06T13:47:02.016 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:47:02.017 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:47:02.188 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q kernel | sort -rV | head -n 1 2024-05-06T13:47:02.234 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-5.14.0-437.el9.x86_64 2024-05-06T13:47:02.235 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-05-06T13:47:02.235 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-06T13:47:02.235 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-05-06T13:47:02.235 DEBUG:teuthology.orchestra.run.smithi174:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-06T13:47:02.265 INFO:teuthology.orchestra.run.smithi174.stdout:ttyS1 2024-05-06T13:47:02.288 DEBUG:teuthology.parallel:result is None 2024-05-06T13:47:02.288 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-06T13:47:02.296 INFO:teuthology.task.internal:Creating test directory... 2024-05-06T13:47:02.296 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-06T13:47:02.300 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-06T13:47:02.342 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-06T13:47:02.349 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-06T13:47:02.360 INFO:teuthology.task.internal:Creating archive directory... 2024-05-06T13:47:02.360 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-06T13:47:02.363 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-06T13:47:02.497 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-06T13:47:02.504 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-06T13:47:02.504 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-06T13:47:02.506 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-06T13:47:02.535 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T13:47:02.537 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T13:47:02.544 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T13:47:02.548 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T13:47:02.549 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-06T13:47:02.557 INFO:teuthology.task.internal:Configuring sudo... 2024-05-06T13:47:02.558 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-06T13:47:02.593 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-06T13:47:02.618 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-06T13:47:02.627 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-06T13:47:02.627 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-06T13:47:02.661 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-06T13:47:02.675 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T13:47:02.756 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T13:47:02.817 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T13:47:02.896 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T13:47:02.941 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:47:02.941 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-06T13:47:03.005 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T13:47:03.047 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T13:47:03.101 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T13:47:03.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T13:47:03.221 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T13:47:03.222 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-06T13:47:03.284 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-05-06T13:47:03.287 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-05-06T13:47:03.333 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-06T13:47:03.357 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-06T13:47:03.810 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-06T13:47:03.818 INFO:teuthology.task.internal:Starting timer... 2024-05-06T13:47:03.819 INFO:teuthology.run_tasks:Running task pcp... 2024-05-06T13:47:03.836 INFO:teuthology.run_tasks:Running task selinux... 2024-05-06T13:47:03.851 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-06T13:47:03.852 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2024-05-06T13:47:03.908 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2024-05-06T13:47:03.910 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2024-05-06T13:47:03.974 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2024-05-06T13:47:03.976 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-06T13:47:03.976 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2024-05-06T13:47:03.999 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2024-05-06T13:47:04.000 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2024-05-06T13:47:04.030 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2024-05-06T13:47:04.030 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi123.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2024-05-06T13:47:04.030 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-06T13:47:04.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T13:47:04.064 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-06T13:47:04.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T13:47:04.095 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-06T13:47:04.095 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2024-05-06T13:47:04.151 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2024-05-06T13:47:04.175 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-06T13:47:04.184 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-06T13:47:04.189 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-06T13:47:04.313 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-06T13:47:04.351 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-06T13:47:04.373 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-06T13:50:54.224 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2024-05-06T13:50:54.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-05-06T13:50:54.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T13:50:54.302 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-05-06T13:50:54.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-05-06T13:50:54.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-06T13:50:54.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T13:50:54.461 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-05-06T13:50:54.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-06T13:50:54.538 INFO:teuthology.run_tasks:Running task clock... 2024-05-06T13:50:54.549 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-06T13:50:54.550 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-06T13:50:54.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T13:50:54.553 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-06T13:50:54.553 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T13:50:54.578 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-06T13:50:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-06T13:50:54.607 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-06T13:50:54.615 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2024-05-06T13:50:54.621 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-06T13:50:54.626 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2024-05-06T13:50:54.638 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-06T13:50:54.645 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2024-05-06T13:50:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-06T13:50:54.656 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2024-05-06T13:50:54.669 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-06T13:50:54.683 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-06T13:50:54.707 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-05-06T13:50:54.710 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-06T13:50:54.711 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-05-06T13:50:54.711 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T13:50:54.711 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T13:50:54.711 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T13:50:54.711 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T13:50:54.742 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-05-06T13:50:54.746 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-06T13:50:54.746 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-05-06T13:50:54.746 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T13:50:54.746 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T13:50:54.746 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T13:50:54.747 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T13:50:54.747 INFO:teuthology.run_tasks:Running task install... 2024-05-06T13:50:54.756 DEBUG:teuthology.task.install:project ceph 2024-05-06T13:50:54.756 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '04416f48efe02891b265c07b4f38b46e422bbef9'}} 2024-05-06T13:50:54.756 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.1', 'flavor': 'default', 'sha1': '04416f48efe02891b265c07b4f38b46e422bbef9'} 2024-05-06T13:50:54.756 INFO:teuthology.task.install:Using flavor: default 2024-05-06T13:50:54.811 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-06T13:50:54.811 INFO:teuthology.task.install:extra packages: [] 2024-05-06T13:50:54.812 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04416f48efe02891b265c07b4f38b46e422bbef9', 'tag': 'v18.2.1', 'wait_for_package': False} 2024-05-06T13:50:54.812 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-05-06T13:50:54.812 INFO:teuthology.packaging:ref: None 2024-05-06T13:50:54.812 INFO:teuthology.packaging:tag: v18.2.1 2024-05-06T13:50:54.812 INFO:teuthology.packaging:branch: None 2024-05-06T13:50:54.812 INFO:teuthology.packaging:sha1: 04416f48efe02891b265c07b4f38b46e422bbef9 2024-05-06T13:50:58.760 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.1^{} -> 7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-05-06T13:50:58.761 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-05-06T13:50:58.764 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04416f48efe02891b265c07b4f38b46e422bbef9', 'tag': 'v18.2.1', 'wait_for_package': False} 2024-05-06T13:50:58.764 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-05-06T13:50:58.764 INFO:teuthology.packaging:ref: None 2024-05-06T13:50:58.764 INFO:teuthology.packaging:tag: v18.2.1 2024-05-06T13:50:58.764 INFO:teuthology.packaging:branch: None 2024-05-06T13:50:58.764 INFO:teuthology.packaging:sha1: 04416f48efe02891b265c07b4f38b46e422bbef9 2024-05-06T13:50:58.765 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-05-06T13:50:58.906 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/ 2024-05-06T13:50:58.907 INFO:teuthology.task.install.rpm:Package version is 18.2.1-0 2024-05-06T13:50:58.936 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-06T13:50:58.937 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:50:58.937 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-06T13:50:58.966 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-06T13:50:58.967 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-05-06T13:50:58.967 INFO:teuthology.packaging:ref: None 2024-05-06T13:50:58.967 INFO:teuthology.packaging:tag: v18.2.1 2024-05-06T13:50:58.967 INFO:teuthology.packaging:branch: None 2024-05-06T13:50:58.967 INFO:teuthology.packaging:sha1: 04416f48efe02891b265c07b4f38b46e422bbef9 2024-05-06T13:50:58.967 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-06T13:50:58.997 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/ 2024-05-06T13:50:58.997 INFO:teuthology.task.install.rpm:Package version is 18.2.1-0 2024-05-06T13:50:59.024 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-06T13:50:59.024 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T13:50:59.024 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-06T13:50:59.038 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-06T13:50:59.054 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-06T13:50:59.054 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-05-06T13:50:59.054 INFO:teuthology.packaging:ref: None 2024-05-06T13:50:59.054 INFO:teuthology.packaging:tag: v18.2.1 2024-05-06T13:50:59.054 INFO:teuthology.packaging:branch: None 2024-05-06T13:50:59.054 INFO:teuthology.packaging:sha1: 04416f48efe02891b265c07b4f38b46e422bbef9 2024-05-06T13:50:59.054 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-06T13:50:59.116 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-06T13:50:59.123 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-06T13:50:59.180 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2024-05-06T13:50:59.182 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2024-05-06T13:50:59.200 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-06T13:50:59.265 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2024-05-06T13:50:59.267 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2024-05-06T13:50:59.411 INFO:teuthology.orchestra.run.smithi123.stdout:50 files removed 2024-05-06T13:50:59.437 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw 2024-05-06T13:50:59.495 INFO:teuthology.orchestra.run.smithi174.stdout:50 files removed 2024-05-06T13:50:59.522 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw 2024-05-06T13:50:59.917 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 348 kB/s | 76 kB 00:00 2024-05-06T13:50:59.955 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 443 kB/s | 76 kB 00:00 2024-05-06T13:51:00.117 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 60 kB/s | 9.4 kB 00:00 2024-05-06T13:51:00.122 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 77 kB/s | 9.4 kB 00:00 2024-05-06T13:51:00.306 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 14 kB/s | 2.2 kB 00:00 2024-05-06T13:51:00.318 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 13 kB/s | 2.2 kB 00:00 2024-05-06T13:51:00.734 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 21 MB/s | 8.0 MB 00:00 2024-05-06T13:51:00.840 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-05-06T13:51:02.610 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-05-06T13:51:05.749 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 4.9 MB/s | 19 MB 00:03 2024-05-06T13:51:06.911 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.2 MB 00:00 2024-05-06T13:51:08.187 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 122 kB/s | 16 kB 00:00 2024-05-06T13:51:10.164 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-06T13:51:11.091 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.2 MB 00:01 2024-05-06T13:51:12.975 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 16 kB 00:00 2024-05-06T13:51:14.695 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-06T13:51:15.439 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-05-06T13:51:17.538 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:51:17.540 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:51:17.540 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-05-06T13:51:17.540 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:51:17.540 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:51:17.540 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:18.2.1-0.el9 ceph 7.7 M 2024-05-06T13:51:17.540 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-05-06T13:51:17.540 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:18.2.1-0.el9 ceph 3.3 M 2024-05-06T13:51:17.540 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:18.2.1-0.el9 ceph 5.2 M 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:18.2.1-0.el9 ceph 18 M 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:18.2.1-0.el9 ceph 24 k 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:18.2.1-0.el9 ceph 658 k 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-06T13:51:17.541 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:18.2.1-0.el9 ceph 474 k 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:18.2.1-0.el9 ceph 4.5 M 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:18.2.1-0.el9 ceph 45 k 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:18.2.1-0.el9 ceph 124 k 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:18.2.1-0.el9 ceph 161 k 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:18.2.1-0.el9 ceph 321 k 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:18.2.1-0.el9 ceph 297 k 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:18.2.1-0.el9 ceph 99 k 2024-05-06T13:51:17.542 INFO:teuthology.orchestra.run.smithi123.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-06T13:51:17.543 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-06T13:51:17.543 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:17.543 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:51:17.543 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:51:17.543 INFO:teuthology.orchestra.run.smithi123.stdout:Install 28 Packages 2024-05-06T13:51:17.543 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 2 Packages 2024-05-06T13:51:17.543 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:17.543 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 53 M 2024-05-06T13:51:17.543 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:51:17.990 INFO:teuthology.orchestra.run.smithi123.stdout:(1/30): ceph-base-18.2.1-0.el9.x86_64.rpm 31 MB/s | 5.2 MB 00:00 2024-05-06T13:51:18.015 INFO:teuthology.orchestra.run.smithi123.stdout:(2/30): ceph-selinux-18.2.1-0.el9.x86_64.rpm 968 kB/s | 24 kB 00:00 2024-05-06T13:51:18.049 INFO:teuthology.orchestra.run.smithi123.stdout:(3/30): libcephfs2-18.2.1-0.el9.x86_64.rpm 19 MB/s | 658 kB 00:00 2024-05-06T13:51:18.082 INFO:teuthology.orchestra.run.smithi123.stdout:(4/30): libradosstriper1-18.2.1-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-05-06T13:51:18.174 INFO:teuthology.orchestra.run.smithi123.stdout:(5/30): librgw2-18.2.1-0.el9.x86_64.rpm 49 MB/s | 4.5 MB 00:00 2024-05-06T13:51:18.199 INFO:teuthology.orchestra.run.smithi123.stdout:(6/30): python3-ceph-argparse-18.2.1-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-05-06T13:51:18.225 INFO:teuthology.orchestra.run.smithi123.stdout:(7/30): python3-ceph-common-18.2.1-0.el9.x86_64 4.8 MB/s | 124 kB 00:00 2024-05-06T13:51:18.308 INFO:teuthology.orchestra.run.smithi123.stdout:(8/30): ceph-radosgw-18.2.1-0.el9.x86_64.rpm 16 MB/s | 7.7 MB 00:00 2024-05-06T13:51:18.333 INFO:teuthology.orchestra.run.smithi123.stdout:(9/30): python3-cephfs-18.2.1-0.el9.x86_64.rpm 1.5 MB/s | 161 kB 00:00 2024-05-06T13:51:18.359 INFO:teuthology.orchestra.run.smithi123.stdout:(10/30): python3-rados-18.2.1-0.el9.x86_64.rpm 6.2 MB/s | 321 kB 00:00 2024-05-06T13:51:18.385 INFO:teuthology.orchestra.run.smithi123.stdout:(11/30): python3-rbd-18.2.1-0.el9.x86_64.rpm 5.8 MB/s | 297 kB 00:00 2024-05-06T13:51:18.409 INFO:teuthology.orchestra.run.smithi123.stdout:(12/30): python3-rgw-18.2.1-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-05-06T13:51:18.627 INFO:teuthology.orchestra.run.smithi123.stdout:(13/30): ceph-common-18.2.1-0.el9.x86_64.rpm 23 MB/s | 18 MB 00:00 2024-05-06T13:51:18.710 INFO:teuthology.orchestra.run.smithi123.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 328 kB/s | 107 kB 00:00 2024-05-06T13:51:18.735 INFO:teuthology.orchestra.run.smithi123.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 492 kB/s | 160 kB 00:00 2024-05-06T13:51:18.752 INFO:teuthology.orchestra.run.smithi123.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-05-06T13:51:18.848 INFO:teuthology.orchestra.run.smithi123.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 292 kB 00:00 2024-05-06T13:51:18.870 INFO:teuthology.orchestra.run.smithi123.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 360 kB/s | 42 kB 00:00 2024-05-06T13:51:18.895 INFO:teuthology.orchestra.run.smithi123.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-05-06T13:51:19.262 INFO:teuthology.orchestra.run.smithi123.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 267 kB/s | 111 kB 00:00 2024-05-06T13:51:19.304 INFO:teuthology.orchestra.run.smithi123.stdout:(21/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 712 kB/s | 309 kB 00:00 2024-05-06T13:51:19.346 INFO:teuthology.orchestra.run.smithi123.stdout:(22/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-05-06T13:51:19.579 INFO:teuthology.orchestra.run.smithi123.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 176 kB/s | 49 kB 00:00 2024-05-06T13:51:19.605 INFO:teuthology.orchestra.run.smithi123.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 260 kB/s | 67 kB 00:00 2024-05-06T13:51:19.810 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-05-06T13:51:20.072 INFO:teuthology.orchestra.run.smithi123.stdout:(25/30): libarrow-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-05-06T13:51:20.088 INFO:teuthology.orchestra.run.smithi123.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 396 kB/s | 192 kB 00:00 2024-05-06T13:51:20.130 INFO:teuthology.orchestra.run.smithi123.stdout:(27/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.5 MB/s | 839 kB 00:00 2024-05-06T13:51:20.189 INFO:teuthology.orchestra.run.smithi123.stdout:(28/30): librados2-18.2.1-0.el9.x86_64.rpm 33 MB/s | 3.3 MB 00:00 2024-05-06T13:51:20.231 INFO:teuthology.orchestra.run.smithi123.stdout:(29/30): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-05-06T13:51:20.289 INFO:teuthology.orchestra.run.smithi123.stdout:(30/30): librbd1-18.2.1-0.el9.x86_64.rpm 19 MB/s | 3.0 MB 00:00 2024-05-06T13:51:20.294 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:51:20.294 INFO:teuthology.orchestra.run.smithi123.stdout:Total 19 MB/s | 53 MB 00:02 2024-05-06T13:51:20.366 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:51:20.401 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:51:20.401 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:51:20.822 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:51:20.822 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:51:21.970 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:51:21.972 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:51:21.972 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-05-06T13:51:21.972 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:51:21.972 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:51:21.972 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:18.2.1-0.el9 ceph 7.7 M 2024-05-06T13:51:21.972 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2024-05-06T13:51:21.973 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:18.2.1-0.el9 ceph 3.3 M 2024-05-06T13:51:21.973 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-05-06T13:51:21.973 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-05-06T13:51:21.973 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-06T13:51:21.973 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:18.2.1-0.el9 ceph 5.2 M 2024-05-06T13:51:21.974 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:18.2.1-0.el9 ceph 18 M 2024-05-06T13:51:21.974 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:18.2.1-0.el9 ceph 24 k 2024-05-06T13:51:21.974 INFO:teuthology.orchestra.run.smithi174.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-05-06T13:51:21.974 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-06T13:51:21.974 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-06T13:51:21.974 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-06T13:51:21.975 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:18.2.1-0.el9 ceph 658 k 2024-05-06T13:51:21.975 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-06T13:51:21.975 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-06T13:51:21.975 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-06T13:51:21.975 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:18.2.1-0.el9 ceph 474 k 2024-05-06T13:51:21.975 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-06T13:51:21.976 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:18.2.1-0.el9 ceph 4.5 M 2024-05-06T13:51:21.976 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-06T13:51:21.976 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-06T13:51:21.976 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-06T13:51:21.976 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:18.2.1-0.el9 ceph 45 k 2024-05-06T13:51:21.976 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:18.2.1-0.el9 ceph 124 k 2024-05-06T13:51:21.976 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:18.2.1-0.el9 ceph 161 k 2024-05-06T13:51:21.976 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-06T13:51:21.977 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:18.2.1-0.el9 ceph 321 k 2024-05-06T13:51:21.977 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:18.2.1-0.el9 ceph 297 k 2024-05-06T13:51:21.977 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:18.2.1-0.el9 ceph 99 k 2024-05-06T13:51:21.977 INFO:teuthology.orchestra.run.smithi174.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-06T13:51:21.977 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-06T13:51:21.977 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:21.977 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:51:21.977 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:51:21.978 INFO:teuthology.orchestra.run.smithi174.stdout:Install 28 Packages 2024-05-06T13:51:21.978 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 2 Packages 2024-05-06T13:51:21.978 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:21.978 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 53 M 2024-05-06T13:51:21.979 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:51:22.183 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:51:22.253 INFO:teuthology.orchestra.run.smithi174.stdout:(1/30): ceph-base-18.2.1-0.el9.x86_64.rpm 27 MB/s | 5.2 MB 00:00 2024-05-06T13:51:22.265 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-05-06T13:51:22.269 INFO:teuthology.orchestra.run.smithi174.stdout:(2/30): ceph-selinux-18.2.1-0.el9.x86_64.rpm 1.4 MB/s | 24 kB 00:00 2024-05-06T13:51:22.294 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-05-06T13:51:22.303 INFO:teuthology.orchestra.run.smithi174.stdout:(3/30): libcephfs2-18.2.1-0.el9.x86_64.rpm 19 MB/s | 658 kB 00:00 2024-05-06T13:51:22.337 INFO:teuthology.orchestra.run.smithi174.stdout:(4/30): libradosstriper1-18.2.1-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-05-06T13:51:22.343 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-05-06T13:51:22.454 INFO:teuthology.orchestra.run.smithi174.stdout:(5/30): ceph-radosgw-18.2.1-0.el9.x86_64.rpm 20 MB/s | 7.7 MB 00:00 2024-05-06T13:51:22.479 INFO:teuthology.orchestra.run.smithi174.stdout:(6/30): python3-ceph-argparse-18.2.1-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-05-06T13:51:22.504 INFO:teuthology.orchestra.run.smithi174.stdout:(7/30): python3-ceph-common-18.2.1-0.el9.x86_64 4.9 MB/s | 124 kB 00:00 2024-05-06T13:51:22.530 INFO:teuthology.orchestra.run.smithi174.stdout:(8/30): python3-cephfs-18.2.1-0.el9.x86_64.rpm 6.3 MB/s | 161 kB 00:00 2024-05-06T13:51:22.555 INFO:teuthology.orchestra.run.smithi174.stdout:(9/30): python3-rados-18.2.1-0.el9.x86_64.rpm 13 MB/s | 321 kB 00:00 2024-05-06T13:51:22.580 INFO:teuthology.orchestra.run.smithi174.stdout:(10/30): python3-rbd-18.2.1-0.el9.x86_64.rpm 12 MB/s | 297 kB 00:00 2024-05-06T13:51:22.597 INFO:teuthology.orchestra.run.smithi174.stdout:(11/30): python3-rgw-18.2.1-0.el9.x86_64.rpm 5.8 MB/s | 99 kB 00:00 2024-05-06T13:51:22.652 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-05-06T13:51:22.656 INFO:teuthology.orchestra.run.smithi174.stdout:(12/30): librgw2-18.2.1-0.el9.x86_64.rpm 14 MB/s | 4.5 MB 00:00 2024-05-06T13:51:22.768 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:18.2.1-0.el9.x86_64 5/32 2024-05-06T13:51:22.856 INFO:teuthology.orchestra.run.smithi174.stdout:(13/30): ceph-common-18.2.1-0.el9.x86_64.rpm 23 MB/s | 18 MB 00:00 2024-05-06T13:51:22.860 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:18.2.1-0.el9.x86_64 5/32 2024-05-06T13:51:22.915 INFO:teuthology.orchestra.run.smithi174.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 778 kB/s | 45 kB 00:00 2024-05-06T13:51:22.940 INFO:teuthology.orchestra.run.smithi174.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 565 kB/s | 160 kB 00:00 2024-05-06T13:51:22.940 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:18.2.1-0.el9.x86_64 6/32 2024-05-06T13:51:22.965 INFO:teuthology.orchestra.run.smithi174.stdout:(16/30): boost-program-options-1.75.0-8.el9.x86 291 kB/s | 107 kB 00:00 2024-05-06T13:51:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-05-06T13:51:23.024 INFO:teuthology.orchestra.run.smithi174.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 727 kB/s | 42 kB 00:00 2024-05-06T13:51:23.032 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-05-06T13:51:23.061 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-05-06T13:51:23.074 INFO:teuthology.orchestra.run.smithi174.stdout:(18/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-05-06T13:51:23.104 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 9/32 2024-05-06T13:51:23.107 INFO:teuthology.orchestra.run.smithi174.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-05-06T13:51:23.170 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-05-06T13:51:23.198 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-05-06T13:51:23.254 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-05-06T13:51:23.359 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-05-06T13:51:23.388 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-05-06T13:51:23.427 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-05-06T13:51:23.453 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-05-06T13:51:23.480 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-05-06T13:51:23.515 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-05-06T13:51:23.549 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-05-06T13:51:23.583 INFO:teuthology.orchestra.run.smithi174.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 198 kB/s | 111 kB 00:00 2024-05-06T13:51:23.700 INFO:teuthology.orchestra.run.smithi174.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 223 kB/s | 26 kB 00:00 2024-05-06T13:51:23.750 INFO:teuthology.orchestra.run.smithi174.stdout:(22/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 457 kB/s | 309 kB 00:00 2024-05-06T13:51:23.825 INFO:teuthology.orchestra.run.smithi174.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 388 kB/s | 49 kB 00:00 2024-05-06T13:51:23.838 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-05-06T13:51:23.859 INFO:teuthology.orchestra.run.smithi174.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 621 kB/s | 67 kB 00:00 2024-05-06T13:51:23.878 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-05-06T13:51:23.952 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-05-06T13:51:23.975 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:18.2.1-0.el9.x86_64 21/32 2024-05-06T13:51:24.001 INFO:teuthology.orchestra.run.smithi174.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-05-06T13:51:24.010 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-05-06T13:51:24.176 INFO:teuthology.orchestra.run.smithi174.stdout:(26/30): libarrow-9.0.0-11.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-05-06T13:51:24.210 INFO:teuthology.orchestra.run.smithi174.stdout:(27/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.1 MB/s | 839 kB 00:00 2024-05-06T13:51:24.285 INFO:teuthology.orchestra.run.smithi174.stdout:(28/30): librbd1-18.2.1-0.el9.x86_64.rpm 40 MB/s | 3.0 MB 00:00 2024-05-06T13:51:24.335 INFO:teuthology.orchestra.run.smithi174.stdout:(29/30): librados2-18.2.1-0.el9.x86_64.rpm 21 MB/s | 3.3 MB 00:00 2024-05-06T13:51:24.386 INFO:teuthology.orchestra.run.smithi174.stdout:(30/30): thrift-0.15.0-2.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2024-05-06T13:51:24.391 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:51:24.391 INFO:teuthology.orchestra.run.smithi174.stdout:Total 22 MB/s | 53 MB 00:02 2024-05-06T13:51:24.408 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-05-06T13:51:24.439 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-05-06T13:51:24.460 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:51:24.496 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:51:24.497 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:51:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-05-06T13:51:24.577 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:18.2.1-0.el9.x86_64 25/32 2024-05-06T13:51:24.608 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:18.2.1-0.el9.x86_64 26/32 2024-05-06T13:51:24.922 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:51:24.923 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:51:26.313 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:51:26.395 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-05-06T13:51:26.424 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-05-06T13:51:26.473 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-05-06T13:51:26.678 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-05-06T13:51:26.713 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-05-06T13:51:26.784 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-05-06T13:51:26.898 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:18.2.1-0.el9.x86_64 5/32 2024-05-06T13:51:26.989 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:18.2.1-0.el9.x86_64 5/32 2024-05-06T13:51:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:18.2.1-0.el9.x86_64 6/32 2024-05-06T13:51:27.091 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-05-06T13:51:27.153 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-05-06T13:51:27.182 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-05-06T13:51:27.225 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 9/32 2024-05-06T13:51:27.251 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-05-06T13:51:27.283 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-05-06T13:51:27.300 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-05-06T13:51:27.310 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-05-06T13:51:27.375 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-05-06T13:51:27.398 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-05-06T13:51:27.398 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-06T13:51:27.398 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-06T13:51:27.398 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:27.426 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-05-06T13:51:27.490 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-05-06T13:51:27.525 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-05-06T13:51:27.565 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-05-06T13:51:27.590 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-05-06T13:51:27.617 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-05-06T13:51:27.654 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-05-06T13:51:27.686 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-05-06T13:51:27.984 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-05-06T13:51:28.024 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-05-06T13:51:28.114 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-05-06T13:51:28.136 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:18.2.1-0.el9.x86_64 21/32 2024-05-06T13:51:28.173 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-05-06T13:51:28.575 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-05-06T13:51:28.601 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-05-06T13:51:28.681 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-05-06T13:51:28.749 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:18.2.1-0.el9.x86_64 25/32 2024-05-06T13:51:28.779 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:18.2.1-0.el9.x86_64 26/32 2024-05-06T13:51:30.904 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-05-06T13:51:30.942 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-05-06T13:51:31.477 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-05-06T13:51:31.512 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-05-06T13:51:31.612 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-05-06T13:51:31.613 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-06T13:51:31.613 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-06T13:51:31.613 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:31.649 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-05-06T13:51:36.601 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-05-06T13:51:36.601 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2024-05-06T13:51:36.601 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2024-05-06T13:51:36.602 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2024-05-06T13:51:36.602 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2024-05-06T13:51:36.602 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2024-05-06T13:51:36.602 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /root 2024-05-06T13:51:36.602 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2024-05-06T13:51:36.602 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:37.343 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-05-06T13:51:37.368 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-05-06T13:51:37.369 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:51:37.369 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-06T13:51:37.369 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-06T13:51:37.369 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-06T13:51:37.369 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:37.370 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-05-06T13:51:37.454 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-05-06T13:51:37.455 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-05-06T13:51:38.669 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-05-06T13:51:38.669 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:18.2.1-0.el9.x86_64 1/32 2024-05-06T13:51:38.669 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:18.2.1-0.el9.x86_64 2/32 2024-05-06T13:51:38.669 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:18.2.1-0.el9.x86_64 3/32 2024-05-06T13:51:38.669 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:18.2.1-0.el9.x86_64 4/32 2024-05-06T13:51:38.669 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:18.2.1-0.el9.x86_64 5/32 2024-05-06T13:51:38.669 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:18.2.1-0.el9.x86_64 6/32 2024-05-06T13:51:38.669 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:18.2.1-0.el9.x86_64 7/32 2024-05-06T13:51:38.669 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 8/32 2024-05-06T13:51:38.669 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:18.2.1-0.el9.x86_64 9/32 2024-05-06T13:51:38.669 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-05-06T13:51:38.669 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:18.2.1-0.el9.x86_64 11/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:18.2.1-0.el9.x86_64 12/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:18.2.1-0.el9.x86_64 13/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-05-06T13:51:38.670 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-05-06T13:51:38.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-05-06T13:51:38.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-05-06T13:51:38.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:18.2.1-0.el9.x86_64 29/32 2024-05-06T13:51:38.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-05-06T13:51:38.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:18.2.1-0.el9.x86_64 31/32 2024-05-06T13:51:39.424 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-05-06T13:51:39.424 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:39.424 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-05-06T13:51:39.424 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:18.2.1-0.el9.x86_64 librbd1-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.424 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:51:39.424 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-06T13:51:39.424 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.424 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.425 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.425 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.425 INFO:teuthology.orchestra.run.smithi123.stdout: fmt-8.1.1-5.el9.x86_64 2024-05-06T13:51:39.425 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-06T13:51:39.425 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-06T13:51:39.425 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-06T13:51:39.425 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.425 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-06T13:51:39.425 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-06T13:51:39.425 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-06T13:51:39.425 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.425 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: re2-1:20211101-3.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:39.426 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:51:39.718 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-test 2024-05-06T13:51:40.249 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:25 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:51:40.371 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:51:40.372 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:51:40.372 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-05-06T13:51:40.372 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:51:40.372 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:51:40.372 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:18.2.1-0.el9 ceph 40 M 2024-05-06T13:51:40.372 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-05-06T13:51:40.372 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:18.2.1-0.el9 ceph 165 k 2024-05-06T13:51:40.372 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-06T13:51:40.372 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-06T13:51:40.372 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:40.372 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:51:40.372 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:51:40.373 INFO:teuthology.orchestra.run.smithi123.stdout:Install 4 Packages 2024-05-06T13:51:40.373 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:40.373 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 40 M 2024-05-06T13:51:40.373 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 166 M 2024-05-06T13:51:40.373 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:51:40.544 INFO:teuthology.orchestra.run.smithi123.stdout:(1/4): libcephsqlite-18.2.1-0.el9.x86_64.rpm 1.3 MB/s | 165 kB 00:00 2024-05-06T13:51:40.885 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-05-06T13:51:40.885 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2024-05-06T13:51:40.885 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2024-05-06T13:51:40.885 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2024-05-06T13:51:40.885 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2024-05-06T13:51:40.885 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2024-05-06T13:51:40.885 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /root 2024-05-06T13:51:40.885 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2024-05-06T13:51:40.885 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:41.063 INFO:teuthology.orchestra.run.smithi123.stdout:(2/4): ceph-test-18.2.1-0.el9.x86_64.rpm 62 MB/s | 40 MB 00:00 2024-05-06T13:51:41.122 INFO:teuthology.orchestra.run.smithi123.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 110 kB/s | 64 kB 00:00 2024-05-06T13:51:41.323 INFO:teuthology.orchestra.run.smithi123.stdout:(4/4): socat-1.7.4.1-5.el9.x86_64.rpm 339 kB/s | 305 kB 00:00 2024-05-06T13:51:41.325 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:51:41.326 INFO:teuthology.orchestra.run.smithi123.stdout:Total 42 MB/s | 40 MB 00:00 2024-05-06T13:51:41.352 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:51:41.372 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:51:41.372 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:51:41.605 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-05-06T13:51:41.629 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-05-06T13:51:41.629 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:51:41.630 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-06T13:51:41.630 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-06T13:51:41.630 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-06T13:51:41.630 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:41.631 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-05-06T13:51:41.701 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:51:41.701 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:51:41.715 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-05-06T13:51:41.715 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-05-06T13:51:42.228 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:51:42.332 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-06T13:51:42.374 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-06T13:51:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:18.2.1-0.el9.x86_64 3/4 2024-05-06T13:51:42.922 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-05-06T13:51:42.923 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:18.2.1-0.el9.x86_64 1/32 2024-05-06T13:51:42.923 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:18.2.1-0.el9.x86_64 2/32 2024-05-06T13:51:42.923 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:18.2.1-0.el9.x86_64 3/32 2024-05-06T13:51:42.923 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:18.2.1-0.el9.x86_64 4/32 2024-05-06T13:51:42.923 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:18.2.1-0.el9.x86_64 5/32 2024-05-06T13:51:42.923 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:18.2.1-0.el9.x86_64 6/32 2024-05-06T13:51:42.923 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:18.2.1-0.el9.x86_64 7/32 2024-05-06T13:51:42.923 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 8/32 2024-05-06T13:51:42.923 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:18.2.1-0.el9.x86_64 9/32 2024-05-06T13:51:42.923 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-05-06T13:51:42.923 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:18.2.1-0.el9.x86_64 11/32 2024-05-06T13:51:42.923 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:18.2.1-0.el9.x86_64 12/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:18.2.1-0.el9.x86_64 13/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-05-06T13:51:42.924 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-05-06T13:51:42.925 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-05-06T13:51:42.925 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-05-06T13:51:42.925 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-05-06T13:51:42.926 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:18.2.1-0.el9.x86_64 29/32 2024-05-06T13:51:42.926 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-05-06T13:51:42.926 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:18.2.1-0.el9.x86_64 31/32 2024-05-06T13:51:43.672 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-05-06T13:51:43.672 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:43.672 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2024-05-06T13:51:43.673 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:18.2.1-0.el9.x86_64 librbd1-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.673 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:51:43.673 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-06T13:51:43.673 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.673 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.673 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.673 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.673 INFO:teuthology.orchestra.run.smithi174.stdout: fmt-8.1.1-5.el9.x86_64 2024-05-06T13:51:43.673 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-06T13:51:43.673 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-06T13:51:43.673 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-06T13:51:43.674 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.674 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-06T13:51:43.674 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-06T13:51:43.674 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-06T13:51:43.674 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.674 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-06T13:51:43.674 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.674 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-06T13:51:43.674 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-06T13:51:43.674 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-06T13:51:43.674 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.675 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.675 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.675 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-06T13:51:43.675 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.675 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.675 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:43.675 INFO:teuthology.orchestra.run.smithi174.stdout: re2-1:20211101-3.el9.x86_64 2024-05-06T13:51:43.675 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-06T13:51:43.675 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:43.675 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:51:43.975 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-test 2024-05-06T13:51:44.563 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:25 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:51:44.690 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:51:44.690 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:51:44.690 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-05-06T13:51:44.691 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:51:44.691 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:51:44.691 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:18.2.1-0.el9 ceph 40 M 2024-05-06T13:51:44.691 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-05-06T13:51:44.691 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:18.2.1-0.el9 ceph 165 k 2024-05-06T13:51:44.691 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-06T13:51:44.691 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-06T13:51:44.691 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:44.691 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:51:44.691 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:51:44.692 INFO:teuthology.orchestra.run.smithi174.stdout:Install 4 Packages 2024-05-06T13:51:44.692 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:44.692 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 40 M 2024-05-06T13:51:44.692 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 166 M 2024-05-06T13:51:44.692 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:51:44.923 INFO:teuthology.orchestra.run.smithi174.stdout:(1/4): libcephsqlite-18.2.1-0.el9.x86_64.rpm 1.8 MB/s | 165 kB 00:00 2024-05-06T13:51:45.032 INFO:teuthology.orchestra.run.smithi174.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 585 kB/s | 64 kB 00:00 2024-05-06T13:51:45.091 INFO:teuthology.orchestra.run.smithi174.stdout:(3/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 305 kB 00:00 2024-05-06T13:51:45.510 INFO:teuthology.orchestra.run.smithi174.stdout:(4/4): ceph-test-18.2.1-0.el9.x86_64.rpm 59 MB/s | 40 MB 00:00 2024-05-06T13:51:45.512 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:51:45.512 INFO:teuthology.orchestra.run.smithi174.stdout:Total 49 MB/s | 40 MB 00:00 2024-05-06T13:51:45.539 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:51:45.558 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:51:45.559 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:51:45.890 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:51:45.891 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:51:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:18.2.1-0.el9.x86_64 3/4 2024-05-06T13:51:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:18.2.1-0.el9.x86_64 4/4 2024-05-06T13:51:46.387 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:51:46.478 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-06T13:51:46.542 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-06T13:51:46.586 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:18.2.1-0.el9.x86_64 3/4 2024-05-06T13:51:48.108 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-test-2:18.2.1-0.el9.x86_64 4/4 2024-05-06T13:51:48.108 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:18.2.1-0.el9.x86_64 1/4 2024-05-06T13:51:48.108 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:18.2.1-0.el9.x86_64 2/4 2024-05-06T13:51:48.108 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-06T13:51:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-06T13:51:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:51:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:18.2.1-0.el9.x86_64 libcephsqlite-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-05-06T13:51:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:51:48.656 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph 2024-05-06T13:51:49.166 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:34 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:51:49.291 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:51:49.293 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:51:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-05-06T13:51:49.293 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:51:49.293 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:51:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:18.2.1-0.el9 ceph 6.4 k 2024-05-06T13:51:49.293 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-05-06T13:51:49.293 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:18.2.1-0.el9 ceph 2.1 M 2024-05-06T13:51:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:18.2.1-0.el9 ceph 1.4 M 2024-05-06T13:51:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:18.2.1-0.el9 ceph-noarch 242 k 2024-05-06T13:51:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:18.2.1-0.el9 ceph 4.4 M 2024-05-06T13:51:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:18.2.1-0.el9 ceph 18 M 2024-05-06T13:51:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-06T13:51:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-06T13:51:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-06T13:51:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-06T13:51:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-06T13:51:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-06T13:51:49.294 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-06T13:51:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-06T13:51:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-06T13:51:49.297 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-06T13:51:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-06T13:51:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-06T13:51:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-06T13:51:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-06T13:51:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-06T13:51:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-06T13:51:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-06T13:51:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-06T13:51:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-06T13:51:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-06T13:51:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-06T13:51:49.298 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-06T13:51:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-06T13:51:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-06T13:51:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-06T13:51:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-06T13:51:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-06T13:51:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:49.299 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:51:49.299 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:51:49.299 INFO:teuthology.orchestra.run.smithi123.stdout:Install 33 Packages 2024-05-06T13:51:49.299 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:49.300 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 30 M 2024-05-06T13:51:49.300 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 110 M 2024-05-06T13:51:49.300 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:51:50.033 INFO:teuthology.orchestra.run.smithi123.stdout:(1/33): ceph-18.2.1-0.el9.x86_64.rpm 61 kB/s | 6.4 kB 00:00 2024-05-06T13:51:50.075 INFO:teuthology.orchestra.run.smithi123.stdout:(2/33): ceph-mgr-18.2.1-0.el9.x86_64.rpm 9.8 MB/s | 1.4 MB 00:00 2024-05-06T13:51:50.125 INFO:teuthology.orchestra.run.smithi123.stdout:(3/33): ceph-mds-18.2.1-0.el9.x86_64.rpm 11 MB/s | 2.1 MB 00:00 2024-05-06T13:51:50.159 INFO:teuthology.orchestra.run.smithi123.stdout:(4/33): ceph-mgr-modules-core-18.2.1-0.el9.noar 7.2 MB/s | 242 kB 00:00 2024-05-06T13:51:50.234 INFO:teuthology.orchestra.run.smithi123.stdout:(5/33): ceph-mon-18.2.1-0.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-05-06T13:51:50.318 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:18.2.1-0.el9.x86_64 3/4 2024-05-06T13:51:50.451 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:18.2.1-0.el9.x86_64 4/4 2024-05-06T13:51:50.452 INFO:teuthology.orchestra.run.smithi123.stdout:(6/33): ceph-osd-18.2.1-0.el9.x86_64.rpm 47 MB/s | 18 MB 00:00 2024-05-06T13:51:51.260 INFO:teuthology.orchestra.run.smithi123.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 230 kB/s | 253 kB 00:01 2024-05-06T13:51:51.335 INFO:teuthology.orchestra.run.smithi123.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 121 kB/s | 106 kB 00:00 2024-05-06T13:51:51.585 INFO:teuthology.orchestra.run.smithi123.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 929 kB/s | 1.2 MB 00:01 2024-05-06T13:51:52.302 INFO:teuthology.orchestra.run.smithi123.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 130 kB/s | 135 kB 00:01 2024-05-06T13:51:52.327 INFO:teuthology.orchestra.run.smithi123.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 126 kB/s | 125 kB 00:00 2024-05-06T13:51:52.358 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-test-2:18.2.1-0.el9.x86_64 4/4 2024-05-06T13:51:52.358 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:18.2.1-0.el9.x86_64 1/4 2024-05-06T13:51:52.358 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:18.2.1-0.el9.x86_64 2/4 2024-05-06T13:51:52.359 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-06T13:51:52.528 INFO:teuthology.orchestra.run.smithi123.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 174 kB/s | 35 kB 00:00 2024-05-06T13:51:52.625 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-06T13:51:52.651 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:52.651 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:51:52.652 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:18.2.1-0.el9.x86_64 libcephsqlite-2:18.2.1-0.el9.x86_64 2024-05-06T13:51:52.652 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-05-06T13:51:52.652 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:52.652 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:51:52.661 INFO:teuthology.orchestra.run.smithi123.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 481 kB/s | 172 kB 00:00 2024-05-06T13:51:52.686 INFO:teuthology.orchestra.run.smithi123.stdout:(14/33): python3-urllib3-1.26.5-5.el9.noarch.rp 200 kB/s | 215 kB 00:01 2024-05-06T13:51:52.711 INFO:teuthology.orchestra.run.smithi123.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 277 kB/s | 51 kB 00:00 2024-05-06T13:51:52.746 INFO:teuthology.orchestra.run.smithi123.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 502 kB/s | 42 kB 00:00 2024-05-06T13:51:52.876 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph 2024-05-06T13:51:53.087 INFO:teuthology.orchestra.run.smithi123.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 116 kB/s | 43 kB 00:00 2024-05-06T13:51:53.204 INFO:teuthology.orchestra.run.smithi123.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 91 kB/s | 11 kB 00:00 2024-05-06T13:51:53.246 INFO:teuthology.orchestra.run.smithi123.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 322 kB/s | 172 kB 00:00 2024-05-06T13:51:53.313 INFO:teuthology.orchestra.run.smithi123.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 163 kB/s | 18 kB 00:00 2024-05-06T13:51:53.355 INFO:teuthology.orchestra.run.smithi123.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 213 kB/s | 23 kB 00:00 2024-05-06T13:51:53.380 INFO:teuthology.orchestra.run.smithi123.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 565 kB/s | 358 kB 00:00 2024-05-06T13:51:53.400 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:34 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:51:53.422 INFO:teuthology.orchestra.run.smithi123.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 179 kB/s | 19 kB 00:00 2024-05-06T13:51:53.464 INFO:teuthology.orchestra.run.smithi123.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 181 kB/s | 20 kB 00:00 2024-05-06T13:51:53.497 INFO:teuthology.orchestra.run.smithi123.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 395 kB/s | 46 kB 00:00 2024-05-06T13:51:53.525 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:51:53.528 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:51:53.528 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-05-06T13:51:53.528 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:51:53.528 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:51:53.528 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:18.2.1-0.el9 ceph 6.4 k 2024-05-06T13:51:53.528 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-05-06T13:51:53.528 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:18.2.1-0.el9 ceph 2.1 M 2024-05-06T13:51:53.528 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:18.2.1-0.el9 ceph 1.4 M 2024-05-06T13:51:53.528 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:18.2.1-0.el9 ceph-noarch 242 k 2024-05-06T13:51:53.528 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:18.2.1-0.el9 ceph 4.4 M 2024-05-06T13:51:53.528 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:18.2.1-0.el9 ceph 18 M 2024-05-06T13:51:53.528 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-06T13:51:53.529 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-06T13:51:53.529 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-06T13:51:53.529 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-06T13:51:53.529 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-06T13:51:53.529 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-06T13:51:53.529 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-06T13:51:53.529 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-06T13:51:53.530 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-06T13:51:53.530 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-06T13:51:53.530 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-06T13:51:53.530 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-06T13:51:53.530 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-06T13:51:53.530 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-06T13:51:53.530 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-06T13:51:53.531 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-06T13:51:53.531 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-06T13:51:53.531 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-06T13:51:53.531 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-06T13:51:53.531 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-06T13:51:53.531 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-06T13:51:53.531 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-06T13:51:53.531 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-06T13:51:53.531 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-06T13:51:53.532 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-06T13:51:53.532 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-06T13:51:53.532 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-06T13:51:53.532 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:53.532 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:51:53.532 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:51:53.532 INFO:teuthology.orchestra.run.smithi174.stdout:Install 33 Packages 2024-05-06T13:51:53.532 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:51:53.533 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 30 M 2024-05-06T13:51:53.533 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 110 M 2024-05-06T13:51:53.533 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:51:53.615 INFO:teuthology.orchestra.run.smithi123.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 141 kB/s | 16 kB 00:00 2024-05-06T13:51:53.640 INFO:teuthology.orchestra.run.smithi123.stdout:(27/33): python3-more-itertools-8.12.0-2.el9.no 362 kB/s | 79 kB 00:00 2024-05-06T13:51:53.665 INFO:teuthology.orchestra.run.smithi123.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-05-06T13:51:53.732 INFO:teuthology.orchestra.run.smithi123.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 768 kB/s | 90 kB 00:00 2024-05-06T13:51:53.757 INFO:teuthology.orchestra.run.smithi123.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 305 kB/s | 36 kB 00:00 2024-05-06T13:51:53.782 INFO:teuthology.orchestra.run.smithi123.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-05-06T13:51:53.858 INFO:teuthology.orchestra.run.smithi123.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 200 kB/s | 20 kB 00:00 2024-05-06T13:51:53.916 INFO:teuthology.orchestra.run.smithi123.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.3 MB/s | 427 kB 00:00 2024-05-06T13:51:53.919 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:51:53.919 INFO:teuthology.orchestra.run.smithi123.stdout:Total 6.5 MB/s | 30 MB 00:04 2024-05-06T13:51:54.036 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:51:54.073 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:51:54.073 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:51:54.127 INFO:teuthology.orchestra.run.smithi174.stdout:(1/33): ceph-18.2.1-0.el9.x86_64.rpm 59 kB/s | 6.4 kB 00:00 2024-05-06T13:51:54.195 INFO:teuthology.orchestra.run.smithi174.stdout:(2/33): ceph-mds-18.2.1-0.el9.x86_64.rpm 12 MB/s | 2.1 MB 00:00 2024-05-06T13:51:54.228 INFO:teuthology.orchestra.run.smithi174.stdout:(3/33): ceph-mgr-18.2.1-0.el9.x86_64.rpm 6.9 MB/s | 1.4 MB 00:00 2024-05-06T13:51:54.262 INFO:teuthology.orchestra.run.smithi174.stdout:(4/33): ceph-mgr-modules-core-18.2.1-0.el9.noar 7.1 MB/s | 242 kB 00:00 2024-05-06T13:51:54.337 INFO:teuthology.orchestra.run.smithi174.stdout:(5/33): ceph-mon-18.2.1-0.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-05-06T13:51:54.360 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:51:54.361 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:51:54.554 INFO:teuthology.orchestra.run.smithi174.stdout:(6/33): ceph-osd-18.2.1-0.el9.x86_64.rpm 49 MB/s | 18 MB 00:00 2024-05-06T13:51:54.688 INFO:teuthology.orchestra.run.smithi174.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 595 kB/s | 253 kB 00:00 2024-05-06T13:51:54.804 INFO:teuthology.orchestra.run.smithi174.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 426 kB/s | 106 kB 00:00 2024-05-06T13:51:54.830 INFO:teuthology.orchestra.run.smithi174.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 953 kB/s | 135 kB 00:00 2024-05-06T13:51:54.980 INFO:teuthology.orchestra.run.smithi174.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 712 kB/s | 125 kB 00:00 2024-05-06T13:51:55.005 INFO:teuthology.orchestra.run.smithi174.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.2 MB/s | 215 kB 00:00 2024-05-06T13:51:55.139 INFO:teuthology.orchestra.run.smithi174.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 1.5 MB/s | 1.2 MB 00:00 2024-05-06T13:51:55.508 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:51:55.577 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-05-06T13:51:55.610 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-05-06T13:51:55.639 INFO:teuthology.orchestra.run.smithi174.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 55 kB/s | 35 kB 00:00 2024-05-06T13:51:55.642 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-05-06T13:51:55.735 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-05-06T13:51:55.773 INFO:teuthology.orchestra.run.smithi174.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 80 kB/s | 51 kB 00:00 2024-05-06T13:51:55.798 INFO:teuthology.orchestra.run.smithi174.stdout:(15/33): python3-mako-1.1.4-6.el9.noarch.rpm 211 kB/s | 172 kB 00:00 2024-05-06T13:51:55.822 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-05-06T13:51:55.870 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-05-06T13:51:55.905 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-05-06T13:51:55.935 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-05-06T13:51:55.969 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-05-06T13:51:56.002 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-05-06T13:51:56.043 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-05-06T13:51:56.078 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-05-06T13:51:56.112 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-05-06T13:51:56.151 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-05-06T13:51:56.224 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-05-06T13:51:56.265 INFO:teuthology.orchestra.run.smithi174.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-05-06T13:51:56.348 INFO:teuthology.orchestra.run.smithi174.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 76 kB/s | 43 kB 00:00 2024-05-06T13:51:56.371 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-05-06T13:51:56.450 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-05-06T13:51:56.490 INFO:teuthology.orchestra.run.smithi174.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 93 kB/s | 11 kB 00:00 2024-05-06T13:51:56.504 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-05-06T13:51:56.532 INFO:teuthology.orchestra.run.smithi174.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 234 kB/s | 172 kB 00:00 2024-05-06T13:51:56.550 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-05-06T13:51:56.599 INFO:teuthology.orchestra.run.smithi174.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 162 kB/s | 18 kB 00:00 2024-05-06T13:51:56.608 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-05-06T13:51:56.624 INFO:teuthology.orchestra.run.smithi174.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 252 kB/s | 23 kB 00:00 2024-05-06T13:51:56.663 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-05-06T13:51:56.699 INFO:teuthology.orchestra.run.smithi174.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 194 kB/s | 19 kB 00:00 2024-05-06T13:51:56.725 INFO:teuthology.orchestra.run.smithi174.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 196 kB/s | 20 kB 00:00 2024-05-06T13:51:56.800 INFO:teuthology.orchestra.run.smithi174.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 462 kB/s | 46 kB 00:00 2024-05-06T13:51:56.850 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-05-06T13:51:56.900 INFO:teuthology.orchestra.run.smithi174.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 449 kB/s | 79 kB 00:00 2024-05-06T13:51:56.904 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-05-06T13:51:56.975 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-05-06T13:51:57.001 INFO:teuthology.orchestra.run.smithi174.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 164 kB/s | 16 kB 00:00 2024-05-06T13:51:57.072 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-05-06T13:51:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-05-06T13:51:57.192 INFO:teuthology.orchestra.run.smithi174.stdout:(27/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 470 kB/s | 90 kB 00:00 2024-05-06T13:51:57.218 INFO:teuthology.orchestra.run.smithi174.stdout:(28/33): python3-cherrypy-18.6.1-2.el9.noarch.r 376 kB/s | 358 kB 00:00 2024-05-06T13:51:57.228 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-05-06T13:51:57.243 INFO:teuthology.orchestra.run.smithi174.stdout:(29/33): python3-pecan-1.4.2-3.el9.noarch.rpm 615 kB/s | 272 kB 00:00 2024-05-06T13:51:57.293 INFO:teuthology.orchestra.run.smithi174.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 355 kB/s | 36 kB 00:00 2024-05-06T13:51:57.389 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 28/33 2024-05-06T13:51:57.393 INFO:teuthology.orchestra.run.smithi174.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 200 kB/s | 20 kB 00:00 2024-05-06T13:51:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-05-06T13:51:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-05-06T13:51:57.438 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:51:57.438 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-06T13:51:57.438 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-06T13:51:57.438 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-06T13:51:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:57.561 INFO:teuthology.orchestra.run.smithi174.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 671 kB/s | 230 kB 00:00 2024-05-06T13:51:57.827 INFO:teuthology.orchestra.run.smithi174.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 732 kB/s | 427 kB 00:00 2024-05-06T13:51:57.832 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:51:57.833 INFO:teuthology.orchestra.run.smithi174.stdout:Total 7.0 MB/s | 30 MB 00:04 2024-05-06T13:51:57.952 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:51:57.990 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:51:57.990 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:51:58.278 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:51:58.279 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:51:58.948 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-05-06T13:51:58.974 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-05-06T13:51:58.974 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:51:58.974 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-06T13:51:58.974 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-06T13:51:58.975 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-06T13:51:58.975 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:59.424 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-05-06T13:51:59.447 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-05-06T13:51:59.447 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:51:59.447 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-06T13:51:59.447 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-06T13:51:59.447 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-06T13:51:59.448 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:59.467 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:51:59.530 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-05-06T13:51:59.570 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-05-06T13:51:59.603 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-05-06T13:51:59.657 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-05-06T13:51:59.680 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-05-06T13:51:59.680 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:51:59.680 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-06T13:51:59.680 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-06T13:51:59.680 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-06T13:51:59.681 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:51:59.697 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-05-06T13:51:59.745 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:18.2.1-0.el9.x86_64 33/33 2024-05-06T13:51:59.767 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-05-06T13:51:59.815 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-05-06T13:51:59.850 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-05-06T13:51:59.880 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-05-06T13:51:59.914 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-05-06T13:51:59.948 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-05-06T13:51:59.988 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-05-06T13:52:00.032 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-05-06T13:52:00.074 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-05-06T13:52:00.113 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-05-06T13:52:00.187 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-05-06T13:52:00.353 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-05-06T13:52:00.438 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-05-06T13:52:00.490 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-05-06T13:52:00.537 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-05-06T13:52:00.595 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-05-06T13:52:00.650 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-05-06T13:52:00.842 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-05-06T13:52:00.891 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-05-06T13:52:00.970 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-05-06T13:52:01.066 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-05-06T13:52:01.106 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-05-06T13:52:01.222 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-05-06T13:52:01.360 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-2:18.2.1-0.el9.x86_64 33/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:18.2.1-0.el9.x86_64 1/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:18.2.1-0.el9.x86_64 2/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:18.2.1-0.el9.x86_64 3/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:18.2.1-0.el9.x86_64 4/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:18.2.1-0.el9.x86_64 5/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 6/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-05-06T13:52:01.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-05-06T13:52:01.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-05-06T13:52:01.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-05-06T13:52:01.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-05-06T13:52:01.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-05-06T13:52:01.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-05-06T13:52:01.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-05-06T13:52:01.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-05-06T13:52:01.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-05-06T13:52:01.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-05-06T13:52:01.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-05-06T13:52:01.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-05-06T13:52:01.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-05-06T13:52:01.363 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-05-06T13:52:01.363 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-05-06T13:52:01.363 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-05-06T13:52:01.363 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-05-06T13:52:01.363 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-05-06T13:52:01.363 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-05-06T13:52:01.364 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-05-06T13:52:01.377 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 28/33 2024-05-06T13:52:01.400 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-05-06T13:52:01.425 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-05-06T13:52:01.425 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:52:01.425 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-06T13:52:01.425 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-06T13:52:01.426 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-06T13:52:01.426 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:02.351 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-05-06T13:52:02.351 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-06T13:52:02.352 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply-3.11-14.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-06T13:52:02.353 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-06T13:52:02.354 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-06T13:52:02.354 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-06T13:52:02.354 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-06T13:52:02.354 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:02.354 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:02.715 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-base 2024-05-06T13:52:02.951 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-05-06T13:52:02.978 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-05-06T13:52:02.978 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:52:02.978 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-06T13:52:02.978 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-06T13:52:02.978 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-06T13:52:02.978 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:03.229 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:48 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:03.308 INFO:teuthology.orchestra.run.smithi123.stdout:Package ceph-base-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:03.349 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:03.350 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-05-06T13:52:03.350 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:03.413 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install cephadm 2024-05-06T13:52:03.427 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-05-06T13:52:03.449 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-05-06T13:52:03.449 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:52:03.449 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-06T13:52:03.450 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-06T13:52:03.450 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-06T13:52:03.450 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:03.652 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-05-06T13:52:03.675 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-05-06T13:52:03.675 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:52:03.675 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-06T13:52:03.675 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-06T13:52:03.675 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-06T13:52:03.676 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:03.739 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:18.2.1-0.el9.x86_64 33/33 2024-05-06T13:52:03.921 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:48 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:04.042 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:04.042 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:04.043 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:04.043 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:04.043 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:52:04.043 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:18.2.1-0.el9 ceph-noarch 221 k 2024-05-06T13:52:04.043 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:04.043 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:52:04.043 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:04.043 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-05-06T13:52:04.043 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:04.043 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 221 k 2024-05-06T13:52:04.043 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 213 k 2024-05-06T13:52:04.043 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:52:04.107 INFO:teuthology.orchestra.run.smithi123.stdout:cephadm-18.2.1-0.el9.noarch.rpm 3.4 MB/s | 221 kB 00:00 2024-05-06T13:52:04.108 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:04.108 INFO:teuthology.orchestra.run.smithi123.stdout:Total 3.3 MB/s | 221 kB 00:00 2024-05-06T13:52:04.108 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:52:04.113 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:52:04.113 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:52:04.115 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:52:04.116 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:52:04.183 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:52:04.659 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-05-06T13:52:04.767 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-05-06T13:52:05.111 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-05-06T13:52:05.321 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-05-06T13:52:05.321 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:05.321 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:05.321 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:18.2.1-0.el9.noarch 2024-05-06T13:52:05.321 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:05.321 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:05.412 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-2:18.2.1-0.el9.x86_64 33/33 2024-05-06T13:52:05.412 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:18.2.1-0.el9.x86_64 1/33 2024-05-06T13:52:05.412 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:18.2.1-0.el9.x86_64 2/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:18.2.1-0.el9.x86_64 3/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:18.2.1-0.el9.x86_64 4/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:18.2.1-0.el9.x86_64 5/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 6/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-05-06T13:52:05.413 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-05-06T13:52:05.414 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-05-06T13:52:05.415 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-05-06T13:52:05.415 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-05-06T13:52:05.415 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-05-06T13:52:05.526 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-immutable-object-cache 2024-05-06T13:52:06.045 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:51 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:06.166 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:06.167 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:06.167 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repo Size 2024-05-06T13:52:06.167 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:06.167 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:52:06.167 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-0.el9 ceph 142 k 2024-05-06T13:52:06.168 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:06.168 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:52:06.168 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:06.168 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-05-06T13:52:06.168 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:06.168 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 142 k 2024-05-06T13:52:06.168 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 395 k 2024-05-06T13:52:06.168 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:52:06.245 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-immutable-object-cache-18.2.1-0.el9.x86_64 1.8 MB/s | 142 kB 00:00 2024-05-06T13:52:06.246 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:06.246 INFO:teuthology.orchestra.run.smithi123.stdout:Total 1.8 MB/s | 142 kB 00:00 2024-05-06T13:52:06.246 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:52:06.254 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:52:06.254 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:52:06.312 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:52:06.312 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:52:06.337 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-05-06T13:52:06.337 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:06.337 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:06.337 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:06.337 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:06.337 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:06.337 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 2024-05-06T13:52:06.337 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:06.337 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:06.337 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-06T13:52:06.337 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-06T13:52:06.338 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-06T13:52:06.338 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-06T13:52:06.338 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-06T13:52:06.338 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-06T13:52:06.338 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-06T13:52:06.338 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-06T13:52:06.338 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-06T13:52:06.338 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-06T13:52:06.338 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-06T13:52:06.338 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-06T13:52:06.338 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-06T13:52:06.338 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply-3.11-14.el9.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-06T13:52:06.339 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-06T13:52:06.340 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:06.340 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:06.462 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:52:06.539 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:06.563 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:06.564 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:52:06.564 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-06T13:52:06.564 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:06.674 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-base 2024-05-06T13:52:07.191 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:48 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:07.272 INFO:teuthology.orchestra.run.smithi174.stdout:Package ceph-base-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:07.313 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:07.314 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do. 2024-05-06T13:52:07.314 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:07.381 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install cephadm 2024-05-06T13:52:07.412 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:07.412 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:07.412 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:07.412 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:07.412 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:07.412 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:07.613 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr 2024-05-06T13:52:07.887 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:48 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:08.008 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:08.009 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:08.009 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:08.009 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:52:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:18.2.1-0.el9 ceph-noarch 221 k 2024-05-06T13:52:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:08.009 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:52:08.009 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:08.009 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package 2024-05-06T13:52:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:08.009 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 221 k 2024-05-06T13:52:08.009 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 213 k 2024-05-06T13:52:08.010 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:52:08.118 INFO:teuthology.orchestra.run.smithi174.stdout:cephadm-18.2.1-0.el9.noarch.rpm 2.0 MB/s | 221 kB 00:00 2024-05-06T13:52:08.119 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:08.119 INFO:teuthology.orchestra.run.smithi174.stdout:Total 2.0 MB/s | 221 kB 00:00 2024-05-06T13:52:08.119 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:52:08.124 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:52:08.124 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:52:08.127 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:52:08.127 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:52:08.128 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:53 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:08.196 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:52:08.208 INFO:teuthology.orchestra.run.smithi123.stdout:Package ceph-mgr-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:08.250 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:08.251 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-05-06T13:52:08.252 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:08.314 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr-dashboard 2024-05-06T13:52:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-05-06T13:52:08.670 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-05-06T13:52:08.830 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:53 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:08.962 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:08.962 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:08.962 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-05-06T13:52:08.962 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:18.2.1-0.el9 ceph-noarch 1.8 M 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:18.2.1-0.el9 ceph-noarch 23 k 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:18.2.1-0.el9 ceph-noarch 15 k 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout:Installing weak dependencies: 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:08.963 INFO:teuthology.orchestra.run.smithi123.stdout:Install 7 Packages 2024-05-06T13:52:08.964 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:08.964 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 2.1 M 2024-05-06T13:52:08.964 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 8.5 M 2024-05-06T13:52:08.964 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:52:08.974 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-05-06T13:52:09.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-05-06T13:52:09.190 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:09.190 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:09.190 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:18.2.1-0.el9.noarch 2024-05-06T13:52:09.190 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:09.190 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:09.381 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-immutable-object-cache 2024-05-06T13:52:09.466 INFO:teuthology.orchestra.run.smithi123.stdout:(1/7): ceph-grafana-dashboards-18.2.1-0.el9.noa 187 kB/s | 23 kB 00:00 2024-05-06T13:52:09.491 INFO:teuthology.orchestra.run.smithi123.stdout:(2/7): ceph-prometheus-alerts-18.2.1-0.el9.noar 98 kB/s | 15 kB 00:00 2024-05-06T13:52:09.544 INFO:teuthology.orchestra.run.smithi123.stdout:(3/7): ceph-mgr-dashboard-18.2.1-0.el9.noarch.r 8.7 MB/s | 1.8 MB 00:00 2024-05-06T13:52:09.703 INFO:teuthology.orchestra.run.smithi123.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 38 kB/s | 9.0 kB 00:00 2024-05-06T13:52:09.803 INFO:teuthology.orchestra.run.smithi123.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 131 kB/s | 41 kB 00:00 2024-05-06T13:52:09.844 INFO:teuthology.orchestra.run.smithi123.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 121 kB/s | 31 kB 00:00 2024-05-06T13:52:09.902 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:50 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:10.020 INFO:teuthology.orchestra.run.smithi123.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 595 kB/s | 188 kB 00:00 2024-05-06T13:52:10.023 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:10.023 INFO:teuthology.orchestra.run.smithi123.stdout:Total 1.9 MB/s | 2.1 MB 00:01 2024-05-06T13:52:10.024 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:52:10.025 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:10.025 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:10.025 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repo Size 2024-05-06T13:52:10.025 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:10.025 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:52:10.025 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-0.el9 ceph 142 k 2024-05-06T13:52:10.025 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:10.025 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:52:10.025 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:10.025 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package 2024-05-06T13:52:10.026 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:10.026 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 142 k 2024-05-06T13:52:10.026 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 395 k 2024-05-06T13:52:10.026 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:52:10.031 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:52:10.031 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:52:10.081 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:52:10.081 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:52:10.091 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-immutable-object-cache-18.2.1-0.el9.x86_64 2.1 MB/s | 142 kB 00:00 2024-05-06T13:52:10.092 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:10.092 INFO:teuthology.orchestra.run.smithi174.stdout:Total 2.1 MB/s | 142 kB 00:00 2024-05-06T13:52:10.092 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:52:10.099 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:52:10.099 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:52:10.157 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:52:10.158 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:52:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:52:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:52:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:10.409 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:10.409 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:52:10.409 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-06T13:52:10.410 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:10.429 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-05-06T13:52:10.463 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-05-06T13:52:10.517 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-05-06T13:52:10.558 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-05-06T13:52:10.587 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 5/7 2024-05-06T13:52:10.823 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 6/7 2024-05-06T13:52:10.857 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-05-06T13:52:11.314 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:11.314 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:11.314 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:11.315 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:11.315 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:11.315 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:11.373 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-05-06T13:52:11.373 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 1/7 2024-05-06T13:52:11.373 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2/7 2024-05-06T13:52:11.374 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 3/7 2024-05-06T13:52:11.374 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-05-06T13:52:11.374 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-05-06T13:52:11.374 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-05-06T13:52:11.514 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-mgr 2024-05-06T13:52:11.610 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-05-06T13:52:11.610 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:11.610 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:11.611 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 2024-05-06T13:52:11.611 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2024-05-06T13:52:11.611 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 2024-05-06T13:52:11.611 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-05-06T13:52:11.611 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-05-06T13:52:11.611 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-06T13:52:11.611 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-06T13:52:11.611 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:11.611 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:11.828 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-06T13:52:12.030 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:53 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:12.111 INFO:teuthology.orchestra.run.smithi174.stdout:Package ceph-mgr-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:12.152 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:12.153 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do. 2024-05-06T13:52:12.153 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:12.228 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-mgr-dashboard 2024-05-06T13:52:12.337 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:57 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:12.459 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:12.460 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:12.460 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-05-06T13:52:12.460 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:12.460 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:52:12.460 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-0.el9 ceph-noarch 7.4 M 2024-05-06T13:52:12.460 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-05-06T13:52:12.460 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-06T13:52:12.460 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-06T13:52:12.460 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout:Install 12 Packages 2024-05-06T13:52:12.461 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:12.462 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 38 M 2024-05-06T13:52:12.462 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 209 M 2024-05-06T13:52:12.462 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:52:12.736 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:53 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:12.784 INFO:teuthology.orchestra.run.smithi123.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.1-0. 51 MB/s | 7.4 MB 00:00 2024-05-06T13:52:12.843 INFO:teuthology.orchestra.run.smithi123.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 562 kB/s | 33 kB 00:00 2024-05-06T13:52:12.857 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:12.858 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:12.858 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-05-06T13:52:12.858 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:12.858 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:52:12.858 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:18.2.1-0.el9 ceph-noarch 1.8 M 2024-05-06T13:52:12.858 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-05-06T13:52:12.858 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:18.2.1-0.el9 ceph-noarch 23 k 2024-05-06T13:52:12.858 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:18.2.1-0.el9 ceph-noarch 15 k 2024-05-06T13:52:12.859 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-05-06T13:52:12.859 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-06T13:52:12.859 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-06T13:52:12.859 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2024-05-06T13:52:12.859 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-05-06T13:52:12.859 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:12.859 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:52:12.859 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:12.859 INFO:teuthology.orchestra.run.smithi174.stdout:Install 7 Packages 2024-05-06T13:52:12.859 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:12.860 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 2.1 M 2024-05-06T13:52:12.860 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 8.5 M 2024-05-06T13:52:12.860 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:52:12.869 INFO:teuthology.orchestra.run.smithi123.stdout:(3/12): libquadmath-11.4.1-3.el9.x86_64.rpm 854 kB/s | 195 kB 00:00 2024-05-06T13:52:12.919 INFO:teuthology.orchestra.run.smithi123.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 366 kB/s | 18 kB 00:00 2024-05-06T13:52:12.969 INFO:teuthology.orchestra.run.smithi123.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 705 kB/s | 35 kB 00:00 2024-05-06T13:52:13.011 INFO:teuthology.orchestra.run.smithi123.stdout:(6/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-05-06T13:52:13.062 INFO:teuthology.orchestra.run.smithi123.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-05-06T13:52:13.120 INFO:teuthology.orchestra.run.smithi174.stdout:(1/7): ceph-grafana-dashboards-18.2.1-0.el9.noa 201 kB/s | 23 kB 00:00 2024-05-06T13:52:13.128 INFO:teuthology.orchestra.run.smithi123.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-05-06T13:52:13.145 INFO:teuthology.orchestra.run.smithi174.stdout:(2/7): ceph-prometheus-alerts-18.2.1-0.el9.noar 104 kB/s | 15 kB 00:00 2024-05-06T13:52:13.196 INFO:teuthology.orchestra.run.smithi174.stdout:(3/7): ceph-mgr-dashboard-18.2.1-0.el9.noarch.r 9.2 MB/s | 1.8 MB 00:00 2024-05-06T13:52:13.228 INFO:teuthology.orchestra.run.smithi123.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.5 MB/s | 250 kB 00:00 2024-05-06T13:52:13.296 INFO:teuthology.orchestra.run.smithi123.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 15 MB/s | 4.7 MB 00:00 2024-05-06T13:52:13.371 INFO:teuthology.orchestra.run.smithi123.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-05-06T13:52:13.396 INFO:teuthology.orchestra.run.smithi174.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 33 kB/s | 9.0 kB 00:00 2024-05-06T13:52:13.471 INFO:teuthology.orchestra.run.smithi174.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 126 kB/s | 41 kB 00:00 2024-05-06T13:52:13.530 INFO:teuthology.orchestra.run.smithi174.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 107 kB/s | 31 kB 00:00 2024-05-06T13:52:13.663 INFO:teuthology.orchestra.run.smithi174.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 708 kB/s | 188 kB 00:00 2024-05-06T13:52:13.667 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:13.667 INFO:teuthology.orchestra.run.smithi174.stdout:Total 2.5 MB/s | 2.1 MB 00:00 2024-05-06T13:52:13.667 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:52:13.675 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:52:13.675 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:52:13.726 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:52:13.726 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:52:13.846 INFO:teuthology.orchestra.run.smithi123.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-05-06T13:52:13.847 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:13.847 INFO:teuthology.orchestra.run.smithi123.stdout:Total 27 MB/s | 38 MB 00:01 2024-05-06T13:52:14.021 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:52:14.081 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-05-06T13:52:14.115 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-05-06T13:52:14.162 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-05-06T13:52:14.197 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:52:14.201 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-05-06T13:52:14.222 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 5/7 2024-05-06T13:52:14.223 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:52:14.223 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:52:14.449 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 6/7 2024-05-06T13:52:14.475 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-05-06T13:52:14.625 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:52:14.625 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:52:14.965 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-05-06T13:52:14.965 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 1/7 2024-05-06T13:52:14.965 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2/7 2024-05-06T13:52:14.965 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 3/7 2024-05-06T13:52:14.966 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-05-06T13:52:14.966 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-05-06T13:52:14.966 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-05-06T13:52:15.214 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-05-06T13:52:15.214 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:15.214 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:15.214 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 2024-05-06T13:52:15.214 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2024-05-06T13:52:15.215 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 2024-05-06T13:52:15.215 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-05-06T13:52:15.215 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-05-06T13:52:15.215 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-06T13:52:15.215 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-06T13:52:15.215 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:15.215 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:15.370 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:52:15.416 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-06T13:52:15.425 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-06T13:52:15.460 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-06T13:52:15.558 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-06T13:52:15.595 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-06T13:52:15.773 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-06T13:52:15.802 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-06T13:52:15.869 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-06T13:52:15.925 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:56 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:16.045 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:16.046 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:16.046 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-0.el9 ceph-noarch 7.4 M 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-06T13:52:16.047 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-06T13:52:16.048 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-06T13:52:16.048 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:16.048 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:52:16.048 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:16.048 INFO:teuthology.orchestra.run.smithi174.stdout:Install 12 Packages 2024-05-06T13:52:16.048 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:16.048 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 38 M 2024-05-06T13:52:16.048 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 209 M 2024-05-06T13:52:16.049 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:52:16.419 INFO:teuthology.orchestra.run.smithi174.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.1-0. 44 MB/s | 7.4 MB 00:00 2024-05-06T13:52:16.507 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-06T13:52:16.528 INFO:teuthology.orchestra.run.smithi174.stdout:(2/12): libquadmath-11.4.1-3.el9.x86_64.rpm 710 kB/s | 195 kB 00:00 2024-05-06T13:52:16.553 INFO:teuthology.orchestra.run.smithi174.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-05-06T13:52:16.612 INFO:teuthology.orchestra.run.smithi174.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 311 kB/s | 18 kB 00:00 2024-05-06T13:52:16.623 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-06T13:52:16.637 INFO:teuthology.orchestra.run.smithi174.stdout:(5/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.0 MB/s | 803 kB 00:00 2024-05-06T13:52:16.662 INFO:teuthology.orchestra.run.smithi174.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-05-06T13:52:16.762 INFO:teuthology.orchestra.run.smithi174.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-05-06T13:52:17.188 INFO:teuthology.orchestra.run.smithi174.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.5 MB/s | 3.0 MB 00:00 2024-05-06T13:52:17.271 INFO:teuthology.orchestra.run.smithi174.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-05-06T13:52:17.488 INFO:teuthology.orchestra.run.smithi174.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 5.6 MB/s | 4.7 MB 00:00 2024-05-06T13:52:17.697 INFO:teuthology.orchestra.run.smithi174.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.5 MB/s | 5.1 MB 00:00 2024-05-06T13:52:17.856 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-06T13:52:18.897 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-06T13:52:18.926 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-05-06T13:52:20.113 INFO:teuthology.orchestra.run.smithi174.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.7 MB/s | 16 MB 00:02 2024-05-06T13:52:20.114 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:20.115 INFO:teuthology.orchestra.run.smithi174.stdout:Total 9.3 MB/s | 38 MB 00:04 2024-05-06T13:52:20.473 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:52:20.499 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:52:20.499 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:52:20.906 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:52:20.906 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:52:21.388 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-05-06T13:52:21.388 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 1/12 2024-05-06T13:52:21.388 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-06T13:52:21.388 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-06T13:52:21.388 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-06T13:52:21.388 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-06T13:52:21.388 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-06T13:52:21.389 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-06T13:52:21.389 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-06T13:52:21.389 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-06T13:52:21.389 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-06T13:52:21.389 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-06T13:52:21.661 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:52:21.718 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-06T13:52:21.761 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-06T13:52:21.784 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-06T13:52:21.784 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:21.784 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:21.784 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarch 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:21.785 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:21.860 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-06T13:52:21.896 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-06T13:52:22.074 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-06T13:52:22.102 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-06T13:52:22.143 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr-rook 2024-05-06T13:52:22.179 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-06T13:52:22.669 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:07 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:22.791 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:22.793 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:22.793 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-05-06T13:52:22.793 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:22.793 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:52:22.793 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:18.2.1-0.el9 ceph-noarch 50 k 2024-05-06T13:52:22.793 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-05-06T13:52:22.793 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-06T13:52:22.793 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-06T13:52:22.793 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-06T13:52:22.793 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout:Install 13 Packages 2024-05-06T13:52:22.794 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:22.795 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 2.2 M 2024-05-06T13:52:22.795 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 26 M 2024-05-06T13:52:22.795 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:52:22.823 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-06T13:52:22.933 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-06T13:52:23.117 INFO:teuthology.orchestra.run.smithi123.stdout:(1/13): ceph-mgr-rook-18.2.1-0.el9.noarch.rpm 695 kB/s | 50 kB 00:00 2024-05-06T13:52:23.200 INFO:teuthology.orchestra.run.smithi123.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 123 kB/s | 19 kB 00:00 2024-05-06T13:52:23.225 INFO:teuthology.orchestra.run.smithi123.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 142 kB/s | 26 kB 00:00 2024-05-06T13:52:23.293 INFO:teuthology.orchestra.run.smithi123.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-05-06T13:52:23.318 INFO:teuthology.orchestra.run.smithi123.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.1 MB/s | 222 kB 00:00 2024-05-06T13:52:23.352 INFO:teuthology.orchestra.run.smithi123.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 914 kB/s | 54 kB 00:00 2024-05-06T13:52:23.394 INFO:teuthology.orchestra.run.smithi123.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.6 MB/s | 279 kB 00:00 2024-05-06T13:52:23.436 INFO:teuthology.orchestra.run.smithi123.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 274 kB/s | 32 kB 00:00 2024-05-06T13:52:23.461 INFO:teuthology.orchestra.run.smithi123.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 138 kB/s | 15 kB 00:00 2024-05-06T13:52:23.536 INFO:teuthology.orchestra.run.smithi123.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 1.4 MB/s | 206 kB 00:00 2024-05-06T13:52:23.571 INFO:teuthology.orchestra.run.smithi123.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 543 kB/s | 59 kB 00:00 2024-05-06T13:52:23.595 INFO:teuthology.orchestra.run.smithi123.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-05-06T13:52:23.645 INFO:teuthology.orchestra.run.smithi123.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.9 MB/s | 1.0 MB 00:00 2024-05-06T13:52:23.645 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:23.646 INFO:teuthology.orchestra.run.smithi123.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-05-06T13:52:23.708 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:52:23.722 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:52:23.722 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:52:23.805 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:52:23.805 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:52:24.159 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-06T13:52:24.373 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:52:24.605 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-06T13:52:24.664 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-06T13:52:24.727 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-06T13:52:24.764 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-06T13:52:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-06T13:52:24.908 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-06T13:52:25.020 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-06T13:52:25.074 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-06T13:52:25.192 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-06T13:52:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-05-06T13:52:25.804 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-06T13:52:25.862 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-06T13:52:25.896 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-06T13:52:25.944 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-06T13:52:25.957 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-05-06T13:52:26.670 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-05-06T13:52:26.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:18.2.1-0.el9.noarch 1/13 2024-05-06T13:52:26.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-06T13:52:26.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-06T13:52:26.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-06T13:52:26.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-06T13:52:26.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-06T13:52:26.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-06T13:52:26.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-06T13:52:26.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-06T13:52:26.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-06T13:52:26.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-06T13:52:26.671 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-06T13:52:26.968 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-06T13:52:26.969 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:26.969 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:26.969 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:18.2.1-0.el9.noarch 2024-05-06T13:52:26.969 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-06T13:52:26.969 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-06T13:52:26.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-06T13:52:26.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-06T13:52:26.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-06T13:52:26.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-06T13:52:26.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-06T13:52:26.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-06T13:52:26.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-06T13:52:26.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-06T13:52:26.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-06T13:52:26.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-06T13:52:26.971 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:26.971 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:27.209 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-mgr-cephadm 2024-05-06T13:52:27.583 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-05-06T13:52:27.583 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 1/12 2024-05-06T13:52:27.583 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-06T13:52:27.583 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-06T13:52:27.583 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-06T13:52:27.583 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-06T13:52:27.583 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-06T13:52:27.583 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-06T13:52:27.584 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-06T13:52:27.584 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-06T13:52:27.584 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-06T13:52:27.584 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-06T13:52:27.750 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:12 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:27.875 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:27.875 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:27.876 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-05-06T13:52:27.876 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:27.876 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:52:27.876 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:18.2.1-0.el9 ceph-noarch 132 k 2024-05-06T13:52:27.876 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-05-06T13:52:27.876 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-06T13:52:27.876 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-06T13:52:27.876 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-06T13:52:27.876 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-06T13:52:27.876 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-06T13:52:27.877 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:27.877 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:52:27.877 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:27.877 INFO:teuthology.orchestra.run.smithi123.stdout:Install 6 Packages 2024-05-06T13:52:27.877 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:27.877 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 7.0 M 2024-05-06T13:52:27.877 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 33 M 2024-05-06T13:52:27.878 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:52:27.997 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-06T13:52:27.998 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:27.998 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:27.998 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarch 2024-05-06T13:52:27.998 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-06T13:52:27.998 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-06T13:52:27.999 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-06T13:52:27.999 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-06T13:52:27.999 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-06T13:52:27.999 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-06T13:52:27.999 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-06T13:52:27.999 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-06T13:52:28.000 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-06T13:52:28.000 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-06T13:52:28.000 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-06T13:52:28.000 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:28.000 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:28.352 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-mgr-rook 2024-05-06T13:52:28.515 INFO:teuthology.orchestra.run.smithi123.stdout:(1/6): ceph-mgr-cephadm-18.2.1-0.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2024-05-06T13:52:28.815 INFO:teuthology.orchestra.run.smithi123.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 681 kB/s | 248 kB 00:00 2024-05-06T13:52:28.870 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:09 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:28.994 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:28.995 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:28.995 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-05-06T13:52:28.995 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:28.995 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:52:28.995 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:18.2.1-0.el9 ceph-noarch 50 k 2024-05-06T13:52:28.995 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-05-06T13:52:28.995 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-06T13:52:28.995 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout:Install 13 Packages 2024-05-06T13:52:28.996 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:28.997 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 2.2 M 2024-05-06T13:52:28.997 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 26 M 2024-05-06T13:52:28.997 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:52:29.182 INFO:teuthology.orchestra.run.smithi123.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 8.2 MB/s | 6.0 MB 00:00 2024-05-06T13:52:29.282 INFO:teuthology.orchestra.run.smithi123.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 124 kB/s | 58 kB 00:00 2024-05-06T13:52:29.416 INFO:teuthology.orchestra.run.smithi123.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 609 kB/s | 548 kB 00:00 2024-05-06T13:52:29.416 INFO:teuthology.orchestra.run.smithi174.stdout:(1/13): ceph-mgr-rook-18.2.1-0.el9.noarch.rpm 752 kB/s | 50 kB 00:00 2024-05-06T13:52:29.575 INFO:teuthology.orchestra.run.smithi174.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 85 kB/s | 19 kB 00:00 2024-05-06T13:52:29.600 INFO:teuthology.orchestra.run.smithi174.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 102 kB/s | 26 kB 00:00 2024-05-06T13:52:29.608 INFO:teuthology.orchestra.run.smithi123.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 120 kB/s | 51 kB 00:00 2024-05-06T13:52:29.608 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:29.608 INFO:teuthology.orchestra.run.smithi123.stdout:Total 4.0 MB/s | 7.0 MB 00:01 2024-05-06T13:52:29.680 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:52:29.691 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:52:29.692 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:52:29.742 INFO:teuthology.orchestra.run.smithi174.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 682 kB/s | 222 kB 00:00 2024-05-06T13:52:29.776 INFO:teuthology.orchestra.run.smithi174.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 792 kB/s | 159 kB 00:00 2024-05-06T13:52:29.787 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:52:29.789 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:52:29.810 INFO:teuthology.orchestra.run.smithi174.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 800 kB/s | 54 kB 00:00 2024-05-06T13:52:29.843 INFO:teuthology.orchestra.run.smithi174.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-05-06T13:52:30.091 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:52:30.118 INFO:teuthology.orchestra.run.smithi174.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 94 kB/s | 32 kB 00:00 2024-05-06T13:52:30.144 INFO:teuthology.orchestra.run.smithi174.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 45 kB/s | 15 kB 00:00 2024-05-06T13:52:30.257 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-06T13:52:30.309 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-06T13:52:30.319 INFO:teuthology.orchestra.run.smithi174.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 338 kB/s | 59 kB 00:00 2024-05-06T13:52:30.377 INFO:teuthology.orchestra.run.smithi174.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 423 kB/s | 206 kB 00:00 2024-05-06T13:52:30.461 INFO:teuthology.orchestra.run.smithi174.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 632 kB/s | 90 kB 00:00 2024-05-06T13:52:30.503 INFO:teuthology.orchestra.run.smithi174.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.7 MB/s | 1.0 MB 00:00 2024-05-06T13:52:30.505 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:30.506 INFO:teuthology.orchestra.run.smithi174.stdout:Total 1.5 MB/s | 2.2 MB 00:01 2024-05-06T13:52:30.569 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:52:30.583 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:52:30.583 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:52:30.666 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:52:30.667 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:52:30.837 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-06T13:52:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-06T13:52:30.990 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-06T13:52:31.013 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-05-06T13:52:31.237 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:52:31.407 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-06T13:52:31.470 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-06T13:52:31.525 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-06T13:52:31.563 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-06T13:52:31.604 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-06T13:52:31.698 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-06T13:52:31.793 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-05-06T13:52:31.794 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 1/6 2024-05-06T13:52:31.794 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-06T13:52:31.794 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-06T13:52:31.794 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-06T13:52:31.794 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-06T13:52:31.808 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-06T13:52:31.856 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-06T13:52:32.041 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-06T13:52:32.041 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:32.042 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:32.042 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 2024-05-06T13:52:32.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-06T13:52:32.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-06T13:52:32.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-06T13:52:32.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-06T13:52:32.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-06T13:52:32.042 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:32.042 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:32.253 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-fuse 2024-05-06T13:52:32.573 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-06T13:52:32.628 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-06T13:52:32.662 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-06T13:52:32.709 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-06T13:52:32.731 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-05-06T13:52:32.762 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:17 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:32.880 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:32.880 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:32.880 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:32.880 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:52:32.881 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:18.2.1-0.el9 ceph 839 k 2024-05-06T13:52:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-05-06T13:52:32.881 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-06T13:52:32.881 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:52:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:Install 2 Packages 2024-05-06T13:52:32.881 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:32.882 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 920 k 2024-05-06T13:52:32.882 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 2.7 M 2024-05-06T13:52:32.882 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:52:33.118 INFO:teuthology.orchestra.run.smithi123.stdout:(1/2): ceph-fuse-18.2.1-0.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-05-06T13:52:33.534 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-05-06T13:52:33.534 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:18.2.1-0.el9.noarch 1/13 2024-05-06T13:52:33.534 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-06T13:52:33.534 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-06T13:52:33.534 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-06T13:52:33.534 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-06T13:52:33.534 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-06T13:52:33.534 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-06T13:52:33.534 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-06T13:52:33.535 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-06T13:52:33.535 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-06T13:52:33.535 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-06T13:52:33.535 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-06T13:52:33.834 INFO:teuthology.orchestra.run.smithi123.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 101 kB/s | 80 kB 00:00 2024-05-06T13:52:33.835 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:33.836 INFO:teuthology.orchestra.run.smithi123.stdout:Total 963 kB/s | 920 kB 00:00 2024-05-06T13:52:33.845 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-06T13:52:33.845 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:33.845 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:33.845 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:18.2.1-0.el9.noarch 2024-05-06T13:52:33.845 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-06T13:52:33.845 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-06T13:52:33.845 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-06T13:52:33.845 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-06T13:52:33.845 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-06T13:52:33.845 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-06T13:52:33.845 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-06T13:52:33.845 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-06T13:52:33.846 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-06T13:52:33.846 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-06T13:52:33.846 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-06T13:52:33.846 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-06T13:52:33.846 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:33.846 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:33.848 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:52:33.870 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:52:33.870 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:52:33.947 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:52:33.950 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:52:34.059 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-mgr-cephadm 2024-05-06T13:52:34.128 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:52:34.274 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-06T13:52:34.356 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-05-06T13:52:34.572 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:15 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:34.693 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:34.693 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:34.693 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-05-06T13:52:34.694 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:34.694 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:52:34.694 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:18.2.1-0.el9 ceph-noarch 132 k 2024-05-06T13:52:34.694 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-05-06T13:52:34.694 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-06T13:52:34.694 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-06T13:52:34.694 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-06T13:52:34.694 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-06T13:52:34.694 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-06T13:52:34.694 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:34.695 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:52:34.695 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:34.695 INFO:teuthology.orchestra.run.smithi174.stdout:Install 6 Packages 2024-05-06T13:52:34.695 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:34.695 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 7.0 M 2024-05-06T13:52:34.695 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 33 M 2024-05-06T13:52:34.695 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:52:34.879 INFO:teuthology.orchestra.run.smithi174.stdout:(1/6): ceph-mgr-cephadm-18.2.1-0.el9.noarch.rpm 2.1 MB/s | 132 kB 00:00 2024-05-06T13:52:34.947 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-05-06T13:52:34.948 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:18.2.1-0.el9.x86_64 1/2 2024-05-06T13:52:34.979 INFO:teuthology.orchestra.run.smithi174.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-05-06T13:52:35.138 INFO:teuthology.orchestra.run.smithi174.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-05-06T13:52:35.163 INFO:teuthology.orchestra.run.smithi174.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 314 kB/s | 58 kB 00:00 2024-05-06T13:52:35.184 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-06T13:52:35.184 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:35.184 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:35.184 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:18.2.1-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-06T13:52:35.184 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:35.184 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:35.313 INFO:teuthology.orchestra.run.smithi174.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 291 kB/s | 51 kB 00:00 2024-05-06T13:52:35.437 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install librados-devel 2024-05-06T13:52:35.963 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:20 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:36.086 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:36.087 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:36.087 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:36.087 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:36.087 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:52:36.087 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:18.2.1-0.el9 ceph 127 k 2024-05-06T13:52:36.088 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:36.088 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:52:36.088 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:36.088 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-05-06T13:52:36.088 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:36.088 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 127 k 2024-05-06T13:52:36.088 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 456 k 2024-05-06T13:52:36.088 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:52:36.162 INFO:teuthology.orchestra.run.smithi123.stdout:librados-devel-18.2.1-0.el9.x86_64.rpm 1.7 MB/s | 127 kB 00:00 2024-05-06T13:52:36.162 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:36.162 INFO:teuthology.orchestra.run.smithi123.stdout:Total 1.7 MB/s | 127 kB 00:00 2024-05-06T13:52:36.163 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:52:36.166 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:52:36.166 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:52:36.229 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:52:36.229 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:52:36.390 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:52:36.518 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:36.747 INFO:teuthology.orchestra.run.smithi174.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 293 kB/s | 548 kB 00:01 2024-05-06T13:52:36.747 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:36.747 INFO:teuthology.orchestra.run.smithi174.stdout:Total 3.4 MB/s | 7.0 MB 00:02 2024-05-06T13:52:36.820 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:52:36.831 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:52:36.832 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:52:36.911 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:36.927 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:52:36.927 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:52:37.124 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:37.124 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:37.124 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:37.124 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:37.124 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:37.124 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:37.240 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:52:37.350 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install libcephfs2 2024-05-06T13:52:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-06T13:52:37.464 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-06T13:52:37.870 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:22 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:37.956 INFO:teuthology.orchestra.run.smithi123.stdout:Package libcephfs2-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:37.985 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-06T13:52:38.000 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:38.000 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-05-06T13:52:38.001 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:38.068 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-06T13:52:38.089 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install libcephfs-devel 2024-05-06T13:52:38.128 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-06T13:52:38.152 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-05-06T13:52:38.610 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:23 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:38.729 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:38.730 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:38.730 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:38.730 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:38.730 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:52:38.730 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:18.2.1-0.el9 ceph 31 k 2024-05-06T13:52:38.730 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:38.730 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:52:38.730 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:38.730 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-05-06T13:52:38.730 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:38.731 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 31 k 2024-05-06T13:52:38.731 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 139 k 2024-05-06T13:52:38.731 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:52:38.793 INFO:teuthology.orchestra.run.smithi123.stdout:libcephfs-devel-18.2.1-0.el9.x86_64.rpm 497 kB/s | 31 kB 00:00 2024-05-06T13:52:38.794 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:38.794 INFO:teuthology.orchestra.run.smithi123.stdout:Total 486 kB/s | 31 kB 00:00 2024-05-06T13:52:38.794 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:52:38.797 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:52:38.798 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:52:38.799 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:52:38.800 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:52:38.885 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-05-06T13:52:38.885 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 1/6 2024-05-06T13:52:38.885 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-06T13:52:38.886 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-06T13:52:38.886 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-06T13:52:38.886 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-06T13:52:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:52:38.987 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:39.144 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-06T13:52:39.144 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:39.144 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:39.145 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 2024-05-06T13:52:39.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-06T13:52:39.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-06T13:52:39.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-06T13:52:39.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-06T13:52:39.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-06T13:52:39.145 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:39.145 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:39.344 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:39.352 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-fuse 2024-05-06T13:52:39.555 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:39.556 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:39.556 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:39.556 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:39.556 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:39.556 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:39.725 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install librados2 2024-05-06T13:52:39.863 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:20 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:39.993 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:39.994 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:39.994 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:39.994 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:39.994 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:52:39.994 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:18.2.1-0.el9 ceph 839 k 2024-05-06T13:52:39.994 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-05-06T13:52:39.994 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-06T13:52:39.994 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:39.994 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:52:39.994 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:39.994 INFO:teuthology.orchestra.run.smithi174.stdout:Install 2 Packages 2024-05-06T13:52:39.994 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:39.995 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 920 k 2024-05-06T13:52:39.995 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 2.7 M 2024-05-06T13:52:39.995 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:52:40.236 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:25 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:40.314 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:40.355 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:40.355 INFO:teuthology.orchestra.run.smithi174.stdout:(1/2): ceph-fuse-18.2.1-0.el9.x86_64.rpm 9.3 MB/s | 839 kB 00:00 2024-05-06T13:52:40.356 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-05-06T13:52:40.356 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:40.406 INFO:teuthology.orchestra.run.smithi174.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 581 kB/s | 80 kB 00:00 2024-05-06T13:52:40.407 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:40.407 INFO:teuthology.orchestra.run.smithi174.stdout:Total 2.2 MB/s | 920 kB 00:00 2024-05-06T13:52:40.415 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install librbd1 2024-05-06T13:52:40.418 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:52:40.440 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:52:40.440 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:52:40.520 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:52:40.520 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:52:40.726 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:52:40.853 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-06T13:52:40.919 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-05-06T13:52:40.926 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:25 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:41.046 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:41.047 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-05-06T13:52:41.047 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:41.120 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install python3-rados 2024-05-06T13:52:41.517 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-05-06T13:52:41.517 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:18.2.1-0.el9.x86_64 1/2 2024-05-06T13:52:41.632 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:26 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:41.711 INFO:teuthology.orchestra.run.smithi123.stdout:Package python3-rados-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:41.752 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:41.752 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-05-06T13:52:41.752 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:41.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-06T13:52:41.779 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:41.779 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:41.779 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:18.2.1-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-06T13:52:41.779 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:41.779 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:41.818 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install python3-rgw 2024-05-06T13:52:41.997 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install librados-devel 2024-05-06T13:52:42.329 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:27 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:42.407 INFO:teuthology.orchestra.run.smithi123.stdout:Package python3-rgw-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:42.448 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:42.449 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-05-06T13:52:42.449 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:42.510 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install python3-cephfs 2024-05-06T13:52:42.531 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:23 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:42.653 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:42.654 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:42.654 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:42.654 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:42.654 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:52:42.654 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:18.2.1-0.el9 ceph 127 k 2024-05-06T13:52:42.654 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:42.654 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:52:42.654 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:42.654 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package 2024-05-06T13:52:42.655 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:42.655 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 127 k 2024-05-06T13:52:42.655 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 456 k 2024-05-06T13:52:42.655 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:52:42.710 INFO:teuthology.orchestra.run.smithi174.stdout:librados-devel-18.2.1-0.el9.x86_64.rpm 2.3 MB/s | 127 kB 00:00 2024-05-06T13:52:42.711 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:42.711 INFO:teuthology.orchestra.run.smithi174.stdout:Total 2.2 MB/s | 127 kB 00:00 2024-05-06T13:52:42.711 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:52:42.716 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:52:42.716 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:52:42.779 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:52:42.780 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:52:42.927 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:52:43.025 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:28 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:43.103 INFO:teuthology.orchestra.run.smithi123.stdout:Package python3-cephfs-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:43.146 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:43.147 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-05-06T13:52:43.147 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:43.211 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install python3-rbd 2024-05-06T13:52:43.425 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:43.686 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:43.686 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:43.686 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:43.687 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:43.687 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:43.687 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:28 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:43.796 INFO:teuthology.orchestra.run.smithi123.stdout:Package python3-rbd-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:43.836 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:43.837 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-05-06T13:52:43.837 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:43.901 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install rbd-fuse 2024-05-06T13:52:43.919 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install libcephfs2 2024-05-06T13:52:44.420 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:29 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:44.444 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:25 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:44.525 INFO:teuthology.orchestra.run.smithi174.stdout:Package libcephfs2-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:44.539 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:44.539 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:44.539 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:44.539 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:44.539 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:52:44.539 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:18.2.1-0.el9 ceph 86 k 2024-05-06T13:52:44.540 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:44.540 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:52:44.540 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:44.540 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-05-06T13:52:44.540 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:44.540 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 86 k 2024-05-06T13:52:44.540 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 226 k 2024-05-06T13:52:44.541 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:52:44.567 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:44.568 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do. 2024-05-06T13:52:44.568 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:44.604 INFO:teuthology.orchestra.run.smithi123.stdout:rbd-fuse-18.2.1-0.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2024-05-06T13:52:44.605 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:44.605 INFO:teuthology.orchestra.run.smithi123.stdout:Total 1.3 MB/s | 86 kB 00:00 2024-05-06T13:52:44.605 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:52:44.612 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:52:44.612 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:52:44.639 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install libcephfs-devel 2024-05-06T13:52:44.674 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:52:44.674 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:52:44.814 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:52:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:45.157 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:26 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:45.252 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:45.277 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:45.278 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:45.278 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:45.278 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:45.278 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:52:45.278 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:18.2.1-0.el9 ceph 31 k 2024-05-06T13:52:45.278 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:45.278 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:52:45.278 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:45.278 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package 2024-05-06T13:52:45.278 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:45.279 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 31 k 2024-05-06T13:52:45.279 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 139 k 2024-05-06T13:52:45.279 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:52:45.347 INFO:teuthology.orchestra.run.smithi174.stdout:libcephfs-devel-18.2.1-0.el9.x86_64.rpm 461 kB/s | 31 kB 00:00 2024-05-06T13:52:45.347 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:45.347 INFO:teuthology.orchestra.run.smithi174.stdout:Total 452 kB/s | 31 kB 00:00 2024-05-06T13:52:45.347 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:52:45.350 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:52:45.350 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:52:45.353 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:52:45.353 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:52:45.440 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:52:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:45.502 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:45.502 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:45.549 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:45.769 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install rbd-mirror 2024-05-06T13:52:45.887 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:46.109 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:46.109 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:46.263 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install librados2 2024-05-06T13:52:46.287 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:31 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:46.408 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:46.408 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:46.409 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:46.409 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:52:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-05-06T13:52:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:46.409 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:52:46.409 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:46.409 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-05-06T13:52:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:46.410 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 3.0 M 2024-05-06T13:52:46.410 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 12 M 2024-05-06T13:52:46.410 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:52:46.511 INFO:teuthology.orchestra.run.smithi123.stdout:rbd-mirror-18.2.1-0.el9.x86_64.rpm 30 MB/s | 3.0 MB 00:00 2024-05-06T13:52:46.511 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:46.512 INFO:teuthology.orchestra.run.smithi123.stdout:Total 29 MB/s | 3.0 MB 00:00 2024-05-06T13:52:46.512 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:52:46.520 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:52:46.521 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:52:46.602 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:52:46.603 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:52:46.777 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:27 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:46.857 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:46.897 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:46.898 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do. 2024-05-06T13:52:46.898 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:46.970 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install librbd1 2024-05-06T13:52:47.022 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:52:47.187 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:47.212 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:47.213 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:52:47.213 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-06T13:52:47.213 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-06T13:52:47.213 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-06T13:52:47.213 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:47.482 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:28 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:47.561 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:47.601 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:47.602 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do. 2024-05-06T13:52:47.602 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:47.666 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install python3-rados 2024-05-06T13:52:48.091 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:48.091 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:48.091 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:48.091 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:48.091 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:48.091 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:48.183 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:29 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:48.263 INFO:teuthology.orchestra.run.smithi174.stdout:Package python3-rados-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:48.303 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:48.304 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do. 2024-05-06T13:52:48.305 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:48.349 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install rbd-nbd 2024-05-06T13:52:48.370 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install python3-rgw 2024-05-06T13:52:48.872 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:33 ago on Mon 06 May 2024 01:51:15 PM UTC. 2024-05-06T13:52:48.883 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:29 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:48.962 INFO:teuthology.orchestra.run.smithi174.stdout:Package python3-rgw-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:48.996 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:18.2.1-0.el9 ceph 171 k 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout:Install 1 Package 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 171 k 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 494 k 2024-05-06T13:52:48.999 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-05-06T13:52:49.003 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:49.005 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do. 2024-05-06T13:52:49.005 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:49.056 INFO:teuthology.orchestra.run.smithi123.stdout:rbd-nbd-18.2.1-0.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-05-06T13:52:49.058 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:49.058 INFO:teuthology.orchestra.run.smithi123.stdout:Total 2.8 MB/s | 171 kB 00:00 2024-05-06T13:52:49.058 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-05-06T13:52:49.065 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install python3-cephfs 2024-05-06T13:52:49.066 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-05-06T13:52:49.066 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-05-06T13:52:49.129 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-05-06T13:52:49.129 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-05-06T13:52:49.281 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-05-06T13:52:49.393 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:49.584 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:30 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:49.664 INFO:teuthology.orchestra.run.smithi174.stdout:Package python3-cephfs-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:49.705 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:49.706 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do. 2024-05-06T13:52:49.706 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:49.764 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:49.772 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install python3-rbd 2024-05-06T13:52:50.006 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:50.006 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:50.006 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-05-06T13:52:50.006 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:50.006 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:52:50.006 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-05-06T13:52:50.260 DEBUG:teuthology.parallel:result is None 2024-05-06T13:52:50.281 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:31 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:50.359 INFO:teuthology.orchestra.run.smithi174.stdout:Package python3-rbd-2:18.2.1-0.el9.x86_64 is already installed. 2024-05-06T13:52:50.399 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:50.400 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do. 2024-05-06T13:52:50.400 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:50.465 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install rbd-fuse 2024-05-06T13:52:50.980 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:31 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:51.099 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:51.100 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:51.100 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:51.100 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:51.100 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:52:51.100 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:18.2.1-0.el9 ceph 86 k 2024-05-06T13:52:51.100 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:51.101 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:52:51.101 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:51.101 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package 2024-05-06T13:52:51.101 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:51.101 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 86 k 2024-05-06T13:52:51.101 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 226 k 2024-05-06T13:52:51.101 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:52:51.174 INFO:teuthology.orchestra.run.smithi174.stdout:rbd-fuse-18.2.1-0.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2024-05-06T13:52:51.175 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:51.175 INFO:teuthology.orchestra.run.smithi174.stdout:Total 1.1 MB/s | 86 kB 00:00 2024-05-06T13:52:51.175 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:52:51.181 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:52:51.181 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:52:51.243 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:52:51.244 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:52:51.386 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:52:51.495 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:51.879 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:52.134 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:52.134 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:52.134 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:52.134 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:52.134 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:52.134 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:52.366 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install rbd-mirror 2024-05-06T13:52:52.888 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:33 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:53.009 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:53.010 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:53.010 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:53.010 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:53.010 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:52:53.011 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-05-06T13:52:53.011 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:53.011 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:52:53.011 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:53.011 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package 2024-05-06T13:52:53.011 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:53.011 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 3.0 M 2024-05-06T13:52:53.011 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 12 M 2024-05-06T13:52:53.011 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:52:53.154 INFO:teuthology.orchestra.run.smithi174.stdout:rbd-mirror-18.2.1-0.el9.x86_64.rpm 21 MB/s | 3.0 MB 00:00 2024-05-06T13:52:53.154 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:53.155 INFO:teuthology.orchestra.run.smithi174.stdout:Total 21 MB/s | 3.0 MB 00:00 2024-05-06T13:52:53.155 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:52:53.164 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:52:53.164 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:52:53.246 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:52:53.246 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:52:53.662 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:52:53.824 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:53.848 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:53.848 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T13:52:53.848 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-06T13:52:53.848 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-06T13:52:53.848 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-06T13:52:53.848 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:54.716 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:54.716 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:54.716 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:54.716 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:54.716 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:54.716 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:54.933 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install rbd-nbd 2024-05-06T13:52:55.461 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:01:36 ago on Mon 06 May 2024 01:51:19 PM UTC. 2024-05-06T13:52:55.583 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-06T13:52:55.584 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:55.584 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-05-06T13:52:55.584 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:55.584 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-06T13:52:55.584 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:18.2.1-0.el9 ceph 171 k 2024-05-06T13:52:55.584 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:55.584 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-06T13:52:55.584 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-06T13:52:55.584 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package 2024-05-06T13:52:55.584 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:55.585 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 171 k 2024-05-06T13:52:55.585 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 494 k 2024-05-06T13:52:55.585 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-06T13:52:55.663 INFO:teuthology.orchestra.run.smithi174.stdout:rbd-nbd-18.2.1-0.el9.x86_64.rpm 2.3 MB/s | 171 kB 00:00 2024-05-06T13:52:55.663 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:52:55.664 INFO:teuthology.orchestra.run.smithi174.stdout:Total 2.2 MB/s | 171 kB 00:00 2024-05-06T13:52:55.664 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-06T13:52:55.668 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-06T13:52:55.668 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-06T13:52:55.730 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-06T13:52:55.730 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-06T13:52:55.879 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-06T13:52:55.980 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:56.349 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:56.599 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-05-06T13:52:56.599 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:56.599 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-06T13:52:56.599 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:18.2.1-0.el9.x86_64 2024-05-06T13:52:56.599 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:52:56.599 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-06T13:52:56.852 DEBUG:teuthology.parallel:result is None 2024-05-06T13:52:56.852 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-05-06T13:52:56.852 INFO:teuthology.packaging:ref: None 2024-05-06T13:52:56.852 INFO:teuthology.packaging:tag: v18.2.1 2024-05-06T13:52:56.852 INFO:teuthology.packaging:branch: None 2024-05-06T13:52:56.852 INFO:teuthology.packaging:sha1: 04416f48efe02891b265c07b4f38b46e422bbef9 2024-05-06T13:52:56.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-05-06T13:52:56.996 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-06T13:52:57.020 INFO:teuthology.orchestra.run.smithi123.stdout:18.2.1-0.el9 2024-05-06T13:52:57.021 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-0.el9 2024-05-06T13:52:57.021 INFO:teuthology.task.install:The correct ceph version 18.2.1-0 is installed. 2024-05-06T13:52:57.023 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-05-06T13:52:57.023 INFO:teuthology.packaging:ref: None 2024-05-06T13:52:57.023 INFO:teuthology.packaging:tag: v18.2.1 2024-05-06T13:52:57.023 INFO:teuthology.packaging:branch: None 2024-05-06T13:52:57.023 INFO:teuthology.packaging:sha1: 04416f48efe02891b265c07b4f38b46e422bbef9 2024-05-06T13:52:57.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-05-06T13:52:57.164 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-06T13:52:57.184 INFO:teuthology.orchestra.run.smithi174.stdout:18.2.1-0.el9 2024-05-06T13:52:57.185 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-0.el9 2024-05-06T13:52:57.185 INFO:teuthology.task.install:The correct ceph version 18.2.1-0 is installed. 2024-05-06T13:52:57.186 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-06T13:52:57.215 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:52:57.215 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-06T13:52:57.244 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T13:52:57.245 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-06T13:52:57.268 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-06T13:52:57.268 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:52:57.268 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-05-06T13:52:57.312 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-06T13:52:57.379 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T13:52:57.379 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-05-06T13:52:57.403 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-06T13:52:57.466 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-06T13:52:57.467 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:52:57.467 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-06T13:52:57.493 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-06T13:52:57.559 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T13:52:57.559 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-06T13:52:57.582 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-06T13:52:57.661 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-06T13:52:57.661 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:52:57.661 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-05-06T13:52:57.684 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-06T13:52:57.748 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T13:52:57.748 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-05-06T13:52:57.771 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-06T13:52:57.834 INFO:teuthology.run_tasks:Running task print... 2024-05-06T13:52:57.843 INFO:teuthology.task.print:**** done install task... 2024-05-06T13:52:57.843 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-06T13:52:58.210 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.io/ceph/ceph:v18.2.1', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '04416f48efe02891b265c07b4f38b46e422bbef9'} 2024-05-06T13:52:58.211 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.1 2024-05-06T13:52:58.211 INFO:tasks.cephadm:Cluster fsid is f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:52:58.211 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-06T13:52:58.211 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-05-06T13:52:58.211 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi123': '172.21.15.123', 'mon.smithi174': '172.21.15.174'} 2024-05-06T13:52:58.212 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-06T13:52:58.212 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname $(hostname -s) 2024-05-06T13:52:58.236 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname $(hostname -s) 2024-05-06T13:52:58.261 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-05-06T13:52:58.261 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04416f48efe02891b265c07b4f38b46e422bbef9 2024-05-06T13:52:58.482 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '04416f48efe02891b265c07b4f38b46e422bbef9', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55067/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3497-g04416f48', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3497.g04416f48'}, 'url': 'https://4.chacra.ceph.com/r/ceph/main/04416f48efe02891b265c07b4f38b46e422bbef9/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-03 19:35:29.784338', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'main', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/main/04416f48efe02891b265c07b4f38b46e422bbef9/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-06T13:52:58.734 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref reef, sha1 1758e8ea56486d7ed4a57cf883ac5d1ad36580ad from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-05-06T13:52:58.735 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/reef/1758e8ea56486d7ed4a57cf883ac5d1ad36580ad/centos/9/x86_64/flavors/default/cephadm 2024-05-06T13:52:58.736 DEBUG:teuthology.orchestra.run.smithi123:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/reef/1758e8ea56486d7ed4a57cf883ac5d1ad36580ad/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-06T13:52:59.126 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r--. 1 ubuntu ubuntu 215333 May 6 13:52 /home/ubuntu/cephtest/cephadm 2024-05-06T13:52:59.126 DEBUG:teuthology.orchestra.run.smithi174:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/reef/1758e8ea56486d7ed4a57cf883ac5d1ad36580ad/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-06T13:52:59.654 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r--. 1 ubuntu ubuntu 215333 May 6 13:52 /home/ubuntu/cephtest/cephadm 2024-05-06T13:52:59.654 DEBUG:teuthology.orchestra.run.smithi123:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-06T13:52:59.671 DEBUG:teuthology.orchestra.run.smithi174:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-06T13:52:59.701 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.1 on all hosts... 2024-05-06T13:52:59.702 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 pull 2024-05-06T13:52:59.713 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 pull 2024-05-06T13:53:01.159 INFO:teuthology.orchestra.run.smithi123.stderr:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-05-06T13:53:01.239 INFO:teuthology.orchestra.run.smithi174.stderr:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-05-06T13:53:21.625 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-05-06T13:53:21.625 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-05-06T13:53:21.625 INFO:teuthology.orchestra.run.smithi123.stdout: "image_id": "5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf", 2024-05-06T13:53:21.626 INFO:teuthology.orchestra.run.smithi123.stdout: "repo_digests": [ 2024-05-06T13:53:21.626 INFO:teuthology.orchestra.run.smithi123.stdout: "quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3", 2024-05-06T13:53:21.626 INFO:teuthology.orchestra.run.smithi123.stdout: "quay.io/ceph/ceph@sha256:e8e55db8b4fd270dbec25bc764437a2a3abb707971c4dba5f559fb83018049dc" 2024-05-06T13:53:21.626 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-05-06T13:53:21.626 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-05-06T13:53:34.877 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-05-06T13:53:34.877 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-05-06T13:53:34.877 INFO:teuthology.orchestra.run.smithi174.stdout: "image_id": "5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf", 2024-05-06T13:53:34.877 INFO:teuthology.orchestra.run.smithi174.stdout: "repo_digests": [ 2024-05-06T13:53:34.877 INFO:teuthology.orchestra.run.smithi174.stdout: "quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3", 2024-05-06T13:53:34.877 INFO:teuthology.orchestra.run.smithi174.stdout: "quay.io/ceph/ceph@sha256:e8e55db8b4fd270dbec25bc764437a2a3abb707971c4dba5f559fb83018049dc" 2024-05-06T13:53:34.877 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-05-06T13:53:34.877 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-05-06T13:53:34.901 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph 2024-05-06T13:53:34.933 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph 2024-05-06T13:53:34.960 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /etc/ceph 2024-05-06T13:53:35.001 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /etc/ceph 2024-05-06T13:53:35.024 INFO:tasks.cephadm:Writing seed config... 2024-05-06T13:53:35.050 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-05-06T13:53:35.050 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-05-06T13:53:35.050 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-06T13:53:35.051 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-06T13:53:35.052 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-06T13:53:35.053 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-06T13:53:35.053 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-06T13:53:35.053 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-06T13:53:35.053 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-06T13:53:35.053 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-06T13:53:35.053 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-06T13:53:35.053 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-06T13:53:35.053 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-06T13:53:35.054 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:53:35.054 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-06T13:53:35.070 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f22edd3c-0baf-11ef-bc97-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-06T13:53:35.070 DEBUG:teuthology.orchestra.run.smithi123:mon.smithi123> sudo journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mon.smithi123.service 2024-05-06T13:53:35.113 INFO:tasks.cephadm:Bootstrapping... 2024-05-06T13:53:35.113 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 -v bootstrap --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.123 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-06T13:53:35.269 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-05-06T13:53:35.269 INFO:teuthology.orchestra.run.smithi123.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.1', '-v', 'bootstrap', '--fsid', 'f22edd3c-0baf-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.123', '--skip-admin-label'] 2024-05-06T13:53:35.321 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-06T13:53:35.322 INFO:teuthology.orchestra.run.smithi123.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-06T13:53:35.322 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying podman|docker is present... 2024-05-06T13:53:35.344 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-06T13:53:35.344 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying lvm2 is present... 2024-05-06T13:53:35.345 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying time synchronization is in place... 2024-05-06T13:53:35.351 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-06T13:53:35.352 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-06T13:53:35.358 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-06T13:53:35.358 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-05-06T13:53:35.365 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout enabled 2024-05-06T13:53:35.370 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout active 2024-05-06T13:53:35.370 INFO:teuthology.orchestra.run.smithi123.stdout:Unit chronyd.service is enabled and running 2024-05-06T13:53:35.370 INFO:teuthology.orchestra.run.smithi123.stdout:Repeating the final host check... 2024-05-06T13:53:35.392 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-06T13:53:35.392 INFO:teuthology.orchestra.run.smithi123.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-06T13:53:35.392 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl is present 2024-05-06T13:53:35.393 INFO:teuthology.orchestra.run.smithi123.stdout:lvcreate is present 2024-05-06T13:53:35.399 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-06T13:53:35.399 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-06T13:53:35.404 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-06T13:53:35.405 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-05-06T13:53:35.411 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout enabled 2024-05-06T13:53:35.417 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout active 2024-05-06T13:53:35.417 INFO:teuthology.orchestra.run.smithi123.stdout:Unit chronyd.service is enabled and running 2024-05-06T13:53:35.417 INFO:teuthology.orchestra.run.smithi123.stdout:Host looks OK 2024-05-06T13:53:35.417 INFO:teuthology.orchestra.run.smithi123.stdout:Cluster fsid: f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:53:35.417 INFO:teuthology.orchestra.run.smithi123.stdout:Acquiring lock 140045158634496 on /run/cephadm/f22edd3c-0baf-11ef-bc97-c7b262605968.lock 2024-05-06T13:53:35.417 INFO:teuthology.orchestra.run.smithi123.stdout:Lock 140045158634496 acquired on /run/cephadm/f22edd3c-0baf-11ef-bc97-c7b262605968.lock 2024-05-06T13:53:35.417 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying IP 172.21.15.123 port 3300 ... 2024-05-06T13:53:35.418 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying IP 172.21.15.123 port 6789 ... 2024-05-06T13:53:35.418 INFO:teuthology.orchestra.run.smithi123.stdout:Base mon IP(s) is [172.21.15.123:3300, 172.21.15.123:6789], mon addrv is [v2:172.21.15.123:3300,v1:172.21.15.123:6789] 2024-05-06T13:53:35.421 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.123 metric 100 2024-05-06T13:53:35.421 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.123 metric 100 2024-05-06T13:53:35.423 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-06T13:53:35.423 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-05-06T13:53:35.423 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-05-06T13:53:35.426 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-06T13:53:35.426 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-06T13:53:35.426 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-06T13:53:35.426 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-06T13:53:35.426 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout inet6 fe80::dec2:843b:154a:21fd/64 scope link noprefixroute 2024-05-06T13:53:35.426 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-06T13:53:35.427 INFO:teuthology.orchestra.run.smithi123.stdout:Mon IP `172.21.15.123` is in CIDR network `172.21.0.0/20` 2024-05-06T13:53:35.427 INFO:teuthology.orchestra.run.smithi123.stdout:Mon IP `172.21.15.123` is in CIDR network `172.21.0.0/20` 2024-05-06T13:53:35.427 INFO:teuthology.orchestra.run.smithi123.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-06T13:53:35.427 INFO:teuthology.orchestra.run.smithi123.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-06T13:53:35.428 INFO:teuthology.orchestra.run.smithi123.stdout:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-05-06T13:53:36.628 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf 2024-05-06T13:53:36.628 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.1... 2024-05-06T13:53:36.628 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Getting image source signatures 2024-05-06T13:53:36.629 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Copying blob sha256:a733d3c618b71f19c168ebecd1953429dce2c1631835ca182e9551c36dce5989 2024-05-06T13:53:36.629 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Copying blob sha256:7feca07754707458c3945cf0062cf4dabc512f6d90fe1a9a1370b362b6011124 2024-05-06T13:53:36.629 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Copying config sha256:5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf 2024-05-06T13:53:36.629 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-06T13:53:37.525 INFO:teuthology.orchestra.run.smithi123.stdout:ceph: stdout ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable) 2024-05-06T13:53:37.525 INFO:teuthology.orchestra.run.smithi123.stdout:Ceph version: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable) 2024-05-06T13:53:37.525 INFO:teuthology.orchestra.run.smithi123.stdout:Extracting ceph user uid/gid from container image... 2024-05-06T13:53:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:stat: stdout 167 167 2024-05-06T13:53:38.488 INFO:teuthology.orchestra.run.smithi123.stdout:Creating initial keys... 2024-05-06T13:53:39.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-authtool: stdout AQDi4DhmYrIDLhAAiCotRxOEHsApppoUZirQkw== 2024-05-06T13:53:40.141 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-authtool: stdout AQDj4Dhm2qNSIxAAZE09muRptunFRWoJh9CYjQ== 2024-05-06T13:53:45.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-authtool: stdout AQDk4DhmLqO3GxAAQlmcCkwne8fArv7jLm5Q+g== 2024-05-06T13:53:45.108 INFO:teuthology.orchestra.run.smithi123.stdout:Creating initial monmap... 2024-05-06T13:53:51.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-06T13:53:51.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-05-06T13:53:51.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:53:51.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-06T13:53:51.157 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool for smithi123 [v2:172.21.15.123:3300,v1:172.21.15.123:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-06T13:53:51.157 INFO:teuthology.orchestra.run.smithi123.stdout:setting min_mon_release = pacific 2024-05-06T13:53:51.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: set fsid to f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:53:51.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-06T13:53:51.158 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:53:51.158 INFO:teuthology.orchestra.run.smithi123.stdout:Creating mon... 2024-05-06T13:53:52.344 INFO:teuthology.orchestra.run.smithi123.stdout:create mon.smithi123 on 2024-05-06T13:53:52.572 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-06T13:53:52.704 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-06T13:53:52.867 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f22edd3c-0baf-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-f22edd3c-0baf-11ef-bc97-c7b262605968.target. 2024-05-06T13:53:52.867 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f22edd3c-0baf-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-f22edd3c-0baf-11ef-bc97-c7b262605968.target. 2024-05-06T13:53:53.104 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mon.smithi123 2024-05-06T13:53:53.105 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mon.smithi123.service: Unit ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mon.smithi123.service not loaded. 2024-05-06T13:53:53.272 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f22edd3c-0baf-11ef-bc97-c7b262605968.target.wants/ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mon.smithi123.service → /etc/systemd/system/ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@.service. 2024-05-06T13:53:53.803 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-06T13:53:53.803 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-05-06T13:53:53.811 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-06T13:53:53.811 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-05-06T13:53:53.811 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-05-06T13:53:53.811 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to enable service . firewalld.service is not available 2024-05-06T13:53:53.812 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mon to start... 2024-05-06T13:53:53.812 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mon... 2024-05-06T13:53:53.937 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:53 smithi123 systemd[1]: Started Ceph mon.smithi123 for f22edd3c-0baf-11ef-bc97-c7b262605968. 2024-05-06T13:53:54.894 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout cluster: 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout id: f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout services: 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi123 (age 0.61319s) 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout data: 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-06T13:53:54.895 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout pgs: 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.296+0000 7fbd12c5f700 1 Processor -- start 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.296+0000 7fbd12c5f700 1 -- start start 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.296+0000 7fbd12c5f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 0x7fbd0c106960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.296+0000 7fbd12c5f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c106f30 con 0x7fbd0c106540 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.297+0000 7fbd109fb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 0x7fbd0c106960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.297+0000 7fbd109fb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 0x7fbd0c106960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53392/0 (socket says 172.21.15.123:53392) 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.297+0000 7fbd109fb700 1 -- 172.21.15.123:0/1644423150 learned_addr learned my addr 172.21.15.123:0/1644423150 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.297+0000 7fbd109fb700 1 -- 172.21.15.123:0/1644423150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c107740 con 0x7fbd0c106540 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.297+0000 7fbd109fb700 1 --2- 172.21.15.123:0/1644423150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 0x7fbd0c106960 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbd000098a0 tx=0x7fbd00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3343e716949c3e server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.297+0000 7fbd0b7fe700 1 -- 172.21.15.123:0/1644423150 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd00004180 con 0x7fbd0c106540 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.297+0000 7fbd0b7fe700 1 -- 172.21.15.123:0/1644423150 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd000042e0 con 0x7fbd0c106540 2024-05-06T13:53:54.896 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.297+0000 7fbd0b7fe700 1 -- 172.21.15.123:0/1644423150 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd000036a0 con 0x7fbd0c106540 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.298+0000 7fbd12c5f700 1 -- 172.21.15.123:0/1644423150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 msgr2=0x7fbd0c106960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.298+0000 7fbd12c5f700 1 --2- 172.21.15.123:0/1644423150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 0x7fbd0c106960 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbd000098a0 tx=0x7fbd00009bb0 comp rx=0 tx=0).stop 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.298+0000 7fbd12c5f700 1 -- 172.21.15.123:0/1644423150 shutdown_connections 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.298+0000 7fbd12c5f700 1 --2- 172.21.15.123:0/1644423150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 0x7fbd0c106960 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.298+0000 7fbd12c5f700 1 -- 172.21.15.123:0/1644423150 >> 172.21.15.123:0/1644423150 conn(0x7fbd0c101b20 msgr2=0x7fbd0c103f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.298+0000 7fbd12c5f700 1 -- 172.21.15.123:0/1644423150 shutdown_connections 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.298+0000 7fbd12c5f700 1 -- 172.21.15.123:0/1644423150 wait complete. 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.299+0000 7fbd12c5f700 1 Processor -- start 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.299+0000 7fbd12c5f700 1 -- start start 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.299+0000 7fbd12c5f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 0x7fbd0c199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.299+0000 7fbd12c5f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c199ec0 con 0x7fbd0c106540 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.299+0000 7fbd109fb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 0x7fbd0c199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:53:54.897 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.299+0000 7fbd109fb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 0x7fbd0c199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53400/0 (socket says 172.21.15.123:53400) 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.299+0000 7fbd109fb700 1 -- 172.21.15.123:0/3274200109 learned_addr learned my addr 172.21.15.123:0/3274200109 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.299+0000 7fbd109fb700 1 -- 172.21.15.123:0/3274200109 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd00009550 con 0x7fbd0c106540 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.299+0000 7fbd109fb700 1 --2- 172.21.15.123:0/3274200109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 0x7fbd0c199980 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbd00004000 tx=0x7fbd00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.300+0000 7fbd09ffb700 1 -- 172.21.15.123:0/3274200109 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd00003ce0 con 0x7fbd0c106540 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.300+0000 7fbd09ffb700 1 -- 172.21.15.123:0/3274200109 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd00020070 con 0x7fbd0c106540 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.300+0000 7fbd12c5f700 1 -- 172.21.15.123:0/3274200109 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c19a0c0 con 0x7fbd0c106540 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.300+0000 7fbd09ffb700 1 -- 172.21.15.123:0/3274200109 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd00011630 con 0x7fbd0c106540 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.300+0000 7fbd12c5f700 1 -- 172.21.15.123:0/3274200109 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c19a560 con 0x7fbd0c106540 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.300+0000 7fbd09ffb700 1 -- 172.21.15.123:0/3274200109 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbd00022030 con 0x7fbd0c106540 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.300+0000 7fbd09ffb700 1 -- 172.21.15.123:0/3274200109 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbd00025d10 con 0x7fbd0c106540 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.301+0000 7fbd12c5f700 1 -- 172.21.15.123:0/3274200109 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0c193260 con 0x7fbd0c106540 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.303+0000 7fbd09ffb700 1 -- 172.21.15.123:0/3274200109 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fbd00025480 con 0x7fbd0c106540 2024-05-06T13:53:54.898 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.375+0000 7fbd12c5f700 1 -- 172.21.15.123:0/3274200109 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fbd0c02cc70 con 0x7fbd0c106540 2024-05-06T13:53:54.899 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.375+0000 7fbd09ffb700 1 -- 172.21.15.123:0/3274200109 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+324 (secure 0 0 0) 0x7fbd00011c20 con 0x7fbd0c106540 2024-05-06T13:53:54.899 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.376+0000 7fbd12c5f700 1 -- 172.21.15.123:0/3274200109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 msgr2=0x7fbd0c199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:53:54.899 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.376+0000 7fbd12c5f700 1 --2- 172.21.15.123:0/3274200109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 0x7fbd0c199980 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbd00004000 tx=0x7fbd00004750 comp rx=0 tx=0).stop 2024-05-06T13:53:54.899 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.376+0000 7fbd12c5f700 1 -- 172.21.15.123:0/3274200109 shutdown_connections 2024-05-06T13:53:54.899 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.376+0000 7fbd12c5f700 1 --2- 172.21.15.123:0/3274200109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd0c106540 0x7fbd0c199980 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:53:54.899 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.376+0000 7fbd12c5f700 1 -- 172.21.15.123:0/3274200109 >> 172.21.15.123:0/3274200109 conn(0x7fbd0c101b20 msgr2=0x7fbd0c18df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:53:54.899 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.376+0000 7fbd12c5f700 1 -- 172.21.15.123:0/3274200109 shutdown_connections 2024-05-06T13:53:54.899 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:54.376+0000 7fbd12c5f700 1 -- 172.21.15.123:0/3274200109 wait complete. 2024-05-06T13:53:54.899 INFO:teuthology.orchestra.run.smithi123.stdout:mon is available 2024-05-06T13:53:54.899 INFO:teuthology.orchestra.run.smithi123.stdout:Assimilating anything we can from ceph.conf... 2024-05-06T13:53:55.014 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:54 smithi123 ceph-mon[26880]: mon.smithi123 is new leader, mons smithi123 in quorum (ranks 0) 2024-05-06T13:53:55.014 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:54 smithi123 ceph-mon[26880]: monmap e1: 1 mons at {smithi123=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-06T13:53:55.014 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:54 smithi123 ceph-mon[26880]: fsmap 2024-05-06T13:53:55.014 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:54 smithi123 ceph-mon[26880]: osdmap e1: 0 total, 0 up, 0 in 2024-05-06T13:53:55.014 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:54 smithi123 ceph-mon[26880]: mgrmap e1: no daemons active 2024-05-06T13:53:55.014 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:54 smithi123 ceph-mon[26880]: from='client.? 172.21.15.123:0/3274200109' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-06T13:53:55.933 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:55 smithi123 ceph-mon[26880]: from='client.? 172.21.15.123:0/2815866991' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-06T13:53:55.934 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:55 smithi123 ceph-mon[26880]: from='client.? 172.21.15.123:0/2815866991' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-06T13:53:55.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:53:55.942 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [global] 2024-05-06T13:53:55.942 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout fsid = f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:53:55.942 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.123:3300,v1:172.21.15.123:6789] 2024-05-06T13:53:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-06T13:53:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-06T13:53:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-06T13:53:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-06T13:53:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:53:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-06T13:53:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-06T13:53:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:53:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [osd] 2024-05-06T13:53:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-06T13:53:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-06T13:53:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.328+0000 7f6cf2f16700 1 Processor -- start 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.328+0000 7f6cf2f16700 1 -- start start 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.328+0000 7f6cf2f16700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 0x7f6cec1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.328+0000 7f6cf2f16700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec079e50 con 0x7f6cec106fd0 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.328+0000 7f6cf0cb2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 0x7f6cec1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.328+0000 7f6cf0cb2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 0x7f6cec1093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53410/0 (socket says 172.21.15.123:53410) 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.328+0000 7f6cf0cb2700 1 -- 172.21.15.123:0/3679789031 learned_addr learned my addr 172.21.15.123:0/3679789031 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.328+0000 7f6cf0cb2700 1 -- 172.21.15.123:0/3679789031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec109900 con 0x7f6cec106fd0 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.328+0000 7f6cf0cb2700 1 --2- 172.21.15.123:0/3679789031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 0x7f6cec1093c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00098a0 tx=0x7f6ce0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc29e908567d436 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.329+0000 7f6ceb7fe700 1 -- 172.21.15.123:0/3679789031 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ce0004180 con 0x7f6cec106fd0 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.329+0000 7f6ceb7fe700 1 -- 172.21.15.123:0/3679789031 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce00042e0 con 0x7f6cec106fd0 2024-05-06T13:53:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.329+0000 7f6ceb7fe700 1 -- 172.21.15.123:0/3679789031 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ce00036a0 con 0x7f6cec106fd0 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.329+0000 7f6cf2f16700 1 -- 172.21.15.123:0/3679789031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 msgr2=0x7f6cec1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.329+0000 7f6cf2f16700 1 --2- 172.21.15.123:0/3679789031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 0x7f6cec1093c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00098a0 tx=0x7f6ce0009bb0 comp rx=0 tx=0).stop 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.329+0000 7f6cf2f16700 1 -- 172.21.15.123:0/3679789031 shutdown_connections 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.329+0000 7f6cf2f16700 1 --2- 172.21.15.123:0/3679789031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 0x7f6cec1093c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.329+0000 7f6cf2f16700 1 -- 172.21.15.123:0/3679789031 >> 172.21.15.123:0/3679789031 conn(0x7f6cec100980 msgr2=0x7f6cec102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.329+0000 7f6cf2f16700 1 -- 172.21.15.123:0/3679789031 shutdown_connections 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.329+0000 7f6cf2f16700 1 -- 172.21.15.123:0/3679789031 wait complete. 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.330+0000 7f6cf2f16700 1 Processor -- start 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.330+0000 7f6cf2f16700 1 -- start start 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.330+0000 7f6cf2f16700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 0x7f6cec1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.330+0000 7f6cf2f16700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec199ee0 con 0x7f6cec106fd0 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.330+0000 7f6cf0cb2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 0x7f6cec1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.330+0000 7f6cf0cb2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 0x7f6cec1999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53420/0 (socket says 172.21.15.123:53420) 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.330+0000 7f6cf0cb2700 1 -- 172.21.15.123:0/2815866991 learned_addr learned my addr 172.21.15.123:0/2815866991 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:53:55.945 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.330+0000 7f6cf0cb2700 1 -- 172.21.15.123:0/2815866991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce0009550 con 0x7f6cec106fd0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.330+0000 7f6cf0cb2700 1 --2- 172.21.15.123:0/2815866991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 0x7f6cec1999a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6cec079290 tx=0x7f6ce0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.330+0000 7f6ce9ffb700 1 -- 172.21.15.123:0/2815866991 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ce0003ce0 con 0x7f6cec106fd0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.331+0000 7f6ce9ffb700 1 -- 172.21.15.123:0/2815866991 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0020070 con 0x7f6cec106fd0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.331+0000 7f6ce9ffb700 1 -- 172.21.15.123:0/2815866991 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ce0011630 con 0x7f6cec106fd0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.331+0000 7f6cf2f16700 1 -- 172.21.15.123:0/2815866991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec19a0e0 con 0x7f6cec106fd0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.331+0000 7f6cf2f16700 1 -- 172.21.15.123:0/2815866991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cec19a580 con 0x7f6cec106fd0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.331+0000 7f6ce9ffb700 1 -- 172.21.15.123:0/2815866991 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6ce0022030 con 0x7f6cec106fd0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.331+0000 7f6ce9ffb700 1 -- 172.21.15.123:0/2815866991 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6ce0025e20 con 0x7f6cec106fd0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.332+0000 7f6cf2f16700 1 -- 172.21.15.123:0/2815866991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cec193820 con 0x7f6cec106fd0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.334+0000 7f6ce9ffb700 1 -- 172.21.15.123:0/2815866991 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f6ce0025480 con 0x7f6cec106fd0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.401+0000 7f6cf2f16700 1 -- 172.21.15.123:0/2815866991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6cec02cf20 con 0x7f6cec106fd0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.404+0000 7f6ce9ffb700 1 -- 172.21.15.123:0/2815866991 <== mon.0 v2:172.21.15.123:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6ce0025620 con 0x7f6cec106fd0 2024-05-06T13:53:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.404+0000 7f6ce9ffb700 1 -- 172.21.15.123:0/2815866991 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7f6ce001c450 con 0x7f6cec106fd0 2024-05-06T13:53:55.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.405+0000 7f6cf2f16700 1 -- 172.21.15.123:0/2815866991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 msgr2=0x7f6cec1999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:53:55.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.405+0000 7f6cf2f16700 1 --2- 172.21.15.123:0/2815866991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 0x7f6cec1999a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6cec079290 tx=0x7f6ce0004750 comp rx=0 tx=0).stop 2024-05-06T13:53:55.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.405+0000 7f6cf2f16700 1 -- 172.21.15.123:0/2815866991 shutdown_connections 2024-05-06T13:53:55.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.405+0000 7f6cf2f16700 1 --2- 172.21.15.123:0/2815866991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cec106fd0 0x7f6cec1999a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:53:55.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.405+0000 7f6cf2f16700 1 -- 172.21.15.123:0/2815866991 >> 172.21.15.123:0/2815866991 conn(0x7f6cec100980 msgr2=0x7f6cec1022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:53:55.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.405+0000 7f6cf2f16700 1 -- 172.21.15.123:0/2815866991 shutdown_connections 2024-05-06T13:53:55.947 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:55.405+0000 7f6cf2f16700 1 -- 172.21.15.123:0/2815866991 wait complete. 2024-05-06T13:53:55.947 INFO:teuthology.orchestra.run.smithi123.stdout:Generating new minimal ceph.conf... 2024-05-06T13:53:58.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:57 smithi123 ceph-mon[26880]: from='client.? 172.21.15.123:0/1326728088' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:53:58.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.683+0000 7f7af9fd9700 1 Processor -- start 2024-05-06T13:53:58.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.683+0000 7f7af9fd9700 1 -- start start 2024-05-06T13:53:58.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.683+0000 7f7af9fd9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 0x7f7af4105880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:53:58.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.683+0000 7f7af9fd9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af4105e50 con 0x7f7af4105460 2024-05-06T13:53:58.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.683+0000 7f7af37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 0x7f7af4105880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:53:58.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.683+0000 7f7af37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 0x7f7af4105880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35570/0 (socket says 172.21.15.123:35570) 2024-05-06T13:53:58.391 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.683+0000 7f7af37fe700 1 -- 172.21.15.123:0/220275102 learned_addr learned my addr 172.21.15.123:0/220275102 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:53:58.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.683+0000 7f7af37fe700 1 -- 172.21.15.123:0/220275102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af4106660 con 0x7f7af4105460 2024-05-06T13:53:58.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.684+0000 7f7af37fe700 1 --2- 172.21.15.123:0/220275102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 0x7f7af4105880 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40098a0 tx=0x7f7ae4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9b9562ce6c3b28 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:53:58.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.684+0000 7f7af27fc700 1 -- 172.21.15.123:0/220275102 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ae4004180 con 0x7f7af4105460 2024-05-06T13:53:58.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.684+0000 7f7af27fc700 1 -- 172.21.15.123:0/220275102 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7ae40042e0 con 0x7f7af4105460 2024-05-06T13:53:58.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.684+0000 7f7af27fc700 1 -- 172.21.15.123:0/220275102 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ae4011a50 con 0x7f7af4105460 2024-05-06T13:53:58.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.684+0000 7f7af9fd9700 1 -- 172.21.15.123:0/220275102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 msgr2=0x7f7af4105880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:53:58.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.684+0000 7f7af9fd9700 1 --2- 172.21.15.123:0/220275102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 0x7f7af4105880 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40098a0 tx=0x7f7ae4009bb0 comp rx=0 tx=0).stop 2024-05-06T13:53:58.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.684+0000 7f7af9fd9700 1 -- 172.21.15.123:0/220275102 shutdown_connections 2024-05-06T13:53:58.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.684+0000 7f7af9fd9700 1 --2- 172.21.15.123:0/220275102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 0x7f7af4105880 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:53:58.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.684+0000 7f7af9fd9700 1 -- 172.21.15.123:0/220275102 >> 172.21.15.123:0/220275102 conn(0x7f7af4100a20 msgr2=0x7f7af4102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:53:58.392 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.684+0000 7f7af9fd9700 1 -- 172.21.15.123:0/220275102 shutdown_connections 2024-05-06T13:53:58.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.684+0000 7f7af9fd9700 1 -- 172.21.15.123:0/220275102 wait complete. 2024-05-06T13:53:58.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.685+0000 7f7af9fd9700 1 Processor -- start 2024-05-06T13:53:58.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.685+0000 7f7af9fd9700 1 -- start start 2024-05-06T13:53:58.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.685+0000 7f7af9fd9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 0x7f7af419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:53:58.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af9fd9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af419a770 con 0x7f7af4105460 2024-05-06T13:53:58.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 0x7f7af419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:53:58.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 0x7f7af419a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35584/0 (socket says 172.21.15.123:35584) 2024-05-06T13:53:58.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af37fe700 1 -- 172.21.15.123:0/1326728088 learned_addr learned my addr 172.21.15.123:0/1326728088 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:53:58.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af37fe700 1 -- 172.21.15.123:0/1326728088 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4009550 con 0x7f7af4105460 2024-05-06T13:53:58.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af37fe700 1 --2- 172.21.15.123:0/1326728088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 0x7f7af419a230 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009520 tx=0x7f7ae4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:53:58.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af0ff9700 1 -- 172.21.15.123:0/1326728088 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ae4003a80 con 0x7f7af4105460 2024-05-06T13:53:58.393 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af9fd9700 1 -- 172.21.15.123:0/1326728088 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af419a970 con 0x7f7af4105460 2024-05-06T13:53:58.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af0ff9700 1 -- 172.21.15.123:0/1326728088 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7ae4003be0 con 0x7f7af4105460 2024-05-06T13:53:58.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af0ff9700 1 -- 172.21.15.123:0/1326728088 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ae40197b0 con 0x7f7af4105460 2024-05-06T13:53:58.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af9fd9700 1 -- 172.21.15.123:0/1326728088 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af419ae10 con 0x7f7af4105460 2024-05-06T13:53:58.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af0ff9700 1 -- 172.21.15.123:0/1326728088 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7ae402d440 con 0x7f7af4105460 2024-05-06T13:53:58.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.686+0000 7f7af0ff9700 1 -- 172.21.15.123:0/1326728088 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7ae40247d0 con 0x7f7af4105460 2024-05-06T13:53:58.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.687+0000 7f7af9fd9700 1 -- 172.21.15.123:0/1326728088 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af4193f60 con 0x7f7af4105460 2024-05-06T13:53:58.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.689+0000 7f7af0ff9700 1 -- 172.21.15.123:0/1326728088 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f7ae401ac30 con 0x7f7af4105460 2024-05-06T13:53:58.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.755+0000 7f7af9fd9700 1 -- 172.21.15.123:0/1326728088 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f7af40623c0 con 0x7f7af4105460 2024-05-06T13:53:58.394 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.756+0000 7f7af0ff9700 1 -- 172.21.15.123:0/1326728088 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f7af40623c0 con 0x7f7af4105460 2024-05-06T13:53:58.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.756+0000 7f7af9fd9700 1 -- 172.21.15.123:0/1326728088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 msgr2=0x7f7af419a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:53:58.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.756+0000 7f7af9fd9700 1 --2- 172.21.15.123:0/1326728088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 0x7f7af419a230 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009520 tx=0x7f7ae4011ab0 comp rx=0 tx=0).stop 2024-05-06T13:53:58.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.756+0000 7f7af9fd9700 1 -- 172.21.15.123:0/1326728088 shutdown_connections 2024-05-06T13:53:58.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.756+0000 7f7af9fd9700 1 --2- 172.21.15.123:0/1326728088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af4105460 0x7f7af419a230 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:53:58.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.756+0000 7f7af9fd9700 1 -- 172.21.15.123:0/1326728088 >> 172.21.15.123:0/1326728088 conn(0x7f7af4100a20 msgr2=0x7f7af4101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:53:58.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.756+0000 7f7af9fd9700 1 -- 172.21.15.123:0/1326728088 shutdown_connections 2024-05-06T13:53:58.395 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:53:57.756+0000 7f7af9fd9700 1 -- 172.21.15.123:0/1326728088 wait complete. 2024-05-06T13:53:58.395 INFO:teuthology.orchestra.run.smithi123.stdout:Restarting the monitor... 2024-05-06T13:53:58.645 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:58 smithi123 systemd[1]: Stopping Ceph mon.smithi123 for f22edd3c-0baf-11ef-bc97-c7b262605968... 2024-05-06T13:53:58.911 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:58 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123[26876]: 2024-05-06T13:53:58.643+0000 7f48f5876700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi123 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:53:58.911 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:58 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123[26876]: 2024-05-06T13:53:58.643+0000 7f48f5876700 -1 mon.smithi123@0(leader) e1 *** Got Signal Terminated *** 2024-05-06T13:53:58.911 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:58 smithi123 podman[27127]: 2024-05-06 13:53:58.675162465 +0000 UTC m=+0.128916955 container died dfbea9bb3d055be44b84f0611ad9dcc5ae0b235a54fd119c37f130370bca174c (image=quay.io/ceph/ceph:v18.2.1, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-06T13:53:59.245 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 podman[27127]: 2024-05-06 13:53:59.010359877 +0000 UTC m=+0.464114358 container cleanup dfbea9bb3d055be44b84f0611ad9dcc5ae0b235a54fd119c37f130370bca174c (image=quay.io/ceph/ceph:v18.2.1, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, RELEASE=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-06T13:53:59.245 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 bash[27127]: ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123 2024-05-06T13:53:59.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 podman[27139]: 2024-05-06 13:53:59.245083815 +0000 UTC m=+0.571312131 container remove dfbea9bb3d055be44b84f0611ad9dcc5ae0b235a54fd119c37f130370bca174c (image=quay.io/ceph/ceph:v18.2.1, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-06T13:53:59.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 systemd[1]: ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mon.smithi123.service: Deactivated successfully. 2024-05-06T13:53:59.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 systemd[1]: Stopped Ceph mon.smithi123 for f22edd3c-0baf-11ef-bc97-c7b262605968. 2024-05-06T13:53:59.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 systemd[1]: Starting Ceph mon.smithi123 for f22edd3c-0baf-11ef-bc97-c7b262605968... 2024-05-06T13:53:59.948 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 podman[27235]: 2024-05-06 13:53:59.593321885 +0000 UTC m=+0.017938737 image pull 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf quay.io/ceph/ceph:v18.2.1 2024-05-06T13:53:59.948 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 podman[27235]: 2024-05-06 13:53:59.720865593 +0000 UTC m=+0.145482432 container create 0e6293707f75e783593f9360bb8348c56b35bf4aae853d1bbdb8e1398a4774c0 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0) 2024-05-06T13:53:59.948 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 podman[27235]: 2024-05-06 13:53:59.88139045 +0000 UTC m=+0.306007288 container init 0e6293707f75e783593f9360bb8348c56b35bf4aae853d1bbdb8e1398a4774c0 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-06T13:53:59.948 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 podman[27235]: 2024-05-06 13:53:59.884154161 +0000 UTC m=+0.308770991 container start 0e6293707f75e783593f9360bb8348c56b35bf4aae853d1bbdb8e1398a4774c0 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, maintainer=Guillaume Abrioux ) 2024-05-06T13:53:59.948 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: set uid:gid to 167:167 (ceph:ceph) 2024-05-06T13:53:59.948 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process ceph-mon, pid 2 2024-05-06T13:53:59.948 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: pidfile_write: ignore empty --pid-file 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: load: jerasure load: lrc 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: RocksDB version: 7.9.2 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Git sha 0 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Compile date 2023-12-11 22:07:34 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: DB SUMMARY 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: DB Session ID: VJFDFGMXULST5JJLTW92 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: CURRENT file: CURRENT 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: IDENTITY file: IDENTITY 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi123/store.db dir, Total Num: 1, files: 000008.sst 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi123/store.db: 000009.log size: 98389 ; 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.error_if_exists: 0 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.create_if_missing: 0 2024-05-06T13:53:59.949 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.paranoid_checks: 1 2024-05-06T13:53:59.950 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-06T13:53:59.950 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-06T13:53:59.950 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-06T13:53:59.950 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.env: 0x562b19ef4720 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.fs: PosixFileSystem 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.info_log: 0x562b1c44d2e0 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_file_opening_threads: 16 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.statistics: (nil) 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.use_fsync: 0 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_log_file_size: 0 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.keep_log_file_num: 1000 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.recycle_log_file_num: 0 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.allow_fallocate: 1 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.allow_mmap_reads: 0 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.allow_mmap_writes: 0 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.use_direct_reads: 0 2024-05-06T13:53:59.951 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.create_missing_column_families: 0 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.db_log_dir: 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.wal_dir: 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.advise_random_on_open: 1 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.db_write_buffer_size: 0 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.write_buffer_manager: 0x562b1b6be140 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-06T13:53:59.952 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.rate_limiter: (nil) 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.wal_recovery_mode: 2 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.enable_thread_tracking: 0 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.enable_pipelined_write: 0 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.unordered_write: 0 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.row_cache: None 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.wal_filter: None 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.allow_ingest_behind: 0 2024-05-06T13:53:59.953 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.two_write_queues: 0 2024-05-06T13:53:59.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.manual_wal_flush: 0 2024-05-06T13:53:59.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.wal_compression: 0 2024-05-06T13:53:59.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.atomic_flush: 0 2024-05-06T13:53:59.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-06T13:53:59.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-06T13:53:59.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-06T13:53:59.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.log_readahead_size: 0 2024-05-06T13:53:59.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-06T13:53:59.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.best_efforts_recovery: 0 2024-05-06T13:53:59.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-06T13:53:59.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-06T13:53:59.954 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.allow_data_in_errors: 0 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.db_host_id: __hostname__ 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_background_jobs: 2 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_background_compactions: -1 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_subcompactions: 1 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_total_wal_size: 0 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-06T13:53:59.955 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_open_files: -1 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bytes_per_sync: 0 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_readahead_size: 0 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_background_flushes: -1 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Compression algorithms supported: 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: kZSTD supported: 0 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: kXpressCompression supported: 0 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: kLZ4HCCompression supported: 1 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: kZlibCompression supported: 1 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: kSnappyCompression supported: 1 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: kLZ4Compression supported: 1 2024-05-06T13:53:59.956 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: kBZip2Compression supported: 0 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi123/store.db/MANIFEST-000010 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.merge_operator: 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_filter: None 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_filter_factory: None 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.sst_partitioner_factory: None 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562b1c44d3e0) 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: cache_index_and_filter_blocks: 1 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-06T13:53:59.957 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: pin_top_level_index_and_filter: 1 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: index_type: 0 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: data_block_index_type: 0 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: index_shortening: 1 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: checksum: 4 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: no_block_cache: 0 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_cache: 0x562b1b75f1f0 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_cache_name: BinnedLRUCache 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_cache_options: 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: capacity : 536870912 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: num_shard_bits : 4 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: strict_capacity_limit : 0 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: high_pri_pool_ratio: 0.000 2024-05-06T13:53:59.958 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_cache_compressed: (nil) 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: persistent_cache: (nil) 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_size: 4096 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_size_deviation: 10 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_restart_interval: 16 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: index_block_restart_interval: 1 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: metadata_block_size: 4096 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: partition_filters: 0 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: use_delta_encoding: 1 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: filter_policy: bloomfilter 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: whole_key_filtering: 1 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: verify_compression: 0 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: read_amp_bytes_per_bit: 0 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: format_version: 5 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: enable_index_compression: 1 2024-05-06T13:53:59.959 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: block_align: 0 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: max_auto_readahead_size: 262144 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: prepopulate_block_cache: 0 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: initial_auto_readahead_size: 8192 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: num_file_reads_for_auto_readahead: 2 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.write_buffer_size: 33554432 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_write_buffer_number: 2 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compression: NoCompression 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bottommost_compression: Disabled 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.prefix_extractor: nullptr 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.num_levels: 7 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-06T13:53:59.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compression_opts.level: 32767 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compression_opts.strategy: 0 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-06T13:53:59.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-06T13:53:59.962 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compression_opts.enabled: false 2024-05-06T13:53:59.962 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-06T13:53:59.962 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-06T13:53:59.962 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-06T13:53:59.962 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-06T13:53:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.target_file_size_base: 67108864 2024-05-06T13:53:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-06T13:53:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-06T13:53:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-06T13:53:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-06T13:53:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-06T13:53:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-06T13:53:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-06T13:53:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-06T13:53:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-06T13:53:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-06T13:53:59.963 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.arena_block_size: 1048576 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.disable_auto_compactions: 0 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-06T13:53:59.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.table_properties_collectors: 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.inplace_update_support: 0 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.bloom_locality: 0 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.max_successive_merges: 0 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.paranoid_file_checks: 0 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.force_consistency_checks: 1 2024-05-06T13:53:59.965 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.report_bg_io_stats: 0 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.ttl: 2592000 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.enable_blob_files: false 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.min_blob_size: 0 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.blob_file_size: 268435456 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.blob_file_starting_level: 0 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-06T13:53:59.966 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi123/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: dc22e2a7-7f48-4b2a-acd9-08417406b3db 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715003639912900, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715003639913883, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93633, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 314, "table_properties": {"data_size": 91655, "index_size": 260, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13576, "raw_average_key_size": 49, "raw_value_size": 84264, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 273, "num_filter_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715003639, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "dc22e2a7-7f48-4b2a-acd9-08417406b3db", "db_session_id": "VJFDFGMXULST5JJLTW92", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715003639913973, "job": 1, "event": "recovery_finished"} 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi123/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562b1b7fc000 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: DB pointer 0x562b1b7e8000 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** DB Stats ** 2024-05-06T13:53:59.967 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** Compaction Stats [default] ** 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: L0 2/0 93.31 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Sum 2/0 93.31 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-05-06T13:53:59.968 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** Compaction Stats [default] ** 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 141.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Cumulative compaction: 0.00 GB write, 30.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T13:53:59.969 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Interval compaction: 0.00 GB write, 30.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Block cache BinnedLRUCache@0x562b1b75f1f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: starting mon.smithi123 rank 0 at public addrs [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] at bind addrs [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi123 fsid f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: mon.smithi123@-1(???) e1 preinit fsid f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: mon.smithi123@-1(???).mds e1 new map 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: mon.smithi123@-1(???).mds e1 print_map 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: e1 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: legacy client fscid: -1 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: 2024-05-06T13:53:59.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout: No filesystems configured 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: mon.smithi123@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: mon.smithi123@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: mon.smithi123@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: mon.smithi123@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: mon.smithi123@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: expand_channel_meta expand map: {default=false} 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: expand_channel_meta from 'false' to 'false' 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: expand_channel_meta expanded map: {default=false} 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: expand_channel_meta expand map: {default=info} 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: expand_channel_meta from 'info' to 'info' 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: expand_channel_meta expanded map: {default=info} 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: expand_channel_meta expand map: {default=daemon} 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: expand_channel_meta from 'daemon' to 'daemon' 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: expand_channel_meta expanded map: {default=daemon} 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: expand_channel_meta expand map: {default=debug} 2024-05-06T13:53:59.971 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: expand_channel_meta from 'debug' to 'debug' 2024-05-06T13:53:59.972 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: expand_channel_meta expanded map: {default=debug} 2024-05-06T13:53:59.972 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 bash[27235]: 0e6293707f75e783593f9360bb8348c56b35bf4aae853d1bbdb8e1398a4774c0 2024-05-06T13:53:59.972 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 systemd[1]: Started Ceph mon.smithi123 for f22edd3c-0baf-11ef-bc97-c7b262605968. 2024-05-06T13:53:59.972 INFO:teuthology.orchestra.run.smithi123.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-06T13:54:00.242 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: mon.smithi123 is new leader, mons smithi123 in quorum (ranks 0) 2024-05-06T13:54:00.242 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: monmap e1: 1 mons at {smithi123=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-06T13:54:00.242 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: fsmap 2024-05-06T13:54:00.242 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: osdmap e1: 0 total, 0 up, 0 in 2024-05-06T13:54:00.242 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:53:59 smithi123 ceph-mon[27254]: mgrmap e1: no daemons active 2024-05-06T13:54:00.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.343+0000 7fbb5368a700 1 Processor -- start 2024-05-06T13:54:00.977 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.344+0000 7fbb5368a700 1 -- start start 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.344+0000 7fbb5368a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 0x7fbb4c106990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.344+0000 7fbb5368a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c106f60 con 0x7fbb4c106570 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.344+0000 7fbb51426700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 0x7fbb4c106990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.344+0000 7fbb51426700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 0x7fbb4c106990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35590/0 (socket says 172.21.15.123:35590) 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.344+0000 7fbb51426700 1 -- 172.21.15.123:0/902563903 learned_addr learned my addr 172.21.15.123:0/902563903 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.344+0000 7fbb51426700 1 -- 172.21.15.123:0/902563903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c107770 con 0x7fbb4c106570 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.345+0000 7fbb51426700 1 --2- 172.21.15.123:0/902563903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 0x7fbb4c106990 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0098a0 tx=0x7fbb3c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3040ae730bf7fb09 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.345+0000 7fbb43fff700 1 -- 172.21.15.123:0/902563903 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb3c004180 con 0x7fbb4c106570 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.345+0000 7fbb43fff700 1 -- 172.21.15.123:0/902563903 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fbb3c0042e0 con 0x7fbb4c106570 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.345+0000 7fbb43fff700 1 -- 172.21.15.123:0/902563903 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb3c011a50 con 0x7fbb4c106570 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.345+0000 7fbb5368a700 1 -- 172.21.15.123:0/902563903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 msgr2=0x7fbb4c106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.345+0000 7fbb5368a700 1 --2- 172.21.15.123:0/902563903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 0x7fbb4c106990 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0098a0 tx=0x7fbb3c009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.345+0000 7fbb5368a700 1 -- 172.21.15.123:0/902563903 shutdown_connections 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.345+0000 7fbb5368a700 1 --2- 172.21.15.123:0/902563903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 0x7fbb4c106990 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.345+0000 7fbb5368a700 1 -- 172.21.15.123:0/902563903 >> 172.21.15.123:0/902563903 conn(0x7fbb4c101b10 msgr2=0x7fbb4c103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.345+0000 7fbb5368a700 1 -- 172.21.15.123:0/902563903 shutdown_connections 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.345+0000 7fbb5368a700 1 -- 172.21.15.123:0/902563903 wait complete. 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.346+0000 7fbb5368a700 1 Processor -- start 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.346+0000 7fbb5368a700 1 -- start start 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.346+0000 7fbb5368a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 0x7fbb4c19a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.346+0000 7fbb5368a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c19a760 con 0x7fbb4c106570 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.346+0000 7fbb51426700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 0x7fbb4c19a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.346+0000 7fbb51426700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 0x7fbb4c19a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35592/0 (socket says 172.21.15.123:35592) 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.346+0000 7fbb51426700 1 -- 172.21.15.123:0/320935433 learned_addr learned my addr 172.21.15.123:0/320935433 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.346+0000 7fbb51426700 1 -- 172.21.15.123:0/320935433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c009550 con 0x7fbb4c106570 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.347+0000 7fbb51426700 1 --2- 172.21.15.123:0/320935433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 0x7fbb4c19a220 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c003de0 tx=0x7fbb3c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.347+0000 7fbb427fc700 1 -- 172.21.15.123:0/320935433 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb3c003930 con 0x7fbb4c106570 2024-05-06T13:54:00.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.347+0000 7fbb427fc700 1 -- 172.21.15.123:0/320935433 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fbb3c003a90 con 0x7fbb4c106570 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.347+0000 7fbb5368a700 1 -- 172.21.15.123:0/320935433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4c19a960 con 0x7fbb4c106570 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.347+0000 7fbb427fc700 1 -- 172.21.15.123:0/320935433 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb3c0196c0 con 0x7fbb4c106570 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.347+0000 7fbb5368a700 1 -- 172.21.15.123:0/320935433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4c19ae00 con 0x7fbb4c106570 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.347+0000 7fbb427fc700 1 -- 172.21.15.123:0/320935433 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbb3c019ca0 con 0x7fbb4c106570 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.347+0000 7fbb427fc700 1 -- 172.21.15.123:0/320935433 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbb3c02c3a0 con 0x7fbb4c106570 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.348+0000 7fbb5368a700 1 -- 172.21.15.123:0/320935433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4c0623c0 con 0x7fbb4c106570 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.350+0000 7fbb427fc700 1 -- 172.21.15.123:0/320935433 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fbb3c01abc0 con 0x7fbb4c106570 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.415+0000 7fbb5368a700 1 -- 172.21.15.123:0/320935433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fbb4c19dc10 con 0x7fbb4c106570 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.420+0000 7fbb427fc700 1 -- 172.21.15.123:0/320935433 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbb3c005a20 con 0x7fbb4c106570 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.421+0000 7fbb5368a700 1 -- 172.21.15.123:0/320935433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 msgr2=0x7fbb4c19a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.421+0000 7fbb5368a700 1 --2- 172.21.15.123:0/320935433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 0x7fbb4c19a220 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c003de0 tx=0x7fbb3c011ab0 comp rx=0 tx=0).stop 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.421+0000 7fbb5368a700 1 -- 172.21.15.123:0/320935433 shutdown_connections 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.421+0000 7fbb5368a700 1 --2- 172.21.15.123:0/320935433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4c106570 0x7fbb4c19a220 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:00.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.421+0000 7fbb5368a700 1 -- 172.21.15.123:0/320935433 >> 172.21.15.123:0/320935433 conn(0x7fbb4c101b10 msgr2=0x7fbb4c1028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:00.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.421+0000 7fbb5368a700 1 -- 172.21.15.123:0/320935433 shutdown_connections 2024-05-06T13:54:00.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:00.421+0000 7fbb5368a700 1 -- 172.21.15.123:0/320935433 wait complete. 2024-05-06T13:54:00.981 INFO:teuthology.orchestra.run.smithi123.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-06T13:54:00.995 INFO:teuthology.orchestra.run.smithi123.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-06T13:54:00.995 INFO:teuthology.orchestra.run.smithi123.stdout:Creating mgr... 2024-05-06T13:54:00.996 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-06T13:54:00.996 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-06T13:54:00.996 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying port 0.0.0.0:8443 ... 2024-05-06T13:54:01.244 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mgr.smithi123.vjztrj 2024-05-06T13:54:01.244 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mgr.smithi123.vjztrj.service: Unit ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mgr.smithi123.vjztrj.service not loaded. 2024-05-06T13:54:01.389 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f22edd3c-0baf-11ef-bc97-c7b262605968.target.wants/ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mgr.smithi123.vjztrj.service → /etc/systemd/system/ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@.service. 2024-05-06T13:54:01.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:01 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/320935433' entity='client.admin' 2024-05-06T13:54:01.904 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-06T13:54:01.904 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-05-06T13:54:01.911 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-06T13:54:01.911 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-05-06T13:54:01.911 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-05-06T13:54:01.911 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to enable service . firewalld.service is not available 2024-05-06T13:54:01.919 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-06T13:54:01.919 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-05-06T13:54:01.926 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-06T13:54:01.926 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-05-06T13:54:01.926 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-05-06T13:54:01.926 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-05-06T13:54:01.926 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr to start... 2024-05-06T13:54:01.927 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr... 2024-05-06T13:54:02.780 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:02 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1045645798' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-06T13:54:03.074 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:54:03.074 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-05-06T13:54:03.074 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "f22edd3c-0baf-11ef-bc97-c7b262605968", 2024-05-06T13:54:03.074 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-05-06T13:54:03.074 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-06T13:54:03.074 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-06T13:54:03.074 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "smithi123" 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-06T13:54:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-06T13:54:03.076 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-06T13:54:03.077 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-06T13:54:03.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-06T13:54:03.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-06T13:54:03.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-05-06T13:54:03.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-05-06T13:54:03.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T13:54:03.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:03.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-06T13:54:03.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:03.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-05-06T13:53:53.764472+0000", 2024-05-06T13:54:03.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T13:54:03.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:03.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-06T13:54:03.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-05-06T13:54:03.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.360+0000 7f9f180cc700 1 Processor -- start 2024-05-06T13:54:03.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.360+0000 7f9f180cc700 1 -- start start 2024-05-06T13:54:03.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.360+0000 7f9f180cc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 0x7f9f10106e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:03.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.360+0000 7f9f180cc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f10107440 con 0x7f9f10106a50 2024-05-06T13:54:03.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.360+0000 7f9f15e68700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 0x7f9f10106e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:03.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.360+0000 7f9f15e68700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 0x7f9f10106e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35614/0 (socket says 172.21.15.123:35614) 2024-05-06T13:54:03.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.360+0000 7f9f15e68700 1 -- 172.21.15.123:0/2270699835 learned_addr learned my addr 172.21.15.123:0/2270699835 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:03.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.361+0000 7f9f15e68700 1 -- 172.21.15.123:0/2270699835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f10107580 con 0x7f9f10106a50 2024-05-06T13:54:03.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.361+0000 7f9f15e68700 1 --2- 172.21.15.123:0/2270699835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 0x7f9f10106e70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0098a0 tx=0x7f9f0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75efb3cdc04e24c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:03.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.361+0000 7f9f14e66700 1 -- 172.21.15.123:0/2270699835 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f0c004180 con 0x7f9f10106a50 2024-05-06T13:54:03.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.361+0000 7f9f14e66700 1 -- 172.21.15.123:0/2270699835 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9f0c0042e0 con 0x7f9f10106a50 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.361+0000 7f9f14e66700 1 -- 172.21.15.123:0/2270699835 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f0c011a50 con 0x7f9f10106a50 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.362+0000 7f9f180cc700 1 -- 172.21.15.123:0/2270699835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 msgr2=0x7f9f10106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.362+0000 7f9f180cc700 1 --2- 172.21.15.123:0/2270699835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 0x7f9f10106e70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0098a0 tx=0x7f9f0c009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.362+0000 7f9f180cc700 1 -- 172.21.15.123:0/2270699835 shutdown_connections 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.362+0000 7f9f180cc700 1 --2- 172.21.15.123:0/2270699835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 0x7f9f10106e70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.362+0000 7f9f180cc700 1 -- 172.21.15.123:0/2270699835 >> 172.21.15.123:0/2270699835 conn(0x7f9f10100190 msgr2=0x7f9f101025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.362+0000 7f9f180cc700 1 -- 172.21.15.123:0/2270699835 shutdown_connections 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.362+0000 7f9f180cc700 1 -- 172.21.15.123:0/2270699835 wait complete. 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.362+0000 7f9f180cc700 1 Processor -- start 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.362+0000 7f9f180cc700 1 -- start start 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.362+0000 7f9f180cc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 0x7f9f1019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.362+0000 7f9f180cc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1019a710 con 0x7f9f10106a50 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.363+0000 7f9f15e68700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 0x7f9f1019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.363+0000 7f9f15e68700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 0x7f9f1019a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35626/0 (socket says 172.21.15.123:35626) 2024-05-06T13:54:03.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.363+0000 7f9f15e68700 1 -- 172.21.15.123:0/1045645798 learned_addr learned my addr 172.21.15.123:0/1045645798 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.363+0000 7f9f15e68700 1 -- 172.21.15.123:0/1045645798 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c009550 con 0x7f9f10106a50 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.363+0000 7f9f15e68700 1 --2- 172.21.15.123:0/1045645798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 0x7f9f1019a1d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c000c00 tx=0x7f9f0c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.363+0000 7f9f06ffd700 1 -- 172.21.15.123:0/1045645798 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f0c003b90 con 0x7f9f10106a50 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.363+0000 7f9f180cc700 1 -- 172.21.15.123:0/1045645798 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1019a910 con 0x7f9f10106a50 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.363+0000 7f9f06ffd700 1 -- 172.21.15.123:0/1045645798 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9f0c0248b0 con 0x7f9f10106a50 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.363+0000 7f9f06ffd700 1 -- 172.21.15.123:0/1045645798 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f0c01a8e0 con 0x7f9f10106a50 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.363+0000 7f9f06ffd700 1 -- 172.21.15.123:0/1045645798 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9f0c0193c0 con 0x7f9f10106a50 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.363+0000 7f9f180cc700 1 -- 172.21.15.123:0/1045645798 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1019adb0 con 0x7f9f10106a50 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.364+0000 7f9f06ffd700 1 -- 172.21.15.123:0/1045645798 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9f0c019850 con 0x7f9f10106a50 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.365+0000 7f9f180cc700 1 -- 172.21.15.123:0/1045645798 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f100623c0 con 0x7f9f10106a50 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.367+0000 7f9f06ffd700 1 -- 172.21.15.123:0/1045645798 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f9f10107580 con 0x7f9f10106a50 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.437+0000 7f9f180cc700 1 -- 172.21.15.123:0/1045645798 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9f10106390 con 0x7f9f10106a50 2024-05-06T13:54:03.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.437+0000 7f9f06ffd700 1 -- 172.21.15.123:0/1045645798 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f9f0c024dd0 con 0x7f9f10106a50 2024-05-06T13:54:03.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.438+0000 7f9f180cc700 1 -- 172.21.15.123:0/1045645798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 msgr2=0x7f9f1019a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:03.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.438+0000 7f9f180cc700 1 --2- 172.21.15.123:0/1045645798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 0x7f9f1019a1d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c000c00 tx=0x7f9f0c011ab0 comp rx=0 tx=0).stop 2024-05-06T13:54:03.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.438+0000 7f9f180cc700 1 -- 172.21.15.123:0/1045645798 shutdown_connections 2024-05-06T13:54:03.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.438+0000 7f9f180cc700 1 --2- 172.21.15.123:0/1045645798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f10106a50 0x7f9f1019a1d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:03.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.438+0000 7f9f180cc700 1 -- 172.21.15.123:0/1045645798 >> 172.21.15.123:0/1045645798 conn(0x7f9f10100190 msgr2=0x7f9f10104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:03.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.438+0000 7f9f180cc700 1 -- 172.21.15.123:0/1045645798 shutdown_connections 2024-05-06T13:54:03.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:02.438+0000 7f9f180cc700 1 -- 172.21.15.123:0/1045645798 wait complete. 2024-05-06T13:54:03.082 INFO:teuthology.orchestra.run.smithi123.stdout:mgr not available, waiting (1/15)... 2024-05-06T13:54:06.221 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:05 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1099253242' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-06T13:54:06.225 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:54:06.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-05-06T13:54:06.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "f22edd3c-0baf-11ef-bc97-c7b262605968", 2024-05-06T13:54:06.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-05-06T13:54:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-06T13:54:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-06T13:54:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-06T13:54:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-06T13:54:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-06T13:54:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-05-06T13:54:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-05-06T13:54:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-06T13:54:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "smithi123" 2024-05-06T13:54:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-05-06T13:54:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-06T13:54:06.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:06.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:06.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-05-06T13:53:53.764472+0000", 2024-05-06T13:54:06.241 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T13:54:06.241 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:06.241 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-06T13:54:06.241 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-05-06T13:54:06.241 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.516+0000 7f8ceca22700 1 Processor -- start 2024-05-06T13:54:06.241 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.516+0000 7f8ceca22700 1 -- start start 2024-05-06T13:54:06.241 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.517+0000 7f8ceca22700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 0x7f8ce8104c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:06.241 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.517+0000 7f8ceca22700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8105240 con 0x7f8ce8104850 2024-05-06T13:54:06.241 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.517+0000 7f8ce659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 0x7f8ce8104c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:06.242 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.517+0000 7f8ce659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 0x7f8ce8104c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35630/0 (socket says 172.21.15.123:35630) 2024-05-06T13:54:06.242 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.517+0000 7f8ce659c700 1 -- 172.21.15.123:0/2426434935 learned_addr learned my addr 172.21.15.123:0/2426434935 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:06.242 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.517+0000 7f8ce659c700 1 -- 172.21.15.123:0/2426434935 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8105380 con 0x7f8ce8104850 2024-05-06T13:54:06.242 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.518+0000 7f8ce659c700 1 --2- 172.21.15.123:0/2426434935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 0x7f8ce8104c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80098a0 tx=0x7f8cd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840e56c4028db3a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:06.242 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.518+0000 7f8ce559a700 1 -- 172.21.15.123:0/2426434935 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cd8004180 con 0x7f8ce8104850 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.518+0000 7f8ce559a700 1 -- 172.21.15.123:0/2426434935 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8cd80042e0 con 0x7f8ce8104850 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.518+0000 7f8ce559a700 1 -- 172.21.15.123:0/2426434935 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cd8011a50 con 0x7f8ce8104850 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.518+0000 7f8ceca22700 1 -- 172.21.15.123:0/2426434935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 msgr2=0x7f8ce8104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.518+0000 7f8ceca22700 1 --2- 172.21.15.123:0/2426434935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 0x7f8ce8104c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80098a0 tx=0x7f8cd8009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.519+0000 7f8ceca22700 1 -- 172.21.15.123:0/2426434935 shutdown_connections 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.519+0000 7f8ceca22700 1 --2- 172.21.15.123:0/2426434935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 0x7f8ce8104c70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.519+0000 7f8ceca22700 1 -- 172.21.15.123:0/2426434935 >> 172.21.15.123:0/2426434935 conn(0x7f8ce8100190 msgr2=0x7f8ce81025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.519+0000 7f8ceca22700 1 -- 172.21.15.123:0/2426434935 shutdown_connections 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.519+0000 7f8ceca22700 1 -- 172.21.15.123:0/2426434935 wait complete. 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.520+0000 7f8ceca22700 1 Processor -- start 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.520+0000 7f8ceca22700 1 -- start start 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.520+0000 7f8ceca22700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 0x7f8ce8107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.520+0000 7f8ceca22700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8107770 con 0x7f8ce8104850 2024-05-06T13:54:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.520+0000 7f8ce659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 0x7f8ce8107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.520+0000 7f8ce659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 0x7f8ce8107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35634/0 (socket says 172.21.15.123:35634) 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.520+0000 7f8ce659c700 1 -- 172.21.15.123:0/1099253242 learned_addr learned my addr 172.21.15.123:0/1099253242 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.520+0000 7f8ce659c700 1 -- 172.21.15.123:0/1099253242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8009550 con 0x7f8ce8104850 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.520+0000 7f8ce659c700 1 --2- 172.21.15.123:0/1099253242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 0x7f8ce8107230 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8000c00 tx=0x7f8cd8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.521+0000 7f8cd77fe700 1 -- 172.21.15.123:0/1099253242 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cd8003b90 con 0x7f8ce8104850 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.521+0000 7f8ceca22700 1 -- 172.21.15.123:0/1099253242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce81058e0 con 0x7f8ce8104850 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.521+0000 7f8ceca22700 1 -- 172.21.15.123:0/1099253242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce8105de0 con 0x7f8ce8104850 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.521+0000 7f8cd77fe700 1 -- 172.21.15.123:0/1099253242 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8cd80248b0 con 0x7f8ce8104850 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.521+0000 7f8cd77fe700 1 -- 172.21.15.123:0/1099253242 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cd801a8e0 con 0x7f8ce8104850 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.521+0000 7f8cd77fe700 1 -- 172.21.15.123:0/1099253242 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8cd802d3f0 con 0x7f8ce8104850 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.521+0000 7f8cd77fe700 1 -- 172.21.15.123:0/1099253242 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8cd8019410 con 0x7f8ce8104850 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.522+0000 7f8ceca22700 1 -- 172.21.15.123:0/1099253242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc8005320 con 0x7f8ce8104850 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.524+0000 7f8cd77fe700 1 -- 172.21.15.123:0/1099253242 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f8cd8024440 con 0x7f8ce8104850 2024-05-06T13:54:06.244 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.598+0000 7f8ceca22700 1 -- 172.21.15.123:0/1099253242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8cc8005cc0 con 0x7f8ce8104850 2024-05-06T13:54:06.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.598+0000 7f8cd77fe700 1 -- 172.21.15.123:0/1099253242 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f8cd80245e0 con 0x7f8ce8104850 2024-05-06T13:54:06.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.600+0000 7f8ceca22700 1 -- 172.21.15.123:0/1099253242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 msgr2=0x7f8ce8107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:06.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.600+0000 7f8ceca22700 1 --2- 172.21.15.123:0/1099253242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 0x7f8ce8107230 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8000c00 tx=0x7f8cd8011ab0 comp rx=0 tx=0).stop 2024-05-06T13:54:06.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.600+0000 7f8ceca22700 1 -- 172.21.15.123:0/1099253242 shutdown_connections 2024-05-06T13:54:06.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.600+0000 7f8ceca22700 1 --2- 172.21.15.123:0/1099253242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ce8104850 0x7f8ce8107230 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:06.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.600+0000 7f8ceca22700 1 -- 172.21.15.123:0/1099253242 >> 172.21.15.123:0/1099253242 conn(0x7f8ce8100190 msgr2=0x7f8ce8100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:06.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.600+0000 7f8ceca22700 1 -- 172.21.15.123:0/1099253242 shutdown_connections 2024-05-06T13:54:06.245 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:05.600+0000 7f8ceca22700 1 -- 172.21.15.123:0/1099253242 wait complete. 2024-05-06T13:54:06.245 INFO:teuthology.orchestra.run.smithi123.stdout:mgr not available, waiting (2/15)... 2024-05-06T13:54:08.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: Activating manager daemon smithi123.vjztrj 2024-05-06T13:54:08.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: mgrmap e2: smithi123.vjztrj(active, starting, since 0.0030403s) 2024-05-06T13:54:08.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: from='mgr.14100 172.21.15.123:0/1639576353' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:54:08.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: from='mgr.14100 172.21.15.123:0/1639576353' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:54:08.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: from='mgr.14100 172.21.15.123:0/1639576353' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:54:08.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: from='mgr.14100 172.21.15.123:0/1639576353' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-05-06T13:54:08.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: from='mgr.14100 172.21.15.123:0/1639576353' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr metadata", "who": "smithi123.vjztrj", "id": "smithi123.vjztrj"}]: dispatch 2024-05-06T13:54:08.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: Manager daemon smithi123.vjztrj is now available 2024-05-06T13:54:08.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: from='mgr.14100 172.21.15.123:0/1639576353' entity='mgr.smithi123.vjztrj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.vjztrj/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:54:08.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: from='mgr.14100 172.21.15.123:0/1639576353' entity='mgr.smithi123.vjztrj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.vjztrj/trash_purge_schedule"}]: dispatch 2024-05-06T13:54:08.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: from='mgr.14100 172.21.15.123:0/1639576353' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:08.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: from='mgr.14100 172.21.15.123:0/1639576353' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:08.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:08 smithi123 ceph-mon[27254]: from='mgr.14100 172.21.15.123:0/1639576353' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:09.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:54:09.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-05-06T13:54:09.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "f22edd3c-0baf-11ef-bc97-c7b262605968", 2024-05-06T13:54:09.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-05-06T13:54:09.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-06T13:54:09.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-06T13:54:09.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-06T13:54:09.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:09.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-06T13:54:09.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-06T13:54:09.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-05-06T13:54:09.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-05-06T13:54:09.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-06T13:54:09.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "smithi123" 2024-05-06T13:54:09.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-05-06T13:54:09.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-05-06T13:54:09.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-06T13:54:09.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:09.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-06T13:54:09.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-06T13:54:09.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:09.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-06T13:54:09.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:09.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-06T13:54:09.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-06T13:54:09.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-06T13:54:09.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-06T13:54:09.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-06T13:54:09.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-06T13:54:09.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:09.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-06T13:54:09.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-06T13:54:09.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-06T13:54:09.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-06T13:54:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-06T13:54:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-06T13:54:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-06T13:54:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-06T13:54:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-06T13:54:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-06T13:54:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-06T13:54:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-06T13:54:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:09.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-05-06T13:53:53.764472+0000", 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T13:54:09.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:09.254 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-06T13:54:09.254 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.644+0000 7f197ccce700 1 Processor -- start 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.645+0000 7f197ccce700 1 -- start start 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.645+0000 7f197ccce700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 0x7f1978106980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.645+0000 7f197ccce700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1978106f50 con 0x7f1978106560 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.645+0000 7f197659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 0x7f1978106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.645+0000 7f197659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 0x7f1978106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45892/0 (socket says 172.21.15.123:45892) 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.645+0000 7f197659c700 1 -- 172.21.15.123:0/2321760712 learned_addr learned my addr 172.21.15.123:0/2321760712 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.645+0000 7f197659c700 1 -- 172.21.15.123:0/2321760712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1978107760 con 0x7f1978106560 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.645+0000 7f197659c700 1 --2- 172.21.15.123:0/2321760712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 0x7f1978106980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1970009e80 tx=0x7f197000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa9a6684534605e server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.646+0000 7f197559a700 1 -- 172.21.15.123:0/2321760712 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f197000e070 con 0x7f1978106560 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.646+0000 7f197559a700 1 -- 172.21.15.123:0/2321760712 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1970003e90 con 0x7f1978106560 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.646+0000 7f197559a700 1 -- 172.21.15.123:0/2321760712 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1970004380 con 0x7f1978106560 2024-05-06T13:54:09.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.646+0000 7f197ccce700 1 -- 172.21.15.123:0/2321760712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 msgr2=0x7f1978106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.646+0000 7f197ccce700 1 --2- 172.21.15.123:0/2321760712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 0x7f1978106980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1970009e80 tx=0x7f197000b330 comp rx=0 tx=0).stop 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.646+0000 7f197ccce700 1 -- 172.21.15.123:0/2321760712 shutdown_connections 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.646+0000 7f197ccce700 1 --2- 172.21.15.123:0/2321760712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 0x7f1978106980 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.646+0000 7f197ccce700 1 -- 172.21.15.123:0/2321760712 >> 172.21.15.123:0/2321760712 conn(0x7f1978101b40 msgr2=0x7f1978103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.646+0000 7f197ccce700 1 -- 172.21.15.123:0/2321760712 shutdown_connections 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.646+0000 7f197ccce700 1 -- 172.21.15.123:0/2321760712 wait complete. 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.647+0000 7f197ccce700 1 Processor -- start 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.647+0000 7f197ccce700 1 -- start start 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.647+0000 7f197ccce700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 0x7f197819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.647+0000 7f197ccce700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197819a710 con 0x7f1978106560 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.647+0000 7f197659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 0x7f197819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.647+0000 7f197659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 0x7f197819a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45908/0 (socket says 172.21.15.123:45908) 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.647+0000 7f197659c700 1 -- 172.21.15.123:0/728682242 learned_addr learned my addr 172.21.15.123:0/728682242 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:09.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.648+0000 7f197659c700 1 -- 172.21.15.123:0/728682242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1970009b30 con 0x7f1978106560 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.648+0000 7f197659c700 1 --2- 172.21.15.123:0/728682242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 0x7f197819a1d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f197000d010 tx=0x7f1970004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.648+0000 7f196f7fe700 1 -- 172.21.15.123:0/728682242 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f197000e040 con 0x7f1978106560 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.648+0000 7f196f7fe700 1 -- 172.21.15.123:0/728682242 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1970003c30 con 0x7f1978106560 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.648+0000 7f197ccce700 1 -- 172.21.15.123:0/728682242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197819a910 con 0x7f1978106560 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.648+0000 7f196f7fe700 1 -- 172.21.15.123:0/728682242 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f197001b790 con 0x7f1978106560 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.648+0000 7f197ccce700 1 -- 172.21.15.123:0/728682242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197819ae10 con 0x7f1978106560 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.649+0000 7f196f7fe700 1 -- 172.21.15.123:0/728682242 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 2) v1 ==== 45039+0+0 (secure 0 0 0) 0x7f1970019040 con 0x7f1978106560 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.649+0000 7f196f7fe700 1 -- 172.21.15.123:0/728682242 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f197004b9f0 con 0x7f1978106560 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.649+0000 7f197ccce700 1 -- 172.21.15.123:0/728682242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19780623c0 con 0x7f1978106560 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.651+0000 7f196f7fe700 1 -- 172.21.15.123:0/728682242 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f197001baf0 con 0x7f1978106560 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.719+0000 7f197ccce700 1 -- 172.21.15.123:0/728682242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f197810a990 con 0x7f1978106560 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.719+0000 7f196f7fe700 1 -- 172.21.15.123:0/728682242 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f197001f030 con 0x7f1978106560 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.720+0000 7f197ccce700 1 -- 172.21.15.123:0/728682242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 msgr2=0x7f197819a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.720+0000 7f197ccce700 1 --2- 172.21.15.123:0/728682242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 0x7f197819a1d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f197000d010 tx=0x7f1970004430 comp rx=0 tx=0).stop 2024-05-06T13:54:09.257 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.720+0000 7f197ccce700 1 -- 172.21.15.123:0/728682242 shutdown_connections 2024-05-06T13:54:09.258 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.720+0000 7f197ccce700 1 --2- 172.21.15.123:0/728682242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1978106560 0x7f197819a1d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:09.258 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.720+0000 7f197ccce700 1 -- 172.21.15.123:0/728682242 >> 172.21.15.123:0/728682242 conn(0x7f1978101b40 msgr2=0x7f1978102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:09.258 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.720+0000 7f197ccce700 1 -- 172.21.15.123:0/728682242 shutdown_connections 2024-05-06T13:54:09.258 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:08.720+0000 7f197ccce700 1 -- 172.21.15.123:0/728682242 wait complete. 2024-05-06T13:54:09.258 INFO:teuthology.orchestra.run.smithi123.stdout:mgr not available, waiting (3/15)... 2024-05-06T13:54:09.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:09 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/728682242' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-06T13:54:09.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:09 smithi123 ceph-mon[27254]: mgrmap e3: smithi123.vjztrj(active, since 1.00664s) 2024-05-06T13:54:12.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:11 smithi123 ceph-mon[27254]: mgrmap e4: smithi123.vjztrj(active, since 2s) 2024-05-06T13:54:12.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:54:12.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-05-06T13:54:12.562 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "f22edd3c-0baf-11ef-bc97-c7b262605968", 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "smithi123" 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-06T13:54:12.563 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:12.564 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-06T13:54:12.564 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-06T13:54:12.564 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:12.564 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-06T13:54:12.564 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:12.564 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-06T13:54:12.564 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-06T13:54:12.564 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-06T13:54:12.573 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-06T13:54:12.573 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-06T13:54:12.573 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-06T13:54:12.574 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:12.574 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-06T13:54:12.574 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-06T13:54:12.574 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-06T13:54:12.574 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-06T13:54:12.574 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-06T13:54:12.574 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-06T13:54:12.574 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-06T13:54:12.574 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-06T13:54:12.574 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-05-06T13:54:12.575 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-05-06T13:53:53.764472+0000", 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.654+0000 7fa1f73c0700 1 Processor -- start 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.654+0000 7fa1f73c0700 1 -- start start 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.655+0000 7fa1f73c0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 0x7fa1f01069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.655+0000 7fa1f73c0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0106f70 con 0x7fa1f0106580 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.655+0000 7fa1f515c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 0x7fa1f01069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:12.576 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.655+0000 7fa1f515c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 0x7fa1f01069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45916/0 (socket says 172.21.15.123:45916) 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.655+0000 7fa1f515c700 1 -- 172.21.15.123:0/3879832010 learned_addr learned my addr 172.21.15.123:0/3879832010 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.655+0000 7fa1f515c700 1 -- 172.21.15.123:0/3879832010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f0107780 con 0x7fa1f0106580 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.655+0000 7fa1f515c700 1 --2- 172.21.15.123:0/3879832010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 0x7fa1f01069a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80098a0 tx=0x7fa1e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313d52891cf6ac68 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.655+0000 7fa1e7fff700 1 -- 172.21.15.123:0/3879832010 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1e8004180 con 0x7fa1f0106580 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.655+0000 7fa1e7fff700 1 -- 172.21.15.123:0/3879832010 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa1e80042e0 con 0x7fa1f0106580 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.655+0000 7fa1e7fff700 1 -- 172.21.15.123:0/3879832010 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1e8011a50 con 0x7fa1f0106580 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.656+0000 7fa1f73c0700 1 -- 172.21.15.123:0/3879832010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 msgr2=0x7fa1f01069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.656+0000 7fa1f73c0700 1 --2- 172.21.15.123:0/3879832010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 0x7fa1f01069a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80098a0 tx=0x7fa1e8009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.656+0000 7fa1f73c0700 1 -- 172.21.15.123:0/3879832010 shutdown_connections 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.656+0000 7fa1f73c0700 1 --2- 172.21.15.123:0/3879832010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 0x7fa1f01069a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.656+0000 7fa1f73c0700 1 -- 172.21.15.123:0/3879832010 >> 172.21.15.123:0/3879832010 conn(0x7fa1f0101b00 msgr2=0x7fa1f0103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.656+0000 7fa1f73c0700 1 -- 172.21.15.123:0/3879832010 shutdown_connections 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.656+0000 7fa1f73c0700 1 -- 172.21.15.123:0/3879832010 wait complete. 2024-05-06T13:54:12.577 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1f73c0700 1 Processor -- start 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1f73c0700 1 -- start start 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1f73c0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 0x7fa1f007bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1f73c0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f007c170 con 0x7fa1f0106580 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1f515c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 0x7fa1f007bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1f515c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 0x7fa1f007bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45922/0 (socket says 172.21.15.123:45922) 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1f515c700 1 -- 172.21.15.123:0/1528659203 learned_addr learned my addr 172.21.15.123:0/1528659203 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1f515c700 1 -- 172.21.15.123:0/1528659203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8009550 con 0x7fa1f0106580 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1f515c700 1 --2- 172.21.15.123:0/1528659203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 0x7fa1f007bc30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009520 tx=0x7fa1e8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1e67fc700 1 -- 172.21.15.123:0/1528659203 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1e8003a80 con 0x7fa1f0106580 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1e67fc700 1 -- 172.21.15.123:0/1528659203 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa1e8003be0 con 0x7fa1f0106580 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1e67fc700 1 -- 172.21.15.123:0/1528659203 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1e80197b0 con 0x7fa1f0106580 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.657+0000 7fa1f73c0700 1 -- 172.21.15.123:0/1528659203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f007a280 con 0x7fa1f0106580 2024-05-06T13:54:12.578 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.658+0000 7fa1f73c0700 1 -- 172.21.15.123:0/1528659203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f007a720 con 0x7fa1f0106580 2024-05-06T13:54:12.579 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.658+0000 7fa1e67fc700 1 -- 172.21.15.123:0/1528659203 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 45272+0+0 (secure 0 0 0) 0x7fa1e801a430 con 0x7fa1f0106580 2024-05-06T13:54:12.579 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.658+0000 7fa1e67fc700 1 --2- 172.21.15.123:0/1528659203 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7fa1dc038280 0x7fa1dc03a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:12.579 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.658+0000 7fa1f73c0700 1 -- 172.21.15.123:0/1528659203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f00623c0 con 0x7fa1f0106580 2024-05-06T13:54:12.579 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.659+0000 7fa1e67fc700 1 -- 172.21.15.123:0/1528659203 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa1e804c4b0 con 0x7fa1f0106580 2024-05-06T13:54:12.579 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.659+0000 7fa1f495b700 1 --2- 172.21.15.123:0/1528659203 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7fa1dc038280 0x7fa1dc03a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:12.579 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.659+0000 7fa1f495b700 1 --2- 172.21.15.123:0/1528659203 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7fa1dc038280 0x7fa1dc03a740 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0006fd0 tx=0x7fa1e0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:12.579 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.663+0000 7fa1e67fc700 1 -- 172.21.15.123:0/1528659203 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa1e8018530 con 0x7fa1f0106580 2024-05-06T13:54:12.579 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.926+0000 7fa1f73c0700 1 -- 172.21.15.123:0/1528659203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa1f010a980 con 0x7fa1f0106580 2024-05-06T13:54:12.579 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.926+0000 7fa1e67fc700 1 -- 172.21.15.123:0/1528659203 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fa1e80172b0 con 0x7fa1f0106580 2024-05-06T13:54:12.580 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.928+0000 7fa1f73c0700 1 -- 172.21.15.123:0/1528659203 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7fa1dc038280 msgr2=0x7fa1dc03a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:12.580 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.928+0000 7fa1f73c0700 1 --2- 172.21.15.123:0/1528659203 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7fa1dc038280 0x7fa1dc03a740 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0006fd0 tx=0x7fa1e0006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:12.580 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.928+0000 7fa1f73c0700 1 -- 172.21.15.123:0/1528659203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 msgr2=0x7fa1f007bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:12.580 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.928+0000 7fa1f73c0700 1 --2- 172.21.15.123:0/1528659203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 0x7fa1f007bc30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009520 tx=0x7fa1e8011ab0 comp rx=0 tx=0).stop 2024-05-06T13:54:12.580 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.928+0000 7fa1f73c0700 1 -- 172.21.15.123:0/1528659203 shutdown_connections 2024-05-06T13:54:12.580 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.928+0000 7fa1f73c0700 1 --2- 172.21.15.123:0/1528659203 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7fa1dc038280 0x7fa1dc03a740 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:12.580 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.928+0000 7fa1f73c0700 1 --2- 172.21.15.123:0/1528659203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1f0106580 0x7fa1f007bc30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:12.580 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.928+0000 7fa1f73c0700 1 -- 172.21.15.123:0/1528659203 >> 172.21.15.123:0/1528659203 conn(0x7fa1f0101b00 msgr2=0x7fa1f0102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:12.580 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.929+0000 7fa1f73c0700 1 -- 172.21.15.123:0/1528659203 shutdown_connections 2024-05-06T13:54:12.580 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:11.929+0000 7fa1f73c0700 1 -- 172.21.15.123:0/1528659203 wait complete. 2024-05-06T13:54:12.580 INFO:teuthology.orchestra.run.smithi123.stdout:mgr is available 2024-05-06T13:54:12.960 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:12 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1528659203' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-06T13:54:13.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:54:13.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [global] 2024-05-06T13:54:13.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout fsid = f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:54:13.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-06T13:54:13.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-06T13:54:13.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-06T13:54:13.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-06T13:54:13.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:54:13.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-06T13:54:13.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-06T13:54:13.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-05-06T13:54:13.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [osd] 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.983+0000 7f8381902700 1 Processor -- start 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.983+0000 7f8381902700 1 -- start start 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.983+0000 7f8381902700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 0x7f837c105880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.983+0000 7f8381902700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c105e50 con 0x7f837c105460 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.983+0000 7f837affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 0x7f837c105880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.983+0000 7f837affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 0x7f837c105880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45928/0 (socket says 172.21.15.123:45928) 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.983+0000 7f837affd700 1 -- 172.21.15.123:0/2589206243 learned_addr learned my addr 172.21.15.123:0/2589206243 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.984+0000 7f837affd700 1 -- 172.21.15.123:0/2589206243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c106660 con 0x7f837c105460 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.984+0000 7f837affd700 1 --2- 172.21.15.123:0/2589206243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 0x7f837c105880 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f836c0098a0 tx=0x7f836c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65ae239180b474e server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:13.757 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.984+0000 7f837a7fc700 1 -- 172.21.15.123:0/2589206243 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f836c004180 con 0x7f837c105460 2024-05-06T13:54:13.758 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.984+0000 7f837a7fc700 1 -- 172.21.15.123:0/2589206243 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f836c0042e0 con 0x7f837c105460 2024-05-06T13:54:13.758 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.984+0000 7f837a7fc700 1 -- 172.21.15.123:0/2589206243 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f836c011a50 con 0x7f837c105460 2024-05-06T13:54:13.758 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.984+0000 7f8381902700 1 -- 172.21.15.123:0/2589206243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 msgr2=0x7f837c105880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:13.758 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.984+0000 7f8381902700 1 --2- 172.21.15.123:0/2589206243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 0x7f837c105880 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f836c0098a0 tx=0x7f836c009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:13.758 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.985+0000 7f8381902700 1 -- 172.21.15.123:0/2589206243 shutdown_connections 2024-05-06T13:54:13.758 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.985+0000 7f8381902700 1 --2- 172.21.15.123:0/2589206243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 0x7f837c105880 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:13.758 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.985+0000 7f8381902700 1 -- 172.21.15.123:0/2589206243 >> 172.21.15.123:0/2589206243 conn(0x7f837c100a20 msgr2=0x7f837c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:13.758 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.985+0000 7f8381902700 1 -- 172.21.15.123:0/2589206243 shutdown_connections 2024-05-06T13:54:13.758 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.985+0000 7f8381902700 1 -- 172.21.15.123:0/2589206243 wait complete. 2024-05-06T13:54:13.758 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.985+0000 7f8381902700 1 Processor -- start 2024-05-06T13:54:13.758 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.985+0000 7f8381902700 1 -- start start 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.985+0000 7f8381902700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 0x7f837c079b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.985+0000 7f8381902700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c19cf70 con 0x7f837c105460 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.986+0000 7f837affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 0x7f837c079b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.986+0000 7f837affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 0x7f837c079b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45940/0 (socket says 172.21.15.123:45940) 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.986+0000 7f837affd700 1 -- 172.21.15.123:0/2490539764 learned_addr learned my addr 172.21.15.123:0/2490539764 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.986+0000 7f837affd700 1 -- 172.21.15.123:0/2490539764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c009550 con 0x7f837c105460 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.986+0000 7f837affd700 1 --2- 172.21.15.123:0/2490539764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 0x7f837c079b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f836c009520 tx=0x7f836c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.986+0000 7f8380900700 1 -- 172.21.15.123:0/2490539764 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f836c003a80 con 0x7f837c105460 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.986+0000 7f8381902700 1 -- 172.21.15.123:0/2490539764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c19d0b0 con 0x7f837c105460 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.986+0000 7f8380900700 1 -- 172.21.15.123:0/2490539764 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f836c003be0 con 0x7f837c105460 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.986+0000 7f8380900700 1 -- 172.21.15.123:0/2490539764 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f836c0197b0 con 0x7f837c105460 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.986+0000 7f8381902700 1 -- 172.21.15.123:0/2490539764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c19d550 con 0x7f837c105460 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.987+0000 7f8380900700 1 -- 172.21.15.123:0/2490539764 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 45272+0+0 (secure 0 0 0) 0x7f836c019a70 con 0x7f837c105460 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.987+0000 7f8381902700 1 -- 172.21.15.123:0/2490539764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c0623c0 con 0x7f837c105460 2024-05-06T13:54:13.759 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.987+0000 7f8380900700 1 --2- 172.21.15.123:0/2490539764 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f8368038280 0x7f836803a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.987+0000 7f8380900700 1 -- 172.21.15.123:0/2490539764 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f836c04c4d0 con 0x7f837c105460 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.987+0000 7f83727fc700 1 --2- 172.21.15.123:0/2490539764 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f8368038280 0x7f836803a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.988+0000 7f83727fc700 1 --2- 172.21.15.123:0/2490539764 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f8368038280 0x7f836803a740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8364006fd0 tx=0x7f8364006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:12.992+0000 7f8380900700 1 -- 172.21.15.123:0/2490539764 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f836c018740 con 0x7f837c105460 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:13.178+0000 7f8381902700 1 -- 172.21.15.123:0/2490539764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f837c109860 con 0x7f837c105460 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:13.179+0000 7f8380900700 1 -- 172.21.15.123:0/2490539764 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f836c0172b0 con 0x7f837c105460 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:13.181+0000 7f8381902700 1 -- 172.21.15.123:0/2490539764 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f8368038280 msgr2=0x7f836803a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:13.181+0000 7f8381902700 1 --2- 172.21.15.123:0/2490539764 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f8368038280 0x7f836803a740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8364006fd0 tx=0x7f8364006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:13.181+0000 7f8381902700 1 -- 172.21.15.123:0/2490539764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 msgr2=0x7f837c079b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:13.181+0000 7f8381902700 1 --2- 172.21.15.123:0/2490539764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 0x7f837c079b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f836c009520 tx=0x7f836c011ab0 comp rx=0 tx=0).stop 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:13.181+0000 7f8381902700 1 -- 172.21.15.123:0/2490539764 shutdown_connections 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:13.181+0000 7f8381902700 1 --2- 172.21.15.123:0/2490539764 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f8368038280 0x7f836803a740 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:13.181+0000 7f8381902700 1 --2- 172.21.15.123:0/2490539764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f837c105460 0x7f837c079b10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:13.760 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:13.181+0000 7f8381902700 1 -- 172.21.15.123:0/2490539764 >> 172.21.15.123:0/2490539764 conn(0x7f837c100a20 msgr2=0x7f837c101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:13.761 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:13.181+0000 7f8381902700 1 -- 172.21.15.123:0/2490539764 shutdown_connections 2024-05-06T13:54:13.761 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:13.181+0000 7f8381902700 1 -- 172.21.15.123:0/2490539764 wait complete. 2024-05-06T13:54:13.761 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling cephadm module... 2024-05-06T13:54:14.058 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:13 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2490539764' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-06T13:54:15.221 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:14 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3308343008' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-06T13:54:15.522 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.155+0000 7fa66cbf9700 1 Processor -- start 2024-05-06T13:54:15.522 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.155+0000 7fa66cbf9700 1 -- start start 2024-05-06T13:54:15.522 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.155+0000 7fa66cbf9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 0x7fa668109420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:15.522 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.155+0000 7fa66cbf9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa668079e30 con 0x7fa668107030 2024-05-06T13:54:15.522 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.155+0000 7fa66659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 0x7fa668109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:15.522 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.155+0000 7fa66659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 0x7fa668109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45950/0 (socket says 172.21.15.123:45950) 2024-05-06T13:54:15.522 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.155+0000 7fa66659c700 1 -- 172.21.15.123:0/193030840 learned_addr learned my addr 172.21.15.123:0/193030840 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:15.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.155+0000 7fa66659c700 1 -- 172.21.15.123:0/193030840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa668109960 con 0x7fa668107030 2024-05-06T13:54:15.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.156+0000 7fa66659c700 1 --2- 172.21.15.123:0/193030840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 0x7fa668109420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa6580098a0 tx=0x7fa658009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d7b8473ba9f275 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:15.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.156+0000 7fa66559a700 1 -- 172.21.15.123:0/193030840 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa658004180 con 0x7fa668107030 2024-05-06T13:54:15.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.156+0000 7fa66559a700 1 -- 172.21.15.123:0/193030840 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa6580042e0 con 0x7fa668107030 2024-05-06T13:54:15.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.156+0000 7fa66559a700 1 -- 172.21.15.123:0/193030840 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa658011a50 con 0x7fa668107030 2024-05-06T13:54:15.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.156+0000 7fa66cbf9700 1 -- 172.21.15.123:0/193030840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 msgr2=0x7fa668109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:15.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.156+0000 7fa66cbf9700 1 --2- 172.21.15.123:0/193030840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 0x7fa668109420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa6580098a0 tx=0x7fa658009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:15.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.156+0000 7fa66cbf9700 1 -- 172.21.15.123:0/193030840 shutdown_connections 2024-05-06T13:54:15.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.156+0000 7fa66cbf9700 1 --2- 172.21.15.123:0/193030840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 0x7fa668109420 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:15.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.156+0000 7fa66cbf9700 1 -- 172.21.15.123:0/193030840 >> 172.21.15.123:0/193030840 conn(0x7fa668100a20 msgr2=0x7fa668102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:15.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.157+0000 7fa66cbf9700 1 -- 172.21.15.123:0/193030840 shutdown_connections 2024-05-06T13:54:15.523 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.157+0000 7fa66cbf9700 1 -- 172.21.15.123:0/193030840 wait complete. 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.157+0000 7fa66cbf9700 1 Processor -- start 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.157+0000 7fa66cbf9700 1 -- start start 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.157+0000 7fa66cbf9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 0x7fa66819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.157+0000 7fa66cbf9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66819a720 con 0x7fa668107030 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.158+0000 7fa66659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 0x7fa66819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.158+0000 7fa66659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 0x7fa66819a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45952/0 (socket says 172.21.15.123:45952) 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.158+0000 7fa66659c700 1 -- 172.21.15.123:0/3308343008 learned_addr learned my addr 172.21.15.123:0/3308343008 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.158+0000 7fa66659c700 1 -- 172.21.15.123:0/3308343008 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa658009550 con 0x7fa668107030 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.158+0000 7fa66659c700 1 --2- 172.21.15.123:0/3308343008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 0x7fa66819a1e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa658003de0 tx=0x7fa658011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.158+0000 7fa6577fe700 1 -- 172.21.15.123:0/3308343008 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa658003930 con 0x7fa668107030 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.158+0000 7fa6577fe700 1 -- 172.21.15.123:0/3308343008 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa658003a90 con 0x7fa668107030 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.158+0000 7fa66cbf9700 1 -- 172.21.15.123:0/3308343008 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66819a920 con 0x7fa668107030 2024-05-06T13:54:15.524 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.158+0000 7fa6577fe700 1 -- 172.21.15.123:0/3308343008 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa658019730 con 0x7fa668107030 2024-05-06T13:54:15.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.158+0000 7fa66cbf9700 1 -- 172.21.15.123:0/3308343008 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66819adc0 con 0x7fa668107030 2024-05-06T13:54:15.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.159+0000 7fa6577fe700 1 -- 172.21.15.123:0/3308343008 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 45272+0+0 (secure 0 0 0) 0x7fa658019960 con 0x7fa668107030 2024-05-06T13:54:15.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.159+0000 7fa66cbf9700 1 -- 172.21.15.123:0/3308343008 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66810a680 con 0x7fa668107030 2024-05-06T13:54:15.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.159+0000 7fa6577fe700 1 --2- 172.21.15.123:0/3308343008 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7fa650038320 0x7fa65003a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:15.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.159+0000 7fa6577fe700 1 -- 172.21.15.123:0/3308343008 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa65804bf90 con 0x7fa668107030 2024-05-06T13:54:15.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.159+0000 7fa665d9b700 1 --2- 172.21.15.123:0/3308343008 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7fa650038320 0x7fa65003a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:15.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.160+0000 7fa665d9b700 1 --2- 172.21.15.123:0/3308343008 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7fa650038320 0x7fa65003a7e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa65c006fd0 tx=0x7fa65c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:15.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.164+0000 7fa6577fe700 1 -- 172.21.15.123:0/3308343008 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa658010770 con 0x7fa668107030 2024-05-06T13:54:15.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.404+0000 7fa66cbf9700 1 -- 172.21.15.123:0/3308343008 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fa66810a8a0 con 0x7fa668107030 2024-05-06T13:54:15.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.927+0000 7fa6577fe700 1 -- 172.21.15.123:0/3308343008 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 5) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fa65801a430 con 0x7fa668107030 2024-05-06T13:54:15.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.927+0000 7fa6577fe700 1 -- 172.21.15.123:0/3308343008 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fa65801abc0 con 0x7fa668107030 2024-05-06T13:54:15.525 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.929+0000 7fa66cbf9700 1 -- 172.21.15.123:0/3308343008 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7fa650038320 msgr2=0x7fa65003a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:15.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.929+0000 7fa66cbf9700 1 --2- 172.21.15.123:0/3308343008 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7fa650038320 0x7fa65003a7e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa65c006fd0 tx=0x7fa65c006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:15.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.929+0000 7fa66cbf9700 1 -- 172.21.15.123:0/3308343008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 msgr2=0x7fa66819a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:15.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.929+0000 7fa66cbf9700 1 --2- 172.21.15.123:0/3308343008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 0x7fa66819a1e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa658003de0 tx=0x7fa658011ab0 comp rx=0 tx=0).stop 2024-05-06T13:54:15.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.929+0000 7fa66cbf9700 1 -- 172.21.15.123:0/3308343008 shutdown_connections 2024-05-06T13:54:15.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.929+0000 7fa66cbf9700 1 --2- 172.21.15.123:0/3308343008 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7fa650038320 0x7fa65003a7e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:15.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.929+0000 7fa66cbf9700 1 --2- 172.21.15.123:0/3308343008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa668107030 0x7fa66819a1e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:15.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.929+0000 7fa66cbf9700 1 -- 172.21.15.123:0/3308343008 >> 172.21.15.123:0/3308343008 conn(0x7fa668100a20 msgr2=0x7fa6681017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:15.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.929+0000 7fa66cbf9700 1 -- 172.21.15.123:0/3308343008 shutdown_connections 2024-05-06T13:54:15.526 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:14.929+0000 7fa66cbf9700 1 -- 172.21.15.123:0/3308343008 wait complete. 2024-05-06T13:54:16.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:15 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3308343008' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-06T13:54:16.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:15 smithi123 ceph-mon[27254]: mgrmap e5: smithi123.vjztrj(active, since 6s) 2024-05-06T13:54:16.871 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-05-06T13:54:16.872 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-06T13:54:16.872 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-06T13:54:16.872 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "active_name": "smithi123.vjztrj", 2024-05-06T13:54:16.872 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-06T13:54:16.872 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-05-06T13:54:16.872 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.950+0000 7f268db1b700 1 Processor -- start 2024-05-06T13:54:16.872 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.950+0000 7f268db1b700 1 -- start start 2024-05-06T13:54:16.872 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.950+0000 7f268db1b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 0x7f2688105890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:16.872 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.950+0000 7f268db1b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2688105e60 con 0x7f2688105470 2024-05-06T13:54:16.872 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.950+0000 7f26877fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 0x7f2688105890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:16.872 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.950+0000 7f26877fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 0x7f2688105890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45972/0 (socket says 172.21.15.123:45972) 2024-05-06T13:54:16.872 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.950+0000 7f26877fe700 1 -- 172.21.15.123:0/1909146309 learned_addr learned my addr 172.21.15.123:0/1909146309 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:16.873 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.950+0000 7f26877fe700 1 -- 172.21.15.123:0/1909146309 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2688106670 con 0x7f2688105470 2024-05-06T13:54:16.873 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.950+0000 7f26877fe700 1 --2- 172.21.15.123:0/1909146309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 0x7f2688105890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f26780098a0 tx=0x7f2678009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16299e9cb43288c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:16.873 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.951+0000 7f26867fc700 1 -- 172.21.15.123:0/1909146309 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2678004180 con 0x7f2688105470 2024-05-06T13:54:16.873 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.951+0000 7f26867fc700 1 -- 172.21.15.123:0/1909146309 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f26780042e0 con 0x7f2688105470 2024-05-06T13:54:16.873 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.951+0000 7f26867fc700 1 -- 172.21.15.123:0/1909146309 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2678011a50 con 0x7f2688105470 2024-05-06T13:54:16.873 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.951+0000 7f268db1b700 1 -- 172.21.15.123:0/1909146309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 msgr2=0x7f2688105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:16.873 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.951+0000 7f268db1b700 1 --2- 172.21.15.123:0/1909146309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 0x7f2688105890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f26780098a0 tx=0x7f2678009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:16.873 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.951+0000 7f268db1b700 1 -- 172.21.15.123:0/1909146309 shutdown_connections 2024-05-06T13:54:16.873 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.951+0000 7f268db1b700 1 --2- 172.21.15.123:0/1909146309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 0x7f2688105890 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:16.873 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.951+0000 7f268db1b700 1 -- 172.21.15.123:0/1909146309 >> 172.21.15.123:0/1909146309 conn(0x7f26881009f0 msgr2=0x7f2688102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:16.873 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.951+0000 7f268db1b700 1 -- 172.21.15.123:0/1909146309 shutdown_connections 2024-05-06T13:54:16.874 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.951+0000 7f268db1b700 1 -- 172.21.15.123:0/1909146309 wait complete. 2024-05-06T13:54:16.874 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.952+0000 7f268db1b700 1 Processor -- start 2024-05-06T13:54:16.874 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.952+0000 7f268db1b700 1 -- start start 2024-05-06T13:54:16.874 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.952+0000 7f268db1b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 0x7f2688079b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:16.874 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.952+0000 7f268db1b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268819cf00 con 0x7f2688105470 2024-05-06T13:54:16.874 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.953+0000 7f26877fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 0x7f2688079b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:16.874 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.953+0000 7f26877fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 0x7f2688079b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45978/0 (socket says 172.21.15.123:45978) 2024-05-06T13:54:16.874 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.953+0000 7f26877fe700 1 -- 172.21.15.123:0/3474080763 learned_addr learned my addr 172.21.15.123:0/3474080763 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:16.874 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.953+0000 7f26877fe700 1 -- 172.21.15.123:0/3474080763 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2678009550 con 0x7f2688105470 2024-05-06T13:54:16.874 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.953+0000 7f26877fe700 1 --2- 172.21.15.123:0/3474080763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 0x7f2688079b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2678000c00 tx=0x7f2678011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:16.874 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.953+0000 7f2684ff9700 1 -- 172.21.15.123:0/3474080763 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2678003b90 con 0x7f2688105470 2024-05-06T13:54:16.874 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.953+0000 7f268db1b700 1 -- 172.21.15.123:0/3474080763 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268819d040 con 0x7f2688105470 2024-05-06T13:54:16.875 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.953+0000 7f2684ff9700 1 -- 172.21.15.123:0/3474080763 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f26780248b0 con 0x7f2688105470 2024-05-06T13:54:16.875 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.953+0000 7f2684ff9700 1 -- 172.21.15.123:0/3474080763 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f267801a8e0 con 0x7f2688105470 2024-05-06T13:54:16.875 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.953+0000 7f268db1b700 1 -- 172.21.15.123:0/3474080763 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268819d4e0 con 0x7f2688105470 2024-05-06T13:54:16.875 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.954+0000 7f2684ff9700 1 -- 172.21.15.123:0/3474080763 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f267801aba0 con 0x7f2688105470 2024-05-06T13:54:16.875 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.954+0000 7f2684ff9700 1 --2- 172.21.15.123:0/3474080763 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f2670038320 0x7f267003a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:16.875 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.954+0000 7f2684ff9700 1 -- 172.21.15.123:0/3474080763 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f267804d060 con 0x7f2688105470 2024-05-06T13:54:16.875 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.954+0000 7f2686ffd700 1 -- 172.21.15.123:0/3474080763 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f2670038320 msgr2=0x7f267003a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/35564330 2024-05-06T13:54:16.875 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.954+0000 7f2686ffd700 1 --2- 172.21.15.123:0/3474080763 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f2670038320 0x7f267003a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T13:54:16.875 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.954+0000 7f268db1b700 1 -- 172.21.15.123:0/3474080763 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26880623c0 con 0x7f2688105470 2024-05-06T13:54:16.875 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:15.959+0000 7f2684ff9700 1 -- 172.21.15.123:0/3474080763 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f26780233a0 con 0x7f2688105470 2024-05-06T13:54:16.875 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.155+0000 7f2686ffd700 1 -- 172.21.15.123:0/3474080763 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f2670038320 msgr2=0x7f267003a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/35564330 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.155+0000 7f2686ffd700 1 --2- 172.21.15.123:0/3474080763 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f2670038320 0x7f267003a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.246+0000 7f268db1b700 1 -- 172.21.15.123:0/3474080763 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f268819db40 con 0x7f2688105470 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.246+0000 7f2684ff9700 1 -- 172.21.15.123:0/3474080763 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f2678018ca0 con 0x7f2688105470 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.249+0000 7f268db1b700 1 -- 172.21.15.123:0/3474080763 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f2670038320 msgr2=0x7f267003a7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.249+0000 7f268db1b700 1 --2- 172.21.15.123:0/3474080763 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f2670038320 0x7f267003a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.249+0000 7f268db1b700 1 -- 172.21.15.123:0/3474080763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 msgr2=0x7f2688079b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.249+0000 7f268db1b700 1 --2- 172.21.15.123:0/3474080763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 0x7f2688079b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2678000c00 tx=0x7f2678011ab0 comp rx=0 tx=0).stop 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.249+0000 7f268db1b700 1 -- 172.21.15.123:0/3474080763 shutdown_connections 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.249+0000 7f268db1b700 1 --2- 172.21.15.123:0/3474080763 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f2670038320 0x7f267003a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.249+0000 7f268db1b700 1 --2- 172.21.15.123:0/3474080763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2688105470 0x7f2688079b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.249+0000 7f268db1b700 1 -- 172.21.15.123:0/3474080763 >> 172.21.15.123:0/3474080763 conn(0x7f26881009f0 msgr2=0x7f2688101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.249+0000 7f268db1b700 1 -- 172.21.15.123:0/3474080763 shutdown_connections 2024-05-06T13:54:16.876 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:16.249+0000 7f268db1b700 1 -- 172.21.15.123:0/3474080763 wait complete. 2024-05-06T13:54:16.877 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for the mgr to restart... 2024-05-06T13:54:16.877 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr epoch 5... 2024-05-06T13:54:17.121 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:16 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3474080763' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-06T13:54:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: Active manager daemon smithi123.vjztrj restarted 2024-05-06T13:54:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: Activating manager daemon smithi123.vjztrj 2024-05-06T13:54:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: osdmap e2: 0 total, 0 up, 0 in 2024-05-06T13:54:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: mgrmap e6: smithi123.vjztrj(active, starting, since 0.00305059s) 2024-05-06T13:54:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-05-06T13:54:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr metadata", "who": "smithi123.vjztrj", "id": "smithi123.vjztrj"}]: dispatch 2024-05-06T13:54:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:54:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:54:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:54:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: Manager daemon smithi123.vjztrj is now available 2024-05-06T13:54:21.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:21.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:21.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:54:21.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:54:21.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:54:21.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.vjztrj/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:54:21.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:21 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.vjztrj/trash_purge_schedule"}]: dispatch 2024-05-06T13:54:23.079 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:22 smithi123 ceph-mon[27254]: Found migration_current of "None". Setting to last migration. 2024-05-06T13:54:23.079 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:22 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:23.079 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:22 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:23.079 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:22 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:54:23.079 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:22 smithi123 ceph-mon[27254]: mgrmap e7: smithi123.vjztrj(active, since 1.00583s) 2024-05-06T13:54:23.087 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-05-06T13:54:23.087 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-06T13:54:23.087 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-06T13:54:23.087 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-05-06T13:54:23.087 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.339+0000 7f0e58816700 1 Processor -- start 2024-05-06T13:54:23.087 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.339+0000 7f0e58816700 1 -- start start 2024-05-06T13:54:23.087 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.339+0000 7f0e58816700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 0x7f0e54105270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:23.087 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.339+0000 7f0e58816700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e54074600 con 0x7f0e54104e50 2024-05-06T13:54:23.087 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.339+0000 7f0e5259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 0x7f0e54105270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:23.087 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.339+0000 7f0e5259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 0x7f0e54105270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45986/0 (socket says 172.21.15.123:45986) 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.339+0000 7f0e5259c700 1 -- 172.21.15.123:0/2193821213 learned_addr learned my addr 172.21.15.123:0/2193821213 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.340+0000 7f0e5259c700 1 -- 172.21.15.123:0/2193821213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e541057b0 con 0x7f0e54104e50 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.340+0000 7f0e5259c700 1 --2- 172.21.15.123:0/2193821213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 0x7f0e54105270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e440098a0 tx=0x7f0e44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319c7d716b74fb server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.340+0000 7f0e5159a700 1 -- 172.21.15.123:0/2193821213 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e44004180 con 0x7f0e54104e50 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.340+0000 7f0e5159a700 1 -- 172.21.15.123:0/2193821213 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0e440042e0 con 0x7f0e54104e50 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.340+0000 7f0e5159a700 1 -- 172.21.15.123:0/2193821213 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e44011a50 con 0x7f0e54104e50 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.341+0000 7f0e58816700 1 -- 172.21.15.123:0/2193821213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 msgr2=0x7f0e54105270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.341+0000 7f0e58816700 1 --2- 172.21.15.123:0/2193821213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 0x7f0e54105270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e440098a0 tx=0x7f0e44009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.341+0000 7f0e58816700 1 -- 172.21.15.123:0/2193821213 shutdown_connections 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.341+0000 7f0e58816700 1 --2- 172.21.15.123:0/2193821213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 0x7f0e54105270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.341+0000 7f0e58816700 1 -- 172.21.15.123:0/2193821213 >> 172.21.15.123:0/2193821213 conn(0x7f0e541009f0 msgr2=0x7f0e54102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.341+0000 7f0e58816700 1 -- 172.21.15.123:0/2193821213 shutdown_connections 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.341+0000 7f0e58816700 1 -- 172.21.15.123:0/2193821213 wait complete. 2024-05-06T13:54:23.088 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.342+0000 7f0e58816700 1 Processor -- start 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.342+0000 7f0e58816700 1 -- start start 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.342+0000 7f0e58816700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 0x7f0e5419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.342+0000 7f0e58816700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5419c8c0 con 0x7f0e54104e50 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.342+0000 7f0e5259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 0x7f0e5419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.342+0000 7f0e5259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 0x7f0e5419c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45994/0 (socket says 172.21.15.123:45994) 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.342+0000 7f0e5259c700 1 -- 172.21.15.123:0/1951395006 learned_addr learned my addr 172.21.15.123:0/1951395006 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.342+0000 7f0e5259c700 1 -- 172.21.15.123:0/1951395006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44009550 con 0x7f0e54104e50 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.342+0000 7f0e5259c700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 0x7f0e5419c380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0e44000c00 tx=0x7f0e44011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.343+0000 7f0e437fe700 1 -- 172.21.15.123:0/1951395006 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e44003b90 con 0x7f0e54104e50 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.343+0000 7f0e437fe700 1 -- 172.21.15.123:0/1951395006 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0e440248b0 con 0x7f0e54104e50 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.343+0000 7f0e58816700 1 -- 172.21.15.123:0/1951395006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5419cac0 con 0x7f0e54104e50 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.343+0000 7f0e437fe700 1 -- 172.21.15.123:0/1951395006 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e4401a8e0 con 0x7f0e54104e50 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.343+0000 7f0e58816700 1 -- 172.21.15.123:0/1951395006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5419cf60 con 0x7f0e54104e50 2024-05-06T13:54:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.344+0000 7f0e437fe700 1 -- 172.21.15.123:0/1951395006 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f0e44024440 con 0x7f0e54104e50 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.344+0000 7f0e437fe700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 0x7f0e3c03a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.344+0000 7f0e437fe700 1 -- 172.21.15.123:0/1951395006 --> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e3c03af40 con 0x7f0e3c038370 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.344+0000 7f0e437fe700 1 -- 172.21.15.123:0/1951395006 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0e4404c0f0 con 0x7f0e54104e50 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.344+0000 7f0e51d9b700 1 -- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 msgr2=0x7f0e3c03a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/35564330 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.344+0000 7f0e51d9b700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 0x7f0e3c03a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.545+0000 7f0e51d9b700 1 -- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 msgr2=0x7f0e3c03a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/35564330 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.545+0000 7f0e51d9b700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 0x7f0e3c03a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.946+0000 7f0e51d9b700 1 -- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 msgr2=0x7f0e3c03a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/35564330 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:17.946+0000 7f0e51d9b700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 0x7f0e3c03a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:18.747+0000 7f0e51d9b700 1 -- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 msgr2=0x7f0e3c03a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/35564330 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:18.747+0000 7f0e51d9b700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 0x7f0e3c03a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:20.348+0000 7f0e51d9b700 1 -- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 msgr2=0x7f0e3c03a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/35564330 2024-05-06T13:54:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:20.348+0000 7f0e51d9b700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 0x7f0e3c03a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T13:54:23.091 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:21.526+0000 7f0e437fe700 1 -- 172.21.15.123:0/1951395006 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mgrmap(e 6) v1 ==== 45050+0+0 (secure 0 0 0) 0x7f0e4402d3f0 con 0x7f0e54104e50 2024-05-06T13:54:23.091 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:21.526+0000 7f0e437fe700 1 -- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 msgr2=0x7f0e3c03a830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T13:54:23.091 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:21.526+0000 7f0e437fe700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 0x7f0e3c03a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:23.091 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.527+0000 7f0e437fe700 1 -- 172.21.15.123:0/1951395006 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 7) v1 ==== 45177+0+0 (secure 0 0 0) 0x7f0e4404dbc0 con 0x7f0e54104e50 2024-05-06T13:54:23.091 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.528+0000 7f0e437fe700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f0e3c03bd70 0x7f0e3c03e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:23.091 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.528+0000 7f0e437fe700 1 -- 172.21.15.123:0/1951395006 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e3c03af40 con 0x7f0e3c03bd70 2024-05-06T13:54:23.091 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.528+0000 7f0e51d9b700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f0e3c03bd70 0x7f0e3c03e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:23.091 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.529+0000 7f0e51d9b700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f0e3c03bd70 0x7f0e3c03e160 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0e48003a10 tx=0x7f0e480092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:23.091 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.529+0000 7f0e437fe700 1 -- 172.21.15.123:0/1951395006 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f0e3c03af40 con 0x7f0e3c03bd70 2024-05-06T13:54:23.091 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e58816700 1 -- 172.21.15.123:0/1951395006 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f0e5419d6c0 con 0x7f0e3c03bd70 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e437fe700 1 -- 172.21.15.123:0/1951395006 <== mgr.14120 v2:172.21.15.123:6800/2710951021 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0e5419d6c0 con 0x7f0e3c03bd70 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e58816700 1 -- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f0e3c03bd70 msgr2=0x7f0e3c03e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e58816700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f0e3c03bd70 0x7f0e3c03e160 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0e48003a10 tx=0x7f0e480092b0 comp rx=0 tx=0).stop 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e58816700 1 -- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 msgr2=0x7f0e5419c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e58816700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 0x7f0e5419c380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0e44000c00 tx=0x7f0e44011ab0 comp rx=0 tx=0).stop 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e58816700 1 -- 172.21.15.123:0/1951395006 shutdown_connections 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e58816700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f0e3c03bd70 0x7f0e3c03e160 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e58816700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e54104e50 0x7f0e5419c380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e58816700 1 --2- 172.21.15.123:0/1951395006 >> [v2:172.21.15.123:6800/35564330,v1:172.21.15.123:6801/35564330] conn(0x7f0e3c038370 0x7f0e3c03a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e58816700 1 -- 172.21.15.123:0/1951395006 >> 172.21.15.123:0/1951395006 conn(0x7f0e541009f0 msgr2=0x7f0e54190a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e58816700 1 -- 172.21.15.123:0/1951395006 shutdown_connections 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:22.536+0000 7f0e58816700 1 -- 172.21.15.123:0/1951395006 wait complete. 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:mgr epoch 5 is available 2024-05-06T13:54:23.092 INFO:teuthology.orchestra.run.smithi123.stdout:Setting orchestrator backend to cephadm... 2024-05-06T13:54:24.073 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:23 smithi123 ceph-mon[27254]: [06/May/2024:13:54:22] ENGINE Bus STARTING 2024-05-06T13:54:24.074 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:23 smithi123 ceph-mon[27254]: [06/May/2024:13:54:22] ENGINE Serving on http://172.21.15.123:8765 2024-05-06T13:54:24.074 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:23 smithi123 ceph-mon[27254]: [06/May/2024:13:54:22] ENGINE Serving on https://172.21.15.123:7150 2024-05-06T13:54:24.074 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:23 smithi123 ceph-mon[27254]: [06/May/2024:13:54:22] ENGINE Bus STARTED 2024-05-06T13:54:24.074 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:23 smithi123 ceph-mon[27254]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-06T13:54:24.074 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:23 smithi123 ceph-mon[27254]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-06T13:54:24.074 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:23 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:24.074 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:23 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:54:24.368 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.545+0000 7f60552df700 1 Processor -- start 2024-05-06T13:54:24.368 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.545+0000 7f60552df700 1 -- start start 2024-05-06T13:54:24.368 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.545+0000 7f60552df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 0x7f6050105230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:24.368 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.545+0000 7f60552df700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6050074640 con 0x7f6050104e10 2024-05-06T13:54:24.368 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.545+0000 7f604effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 0x7f6050105230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:24.368 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.545+0000 7f604effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 0x7f6050105230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42638/0 (socket says 172.21.15.123:42638) 2024-05-06T13:54:24.368 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.545+0000 7f604effd700 1 -- 172.21.15.123:0/3341532514 learned_addr learned my addr 172.21.15.123:0/3341532514 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:24.368 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.545+0000 7f604effd700 1 -- 172.21.15.123:0/3341532514 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6050105770 con 0x7f6050104e10 2024-05-06T13:54:24.368 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.546+0000 7f604effd700 1 --2- 172.21.15.123:0/3341532514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 0x7f6050105230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f60440098a0 tx=0x7f6044009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8e0bd02f1c3253 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.546+0000 7f604dffb700 1 -- 172.21.15.123:0/3341532514 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6044004180 con 0x7f6050104e10 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.546+0000 7f604dffb700 1 -- 172.21.15.123:0/3341532514 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f60440042e0 con 0x7f6050104e10 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.546+0000 7f604dffb700 1 -- 172.21.15.123:0/3341532514 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6044011a50 con 0x7f6050104e10 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.546+0000 7f60552df700 1 -- 172.21.15.123:0/3341532514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 msgr2=0x7f6050105230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.546+0000 7f60552df700 1 --2- 172.21.15.123:0/3341532514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 0x7f6050105230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f60440098a0 tx=0x7f6044009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.546+0000 7f60552df700 1 -- 172.21.15.123:0/3341532514 shutdown_connections 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.546+0000 7f60552df700 1 --2- 172.21.15.123:0/3341532514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 0x7f6050105230 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.546+0000 7f60552df700 1 -- 172.21.15.123:0/3341532514 >> 172.21.15.123:0/3341532514 conn(0x7f60501009f0 msgr2=0x7f6050102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.546+0000 7f60552df700 1 -- 172.21.15.123:0/3341532514 shutdown_connections 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.546+0000 7f60552df700 1 -- 172.21.15.123:0/3341532514 wait complete. 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.547+0000 7f60552df700 1 Processor -- start 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.547+0000 7f60552df700 1 -- start start 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.547+0000 7f60552df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 0x7f605019c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:24.369 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.547+0000 7f60552df700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605019c8c0 con 0x7f6050104e10 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.547+0000 7f604effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 0x7f605019c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.548+0000 7f604effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 0x7f605019c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42654/0 (socket says 172.21.15.123:42654) 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.548+0000 7f604effd700 1 -- 172.21.15.123:0/3959375924 learned_addr learned my addr 172.21.15.123:0/3959375924 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.548+0000 7f604effd700 1 -- 172.21.15.123:0/3959375924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6044009550 con 0x7f6050104e10 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.548+0000 7f604effd700 1 --2- 172.21.15.123:0/3959375924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 0x7f605019c380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f60440119e0 tx=0x7f6044011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.548+0000 7f6037fff700 1 -- 172.21.15.123:0/3959375924 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6044003b90 con 0x7f6050104e10 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.548+0000 7f6037fff700 1 -- 172.21.15.123:0/3959375924 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f604401a8a0 con 0x7f6050104e10 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.548+0000 7f60552df700 1 -- 172.21.15.123:0/3959375924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605019cac0 con 0x7f6050104e10 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.548+0000 7f6037fff700 1 -- 172.21.15.123:0/3959375924 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6044019930 con 0x7f6050104e10 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.548+0000 7f60552df700 1 -- 172.21.15.123:0/3959375924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605019cf60 con 0x7f6050104e10 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.549+0000 7f6037fff700 1 -- 172.21.15.123:0/3959375924 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 45177+0+0 (secure 0 0 0) 0x7f6044019bf0 con 0x7f6050104e10 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.549+0000 7f6037fff700 1 --2- 172.21.15.123:0/3959375924 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f60380381c0 0x7f603803a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:24.370 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.549+0000 7f6037fff700 1 -- 172.21.15.123:0/3959375924 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f604404c550 con 0x7f6050104e10 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.549+0000 7f60552df700 1 -- 172.21.15.123:0/3959375924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6050195c30 con 0x7f6050104e10 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.549+0000 7f604e7fc700 1 --2- 172.21.15.123:0/3959375924 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f60380381c0 0x7f603803a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.550+0000 7f604e7fc700 1 --2- 172.21.15.123:0/3959375924 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f60380381c0 0x7f603803a680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6040006fd0 tx=0x7f6040006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.554+0000 7f6037fff700 1 -- 172.21.15.123:0/3959375924 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f604402d440 con 0x7f6050104e10 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.759+0000 7f60552df700 1 -- 172.21.15.123:0/3959375924 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f60500611d0 con 0x7f60380381c0 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.765+0000 7f6037fff700 1 -- 172.21.15.123:0/3959375924 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f60500611d0 con 0x7f60380381c0 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.767+0000 7f60552df700 1 -- 172.21.15.123:0/3959375924 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f60380381c0 msgr2=0x7f603803a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.767+0000 7f60552df700 1 --2- 172.21.15.123:0/3959375924 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f60380381c0 0x7f603803a680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6040006fd0 tx=0x7f6040006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.767+0000 7f60552df700 1 -- 172.21.15.123:0/3959375924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 msgr2=0x7f605019c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.767+0000 7f60552df700 1 --2- 172.21.15.123:0/3959375924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 0x7f605019c380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f60440119e0 tx=0x7f6044011ac0 comp rx=0 tx=0).stop 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.767+0000 7f60552df700 1 -- 172.21.15.123:0/3959375924 shutdown_connections 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.767+0000 7f60552df700 1 --2- 172.21.15.123:0/3959375924 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f60380381c0 0x7f603803a680 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.767+0000 7f60552df700 1 --2- 172.21.15.123:0/3959375924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6050104e10 0x7f605019c380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.767+0000 7f60552df700 1 -- 172.21.15.123:0/3959375924 >> 172.21.15.123:0/3959375924 conn(0x7f60501009f0 msgr2=0x7f60501909d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:24.371 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.767+0000 7f60552df700 1 -- 172.21.15.123:0/3959375924 shutdown_connections 2024-05-06T13:54:24.372 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:23.767+0000 7f60552df700 1 -- 172.21.15.123:0/3959375924 wait complete. 2024-05-06T13:54:24.944 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:24 smithi123 ceph-mon[27254]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:24.944 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:24 smithi123 ceph-mon[27254]: mgrmap e8: smithi123.vjztrj(active, since 2s) 2024-05-06T13:54:25.446 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-06T13:54:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.743+0000 7f7d130cf700 1 Processor -- start 2024-05-06T13:54:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.743+0000 7f7d130cf700 1 -- start start 2024-05-06T13:54:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.743+0000 7f7d130cf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 0x7f7d0c1069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.743+0000 7f7d130cf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c106f70 con 0x7f7d0c106580 2024-05-06T13:54:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.743+0000 7f7d10e6b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 0x7f7d0c1069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.743+0000 7f7d10e6b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 0x7f7d0c1069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42668/0 (socket says 172.21.15.123:42668) 2024-05-06T13:54:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.743+0000 7f7d10e6b700 1 -- 172.21.15.123:0/334297375 learned_addr learned my addr 172.21.15.123:0/334297375 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.743+0000 7f7d10e6b700 1 -- 172.21.15.123:0/334297375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c107780 con 0x7f7d0c106580 2024-05-06T13:54:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.743+0000 7f7d10e6b700 1 --2- 172.21.15.123:0/334297375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 0x7f7d0c1069a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009e80 tx=0x7f7d0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd1db6a2df1acf2 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.744+0000 7f7d0b7fe700 1 -- 172.21.15.123:0/334297375 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d0400e070 con 0x7f7d0c106580 2024-05-06T13:54:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.744+0000 7f7d0b7fe700 1 -- 172.21.15.123:0/334297375 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7d04003e90 con 0x7f7d0c106580 2024-05-06T13:54:25.447 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.744+0000 7f7d0b7fe700 1 -- 172.21.15.123:0/334297375 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d04004380 con 0x7f7d0c106580 2024-05-06T13:54:25.448 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.744+0000 7f7d130cf700 1 -- 172.21.15.123:0/334297375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 msgr2=0x7f7d0c1069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:25.448 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.744+0000 7f7d130cf700 1 --2- 172.21.15.123:0/334297375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 0x7f7d0c1069a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009e80 tx=0x7f7d0400b330 comp rx=0 tx=0).stop 2024-05-06T13:54:25.448 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.744+0000 7f7d130cf700 1 -- 172.21.15.123:0/334297375 shutdown_connections 2024-05-06T13:54:25.448 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.744+0000 7f7d130cf700 1 --2- 172.21.15.123:0/334297375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 0x7f7d0c1069a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:25.448 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.744+0000 7f7d130cf700 1 -- 172.21.15.123:0/334297375 >> 172.21.15.123:0/334297375 conn(0x7f7d0c101b00 msgr2=0x7f7d0c103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:25.448 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.744+0000 7f7d130cf700 1 -- 172.21.15.123:0/334297375 shutdown_connections 2024-05-06T13:54:25.448 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.744+0000 7f7d130cf700 1 -- 172.21.15.123:0/334297375 wait complete. 2024-05-06T13:54:25.448 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.745+0000 7f7d130cf700 1 Processor -- start 2024-05-06T13:54:25.448 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.745+0000 7f7d130cf700 1 -- start start 2024-05-06T13:54:25.448 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.745+0000 7f7d130cf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 0x7f7d0c19a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.745+0000 7f7d130cf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c19a760 con 0x7f7d0c106580 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.745+0000 7f7d10e6b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 0x7f7d0c19a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.745+0000 7f7d10e6b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 0x7f7d0c19a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42676/0 (socket says 172.21.15.123:42676) 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.745+0000 7f7d10e6b700 1 -- 172.21.15.123:0/2603173053 learned_addr learned my addr 172.21.15.123:0/2603173053 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.745+0000 7f7d10e6b700 1 -- 172.21.15.123:0/2603173053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d04009b30 con 0x7f7d0c106580 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.746+0000 7f7d10e6b700 1 --2- 172.21.15.123:0/2603173053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 0x7f7d0c19a220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400d010 tx=0x7f7d04004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.746+0000 7f7d09ffb700 1 -- 172.21.15.123:0/2603173053 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d0400e040 con 0x7f7d0c106580 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.746+0000 7f7d130cf700 1 -- 172.21.15.123:0/2603173053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c19a960 con 0x7f7d0c106580 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.746+0000 7f7d09ffb700 1 -- 172.21.15.123:0/2603173053 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7d04003c30 con 0x7f7d0c106580 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.746+0000 7f7d09ffb700 1 -- 172.21.15.123:0/2603173053 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d0401b790 con 0x7f7d0c106580 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.746+0000 7f7d130cf700 1 -- 172.21.15.123:0/2603173053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c19ae60 con 0x7f7d0c106580 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.747+0000 7f7d09ffb700 1 -- 172.21.15.123:0/2603173053 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f7d04019040 con 0x7f7d0c106580 2024-05-06T13:54:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.747+0000 7f7d130cf700 1 -- 172.21.15.123:0/2603173053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c0623c0 con 0x7f7d0c106580 2024-05-06T13:54:25.450 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.747+0000 7f7d09ffb700 1 --2- 172.21.15.123:0/2603173053 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f7cf80382e0 0x7f7cf803a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:25.450 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.747+0000 7f7d09ffb700 1 -- 172.21.15.123:0/2603173053 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7d0404bf70 con 0x7f7d0c106580 2024-05-06T13:54:25.450 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.747+0000 7f7d0bfff700 1 --2- 172.21.15.123:0/2603173053 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f7cf80382e0 0x7f7cf803a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:25.450 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.748+0000 7f7d0bfff700 1 --2- 172.21.15.123:0/2603173053 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f7cf80382e0 0x7f7cf803a7a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc006fd0 tx=0x7f7cfc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:25.450 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.752+0000 7f7d09ffb700 1 -- 172.21.15.123:0/2603173053 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7d0407f0e0 con 0x7f7d0c106580 2024-05-06T13:54:25.450 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.943+0000 7f7d130cf700 1 -- 172.21.15.123:0/2603173053 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d0c102fe0 con 0x7f7cf80382e0 2024-05-06T13:54:25.451 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.944+0000 7f7d09ffb700 1 -- 172.21.15.123:0/2603173053 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f7d0c102fe0 con 0x7f7cf80382e0 2024-05-06T13:54:25.451 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.946+0000 7f7d130cf700 1 -- 172.21.15.123:0/2603173053 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f7cf80382e0 msgr2=0x7f7cf803a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:25.451 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.946+0000 7f7d130cf700 1 --2- 172.21.15.123:0/2603173053 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f7cf80382e0 0x7f7cf803a7a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc006fd0 tx=0x7f7cfc006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:25.451 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.946+0000 7f7d130cf700 1 -- 172.21.15.123:0/2603173053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 msgr2=0x7f7d0c19a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:25.451 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.946+0000 7f7d130cf700 1 --2- 172.21.15.123:0/2603173053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 0x7f7d0c19a220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400d010 tx=0x7f7d04004430 comp rx=0 tx=0).stop 2024-05-06T13:54:25.451 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.946+0000 7f7d130cf700 1 -- 172.21.15.123:0/2603173053 shutdown_connections 2024-05-06T13:54:25.451 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.946+0000 7f7d130cf700 1 --2- 172.21.15.123:0/2603173053 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f7cf80382e0 0x7f7cf803a7a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:25.451 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.946+0000 7f7d130cf700 1 --2- 172.21.15.123:0/2603173053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d0c106580 0x7f7d0c19a220 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:25.451 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.946+0000 7f7d130cf700 1 -- 172.21.15.123:0/2603173053 >> 172.21.15.123:0/2603173053 conn(0x7f7d0c101b00 msgr2=0x7f7d0c1028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:25.452 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.946+0000 7f7d130cf700 1 -- 172.21.15.123:0/2603173053 shutdown_connections 2024-05-06T13:54:25.452 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:24.946+0000 7f7d130cf700 1 -- 172.21.15.123:0/2603173053 wait complete. 2024-05-06T13:54:25.452 INFO:teuthology.orchestra.run.smithi123.stdout:Generating ssh key... 2024-05-06T13:54:26.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:25 smithi123 ceph-mon[27254]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:27.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.888+0000 7f790e08d700 1 Processor -- start 2024-05-06T13:54:27.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.888+0000 7f790e08d700 1 -- start start 2024-05-06T13:54:27.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.888+0000 7f790e08d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 0x7f7908105890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:27.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.888+0000 7f790e08d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7908105e60 con 0x7f7908105470 2024-05-06T13:54:27.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.888+0000 7f79077fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 0x7f7908105890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:27.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.888+0000 7f79077fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 0x7f7908105890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42680/0 (socket says 172.21.15.123:42680) 2024-05-06T13:54:27.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.888+0000 7f79077fe700 1 -- 172.21.15.123:0/2251030348 learned_addr learned my addr 172.21.15.123:0/2251030348 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:27.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.888+0000 7f79077fe700 1 -- 172.21.15.123:0/2251030348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908106670 con 0x7f7908105470 2024-05-06T13:54:27.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.888+0000 7f79077fe700 1 --2- 172.21.15.123:0/2251030348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 0x7f7908105890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f78f800bb40 tx=0x7f78f800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44921f70989031c server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:27.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.889+0000 7f79067fc700 1 -- 172.21.15.123:0/2251030348 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78f800dc00 con 0x7f7908105470 2024-05-06T13:54:27.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.889+0000 7f79067fc700 1 -- 172.21.15.123:0/2251030348 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f78f80044a0 con 0x7f7908105470 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.889+0000 7f79067fc700 1 -- 172.21.15.123:0/2251030348 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78f8010470 con 0x7f7908105470 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.889+0000 7f790e08d700 1 -- 172.21.15.123:0/2251030348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 msgr2=0x7f7908105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.889+0000 7f790e08d700 1 --2- 172.21.15.123:0/2251030348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 0x7f7908105890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f78f800bb40 tx=0x7f78f800be50 comp rx=0 tx=0).stop 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.889+0000 7f790e08d700 1 -- 172.21.15.123:0/2251030348 shutdown_connections 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.889+0000 7f790e08d700 1 --2- 172.21.15.123:0/2251030348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 0x7f7908105890 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.889+0000 7f790e08d700 1 -- 172.21.15.123:0/2251030348 >> 172.21.15.123:0/2251030348 conn(0x7f79081009f0 msgr2=0x7f7908102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.889+0000 7f790e08d700 1 -- 172.21.15.123:0/2251030348 shutdown_connections 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.889+0000 7f790e08d700 1 -- 172.21.15.123:0/2251030348 wait complete. 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.890+0000 7f790e08d700 1 Processor -- start 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.890+0000 7f790e08d700 1 -- start start 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.890+0000 7f790e08d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 0x7f7908197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.890+0000 7f790e08d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79081984e0 con 0x7f7908105470 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.890+0000 7f79077fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 0x7f7908197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:27.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.890+0000 7f79077fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 0x7f7908197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42684/0 (socket says 172.21.15.123:42684) 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.890+0000 7f79077fe700 1 -- 172.21.15.123:0/1652229748 learned_addr learned my addr 172.21.15.123:0/1652229748 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.891+0000 7f79077fe700 1 -- 172.21.15.123:0/1652229748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f800b7f0 con 0x7f7908105470 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.891+0000 7f79077fe700 1 --2- 172.21.15.123:0/1652229748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 0x7f7908197fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f78f800b340 tx=0x7f78f8003fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.891+0000 7f7904ff9700 1 -- 172.21.15.123:0/1652229748 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78f801e070 con 0x7f7908105470 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.891+0000 7f7904ff9700 1 -- 172.21.15.123:0/1652229748 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f78f80104e0 con 0x7f7908105470 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.891+0000 7f790e08d700 1 -- 172.21.15.123:0/1652229748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79081986e0 con 0x7f7908105470 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.891+0000 7f7904ff9700 1 -- 172.21.15.123:0/1652229748 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78f80229a0 con 0x7f7908105470 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.891+0000 7f790e08d700 1 -- 172.21.15.123:0/1652229748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7908198b80 con 0x7f7908105470 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.892+0000 7f7904ff9700 1 -- 172.21.15.123:0/1652229748 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f78f802c440 con 0x7f7908105470 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.892+0000 7f790e08d700 1 -- 172.21.15.123:0/1652229748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7908191d00 con 0x7f7908105470 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.892+0000 7f7904ff9700 1 --2- 172.21.15.123:0/1652229748 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f78f00382d0 0x7f78f003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.892+0000 7f7904ff9700 1 -- 172.21.15.123:0/1652229748 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f78f804e9c0 con 0x7f7908105470 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.892+0000 7f7906ffd700 1 --2- 172.21.15.123:0/1652229748 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f78f00382d0 0x7f78f003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.892+0000 7f7906ffd700 1 --2- 172.21.15.123:0/1652229748 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f78f00382d0 0x7f78f003a790 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f78fc006fd0 tx=0x7f78fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:25.897+0000 7f7904ff9700 1 -- 172.21.15.123:0/1652229748 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f78f802a950 con 0x7f7908105470 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:26.086+0000 7f790e08d700 1 -- 172.21.15.123:0/1652229748 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f79080611d0 con 0x7f78f00382d0 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:26.435+0000 7f7904ff9700 1 -- 172.21.15.123:0/1652229748 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f79080611d0 con 0x7f78f00382d0 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:26.438+0000 7f790e08d700 1 -- 172.21.15.123:0/1652229748 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f78f00382d0 msgr2=0x7f78f003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:26.438+0000 7f790e08d700 1 --2- 172.21.15.123:0/1652229748 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f78f00382d0 0x7f78f003a790 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f78fc006fd0 tx=0x7f78fc006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:26.438+0000 7f790e08d700 1 -- 172.21.15.123:0/1652229748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 msgr2=0x7f7908197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:26.438+0000 7f790e08d700 1 --2- 172.21.15.123:0/1652229748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 0x7f7908197fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f78f800b340 tx=0x7f78f8003fa0 comp rx=0 tx=0).stop 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:26.438+0000 7f790e08d700 1 -- 172.21.15.123:0/1652229748 shutdown_connections 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:26.438+0000 7f790e08d700 1 --2- 172.21.15.123:0/1652229748 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f78f00382d0 0x7f78f003a790 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:26.438+0000 7f790e08d700 1 --2- 172.21.15.123:0/1652229748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7908105470 0x7f7908197fa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:26.438+0000 7f790e08d700 1 -- 172.21.15.123:0/1652229748 >> 172.21.15.123:0/1652229748 conn(0x7f79081009f0 msgr2=0x7f790818ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:26.438+0000 7f790e08d700 1 -- 172.21.15.123:0/1652229748 shutdown_connections 2024-05-06T13:54:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:26.438+0000 7f790e08d700 1 -- 172.21.15.123:0/1652229748 wait complete. 2024-05-06T13:54:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:27 smithi123 ceph-mon[27254]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:27 smithi123 ceph-mon[27254]: Generating ssh key... 2024-05-06T13:54:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:27 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:27 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:28.217 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLAeeOOrFTApeYIabkUxFTAFYPDQGkDuFmcd0O/7Ia9/Cj3piSf7bwNjx31ekG1imaPpzC4HhK08UTQhW3wTKLtNkwDs7ojCP/8Jtfa5QuyxD9J5MPLlgXtrQ30v3XvMXIcfW9XJzLwgFkzag7KRyN6N0WtYTkl5WiBX/sP0QHFTtFdf7mQZJjOiIXh8ckJImvnh6l6s55M5nsuixrNY5qMs9LDy3xTm99O0U4hGIm2fw/zCZ74b1Y+v4Qlas65n4d/Rl3ccCEVY/S5cjbvIkDUWO8e+VTiqWzuY7ctXcZoOkwo3wI5o86vwSu75KbZbR82BebP9+aS4l858Z5pwDNjAMLKAjvQ10Ehv/bCgRklXT7/Hc7pNrki/dPuhaH8MQrGMl6S2ghqIAlKUo33XHxxnP4ANY09USwjU6zxpnhRvY/8DZI1SkLMZQhIbx5AH7z+GB6TqRa32YMlj6mEiBH9GUtaU+k7QSINf1L/I46EHXBmLAg0khcFPt9MUMoySc= ceph-f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:54:28.217 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.440+0000 7fe8aae81700 1 Processor -- start 2024-05-06T13:54:28.217 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.440+0000 7fe8aae81700 1 -- start start 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.440+0000 7fe8aae81700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 0x7fe8a4109410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.440+0000 7fe8aae81700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a4074640 con 0x7fe8a4107020 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.441+0000 7fe8a8c1d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 0x7fe8a4109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.441+0000 7fe8a8c1d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 0x7fe8a4109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42698/0 (socket says 172.21.15.123:42698) 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.441+0000 7fe8a8c1d700 1 -- 172.21.15.123:0/1295042315 learned_addr learned my addr 172.21.15.123:0/1295042315 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.441+0000 7fe8a8c1d700 1 -- 172.21.15.123:0/1295042315 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a4109950 con 0x7fe8a4107020 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.441+0000 7fe8a8c1d700 1 --2- 172.21.15.123:0/1295042315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 0x7fe8a4109410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe8980098a0 tx=0x7fe898009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbd41ba4758e58c server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.441+0000 7fe8a37fe700 1 -- 172.21.15.123:0/1295042315 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe898004180 con 0x7fe8a4107020 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.441+0000 7fe8a37fe700 1 -- 172.21.15.123:0/1295042315 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe8980042e0 con 0x7fe8a4107020 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.441+0000 7fe8a37fe700 1 -- 172.21.15.123:0/1295042315 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe898011a50 con 0x7fe8a4107020 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.442+0000 7fe8aae81700 1 -- 172.21.15.123:0/1295042315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 msgr2=0x7fe8a4109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.442+0000 7fe8aae81700 1 --2- 172.21.15.123:0/1295042315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 0x7fe8a4109410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe8980098a0 tx=0x7fe898009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.442+0000 7fe8aae81700 1 -- 172.21.15.123:0/1295042315 shutdown_connections 2024-05-06T13:54:28.218 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.442+0000 7fe8aae81700 1 --2- 172.21.15.123:0/1295042315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 0x7fe8a4109410 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.442+0000 7fe8aae81700 1 -- 172.21.15.123:0/1295042315 >> 172.21.15.123:0/1295042315 conn(0x7fe8a41009f0 msgr2=0x7fe8a4102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.442+0000 7fe8aae81700 1 -- 172.21.15.123:0/1295042315 shutdown_connections 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.442+0000 7fe8aae81700 1 -- 172.21.15.123:0/1295042315 wait complete. 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.442+0000 7fe8aae81700 1 Processor -- start 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.442+0000 7fe8aae81700 1 -- start start 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.443+0000 7fe8aae81700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 0x7fe8a419a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.443+0000 7fe8aae81700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a419a680 con 0x7fe8a4107020 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.443+0000 7fe8a8c1d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 0x7fe8a419a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.443+0000 7fe8a8c1d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 0x7fe8a419a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42700/0 (socket says 172.21.15.123:42700) 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.443+0000 7fe8a8c1d700 1 -- 172.21.15.123:0/2513771502 learned_addr learned my addr 172.21.15.123:0/2513771502 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.443+0000 7fe8a8c1d700 1 -- 172.21.15.123:0/2513771502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe898009550 con 0x7fe8a4107020 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.443+0000 7fe8a8c1d700 1 --2- 172.21.15.123:0/2513771502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 0x7fe8a419a140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8980119e0 tx=0x7fe898011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.443+0000 7fe8a1ffb700 1 -- 172.21.15.123:0/2513771502 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe898003b90 con 0x7fe8a4107020 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.443+0000 7fe8a1ffb700 1 -- 172.21.15.123:0/2513771502 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe89801a8a0 con 0x7fe8a4107020 2024-05-06T13:54:28.219 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.443+0000 7fe8aae81700 1 -- 172.21.15.123:0/2513771502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a419a880 con 0x7fe8a4107020 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.443+0000 7fe8a1ffb700 1 -- 172.21.15.123:0/2513771502 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe898019930 con 0x7fe8a4107020 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.444+0000 7fe8aae81700 1 -- 172.21.15.123:0/2513771502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a419ad20 con 0x7fe8a4107020 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.444+0000 7fe8a1ffb700 1 -- 172.21.15.123:0/2513771502 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fe898019bf0 con 0x7fe8a4107020 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.445+0000 7fe8a1ffb700 1 --2- 172.21.15.123:0/2513771502 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fe8940382e0 0x7fe89403a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.445+0000 7fe8a1ffb700 1 -- 172.21.15.123:0/2513771502 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe89804c980 con 0x7fe8a4107020 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.445+0000 7fe8aae81700 1 -- 172.21.15.123:0/2513771502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a410a6a0 con 0x7fe8a4107020 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.445+0000 7fe8a3fff700 1 --2- 172.21.15.123:0/2513771502 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fe8940382e0 0x7fe89403a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.445+0000 7fe8a3fff700 1 --2- 172.21.15.123:0/2513771502 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fe8940382e0 0x7fe89403a7a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe890006fd0 tx=0x7fe890006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.449+0000 7fe8a1ffb700 1 -- 172.21.15.123:0/2513771502 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe89802d440 con 0x7fe8a4107020 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.638+0000 7fe8aae81700 1 -- 172.21.15.123:0/2513771502 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8a4101e50 con 0x7fe8940382e0 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.639+0000 7fe8a1ffb700 1 -- 172.21.15.123:0/2513771502 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fe8a4101e50 con 0x7fe8940382e0 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.641+0000 7fe8aae81700 1 -- 172.21.15.123:0/2513771502 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fe8940382e0 msgr2=0x7fe89403a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.641+0000 7fe8aae81700 1 --2- 172.21.15.123:0/2513771502 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fe8940382e0 0x7fe89403a7a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe890006fd0 tx=0x7fe890006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:28.220 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.641+0000 7fe8aae81700 1 -- 172.21.15.123:0/2513771502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 msgr2=0x7fe8a419a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:28.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.641+0000 7fe8aae81700 1 --2- 172.21.15.123:0/2513771502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 0x7fe8a419a140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8980119e0 tx=0x7fe898011ac0 comp rx=0 tx=0).stop 2024-05-06T13:54:28.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.641+0000 7fe8aae81700 1 -- 172.21.15.123:0/2513771502 shutdown_connections 2024-05-06T13:54:28.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.641+0000 7fe8aae81700 1 --2- 172.21.15.123:0/2513771502 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fe8940382e0 0x7fe89403a7a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:28.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.641+0000 7fe8aae81700 1 --2- 172.21.15.123:0/2513771502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a4107020 0x7fe8a419a140 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:28.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.641+0000 7fe8aae81700 1 -- 172.21.15.123:0/2513771502 >> 172.21.15.123:0/2513771502 conn(0x7fe8a41009f0 msgr2=0x7fe8a4101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:28.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.641+0000 7fe8aae81700 1 -- 172.21.15.123:0/2513771502 shutdown_connections 2024-05-06T13:54:28.221 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:27.641+0000 7fe8aae81700 1 -- 172.21.15.123:0/2513771502 wait complete. 2024-05-06T13:54:28.221 INFO:teuthology.orchestra.run.smithi123.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-06T13:54:28.221 INFO:teuthology.orchestra.run.smithi123.stdout:Adding key to root@localhost authorized_keys... 2024-05-06T13:54:28.221 INFO:teuthology.orchestra.run.smithi123.stdout:Adding host smithi123... 2024-05-06T13:54:28.828 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:28 smithi123 ceph-mon[27254]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:29.655 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:29 smithi123 ceph-mon[27254]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi123", "addr": "172.21.15.123", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:31.178 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:30 smithi123 ceph-mon[27254]: Deploying cephadm binary to smithi123 2024-05-06T13:54:31.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Added host 'smithi123' with addr '172.21.15.123' 2024-05-06T13:54:31.691 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.629+0000 7f5f8a2a0700 1 Processor -- start 2024-05-06T13:54:31.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.629+0000 7f5f8a2a0700 1 -- start start 2024-05-06T13:54:31.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.629+0000 7f5f8a2a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 0x7f5f8407a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:31.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.629+0000 7f5f8a2a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8407a8d0 con 0x7f5f8407bea0 2024-05-06T13:54:31.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.629+0000 7f5f83fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 0x7f5f8407a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:31.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.629+0000 7f5f83fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 0x7f5f8407a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51936/0 (socket says 172.21.15.123:51936) 2024-05-06T13:54:31.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.629+0000 7f5f83fff700 1 -- 172.21.15.123:0/838742627 learned_addr learned my addr 172.21.15.123:0/838742627 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:31.692 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.629+0000 7f5f83fff700 1 -- 172.21.15.123:0/838742627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8407aa10 con 0x7f5f8407bea0 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.630+0000 7f5f83fff700 1 --2- 172.21.15.123:0/838742627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 0x7f5f8407a300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f740098a0 tx=0x7f5f74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4c90d5f040c72f server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.630+0000 7f5f82ffd700 1 -- 172.21.15.123:0/838742627 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f74004180 con 0x7f5f8407bea0 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.630+0000 7f5f82ffd700 1 -- 172.21.15.123:0/838742627 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5f740042e0 con 0x7f5f8407bea0 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.630+0000 7f5f82ffd700 1 -- 172.21.15.123:0/838742627 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f74011a50 con 0x7f5f8407bea0 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.630+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/838742627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 msgr2=0x7f5f8407a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.630+0000 7f5f8a2a0700 1 --2- 172.21.15.123:0/838742627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 0x7f5f8407a300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f740098a0 tx=0x7f5f74009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.630+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/838742627 shutdown_connections 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.630+0000 7f5f8a2a0700 1 --2- 172.21.15.123:0/838742627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 0x7f5f8407a300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.630+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/838742627 >> 172.21.15.123:0/838742627 conn(0x7f5f84101b00 msgr2=0x7f5f84103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.630+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/838742627 shutdown_connections 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.630+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/838742627 wait complete. 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.631+0000 7f5f8a2a0700 1 Processor -- start 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.631+0000 7f5f8a2a0700 1 -- start start 2024-05-06T13:54:31.693 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.631+0000 7f5f8a2a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 0x7f5f8419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.631+0000 7f5f8a2a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8419c990 con 0x7f5f8407bea0 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.631+0000 7f5f83fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 0x7f5f8419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.631+0000 7f5f83fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 0x7f5f8419c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51950/0 (socket says 172.21.15.123:51950) 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.631+0000 7f5f83fff700 1 -- 172.21.15.123:0/3484892035 learned_addr learned my addr 172.21.15.123:0/3484892035 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.632+0000 7f5f83fff700 1 -- 172.21.15.123:0/3484892035 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74009550 con 0x7f5f8407bea0 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.632+0000 7f5f83fff700 1 --2- 172.21.15.123:0/3484892035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 0x7f5f8419c450 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009520 tx=0x7f5f74011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.632+0000 7f5f817fa700 1 -- 172.21.15.123:0/3484892035 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f74003a80 con 0x7f5f8407bea0 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.632+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/3484892035 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8419cb90 con 0x7f5f8407bea0 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.632+0000 7f5f817fa700 1 -- 172.21.15.123:0/3484892035 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5f74003be0 con 0x7f5f8407bea0 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.632+0000 7f5f817fa700 1 -- 172.21.15.123:0/3484892035 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f740197b0 con 0x7f5f8407bea0 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.632+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/3484892035 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8419d030 con 0x7f5f8407bea0 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.633+0000 7f5f817fa700 1 -- 172.21.15.123:0/3484892035 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f5f74019a70 con 0x7f5f8407bea0 2024-05-06T13:54:31.694 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.633+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/3484892035 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8410c8c0 con 0x7f5f8407bea0 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.633+0000 7f5f817fa700 1 --2- 172.21.15.123:0/3484892035 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5f6c0382d0 0x7f5f6c03a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.633+0000 7f5f817fa700 1 -- 172.21.15.123:0/3484892035 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5f7404c7b0 con 0x7f5f8407bea0 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.633+0000 7f5f837fe700 1 --2- 172.21.15.123:0/3484892035 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5f6c0382d0 0x7f5f6c03a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.633+0000 7f5f837fe700 1 --2- 172.21.15.123:0/3484892035 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5f6c0382d0 0x7f5f6c03a790 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5f78006fd0 tx=0x7f5f78006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.638+0000 7f5f817fa700 1 -- 172.21.15.123:0/3484892035 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5f7402b750 con 0x7f5f8407bea0 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:28.827+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/3484892035 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi123", "addr": "172.21.15.123", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f84103e70 con 0x7f5f6c0382d0 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:31.137+0000 7f5f817fa700 1 -- 172.21.15.123:0/3484892035 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5f84103e70 con 0x7f5f6c0382d0 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:31.139+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/3484892035 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5f6c0382d0 msgr2=0x7f5f6c03a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:31.139+0000 7f5f8a2a0700 1 --2- 172.21.15.123:0/3484892035 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5f6c0382d0 0x7f5f6c03a790 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5f78006fd0 tx=0x7f5f78006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:31.139+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/3484892035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 msgr2=0x7f5f8419c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:31.139+0000 7f5f8a2a0700 1 --2- 172.21.15.123:0/3484892035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 0x7f5f8419c450 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009520 tx=0x7f5f74011ab0 comp rx=0 tx=0).stop 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:31.139+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/3484892035 shutdown_connections 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:31.139+0000 7f5f8a2a0700 1 --2- 172.21.15.123:0/3484892035 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5f6c0382d0 0x7f5f6c03a790 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:31.695 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:31.139+0000 7f5f8a2a0700 1 --2- 172.21.15.123:0/3484892035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f8407bea0 0x7f5f8419c450 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:31.696 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:31.139+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/3484892035 >> 172.21.15.123:0/3484892035 conn(0x7f5f84101b00 msgr2=0x7f5f84103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:31.696 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:31.139+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/3484892035 shutdown_connections 2024-05-06T13:54:31.696 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:31.139+0000 7f5f8a2a0700 1 -- 172.21.15.123:0/3484892035 wait complete. 2024-05-06T13:54:31.696 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying mon service with default placement... 2024-05-06T13:54:32.334 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:32 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:32.335 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:32 smithi123 ceph-mon[27254]: Added host smithi123 2024-05-06T13:54:32.335 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:32 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:54:33.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:33 smithi123 ceph-mon[27254]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:33.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:33 smithi123 ceph-mon[27254]: Saving service mon spec with placement count:5 2024-05-06T13:54:33.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:33 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:33.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:33 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:33.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-06T13:54:33.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.078+0000 7f62c6eb7700 1 Processor -- start 2024-05-06T13:54:33.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.078+0000 7f62c6eb7700 1 -- start start 2024-05-06T13:54:33.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.078+0000 7f62c6eb7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 0x7f62c0109410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:33.712 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.078+0000 7f62c6eb7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c0079e50 con 0x7f62c0107020 2024-05-06T13:54:33.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.078+0000 7f62c4c53700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 0x7f62c0109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:33.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.078+0000 7f62c4c53700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 0x7f62c0109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51958/0 (socket says 172.21.15.123:51958) 2024-05-06T13:54:33.713 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.078+0000 7f62c4c53700 1 -- 172.21.15.123:0/1864139317 learned_addr learned my addr 172.21.15.123:0/1864139317 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:33.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.079+0000 7f62c4c53700 1 -- 172.21.15.123:0/1864139317 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c0109950 con 0x7f62c0107020 2024-05-06T13:54:33.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.079+0000 7f62c4c53700 1 --2- 172.21.15.123:0/1864139317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 0x7f62c0109410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62b40098a0 tx=0x7f62b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e8271cd5219d28 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:33.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.079+0000 7f62bf7fe700 1 -- 172.21.15.123:0/1864139317 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62b4004180 con 0x7f62c0107020 2024-05-06T13:54:33.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.079+0000 7f62bf7fe700 1 -- 172.21.15.123:0/1864139317 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f62b40042e0 con 0x7f62c0107020 2024-05-06T13:54:33.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.079+0000 7f62bf7fe700 1 -- 172.21.15.123:0/1864139317 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62b4011a00 con 0x7f62c0107020 2024-05-06T13:54:33.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.080+0000 7f62c6eb7700 1 -- 172.21.15.123:0/1864139317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 msgr2=0x7f62c0109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:33.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.080+0000 7f62c6eb7700 1 --2- 172.21.15.123:0/1864139317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 0x7f62c0109410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62b40098a0 tx=0x7f62b4009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:33.714 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.080+0000 7f62c6eb7700 1 -- 172.21.15.123:0/1864139317 shutdown_connections 2024-05-06T13:54:33.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.080+0000 7f62c6eb7700 1 --2- 172.21.15.123:0/1864139317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 0x7f62c0109410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:33.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.080+0000 7f62c6eb7700 1 -- 172.21.15.123:0/1864139317 >> 172.21.15.123:0/1864139317 conn(0x7f62c01009f0 msgr2=0x7f62c0102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:33.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.080+0000 7f62c6eb7700 1 -- 172.21.15.123:0/1864139317 shutdown_connections 2024-05-06T13:54:33.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.080+0000 7f62c6eb7700 1 -- 172.21.15.123:0/1864139317 wait complete. 2024-05-06T13:54:33.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.081+0000 7f62c6eb7700 1 Processor -- start 2024-05-06T13:54:33.715 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.081+0000 7f62c6eb7700 1 -- start start 2024-05-06T13:54:33.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.081+0000 7f62c6eb7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 0x7f62c019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:33.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.081+0000 7f62c6eb7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c019a6b0 con 0x7f62c0107020 2024-05-06T13:54:33.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.081+0000 7f62c4c53700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 0x7f62c019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:33.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.081+0000 7f62c4c53700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 0x7f62c019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51972/0 (socket says 172.21.15.123:51972) 2024-05-06T13:54:33.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.081+0000 7f62c4c53700 1 -- 172.21.15.123:0/730417865 learned_addr learned my addr 172.21.15.123:0/730417865 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:33.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.081+0000 7f62c4c53700 1 -- 172.21.15.123:0/730417865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4009550 con 0x7f62c0107020 2024-05-06T13:54:33.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.081+0000 7f62c4c53700 1 --2- 172.21.15.123:0/730417865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 0x7f62c019a170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62b4000c00 tx=0x7f62b4011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:33.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.082+0000 7f62bdffb700 1 -- 172.21.15.123:0/730417865 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62b4003b30 con 0x7f62c0107020 2024-05-06T13:54:33.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.082+0000 7f62bdffb700 1 -- 172.21.15.123:0/730417865 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f62b40248b0 con 0x7f62c0107020 2024-05-06T13:54:33.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.082+0000 7f62bdffb700 1 -- 172.21.15.123:0/730417865 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62b401a8f0 con 0x7f62c0107020 2024-05-06T13:54:33.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.082+0000 7f62c6eb7700 1 -- 172.21.15.123:0/730417865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c019a8b0 con 0x7f62c0107020 2024-05-06T13:54:33.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.082+0000 7f62c6eb7700 1 -- 172.21.15.123:0/730417865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c019ad50 con 0x7f62c0107020 2024-05-06T13:54:33.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.083+0000 7f62bdffb700 1 -- 172.21.15.123:0/730417865 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f62b401abb0 con 0x7f62c0107020 2024-05-06T13:54:33.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.083+0000 7f62c6eb7700 1 -- 172.21.15.123:0/730417865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c010a6a0 con 0x7f62c0107020 2024-05-06T13:54:33.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.083+0000 7f62bdffb700 1 --2- 172.21.15.123:0/730417865 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f62b0038320 0x7f62b003a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:33.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.083+0000 7f62bdffb700 1 -- 172.21.15.123:0/730417865 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f62b404c680 con 0x7f62c0107020 2024-05-06T13:54:33.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.083+0000 7f62bffff700 1 --2- 172.21.15.123:0/730417865 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f62b0038320 0x7f62b003a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:33.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.084+0000 7f62bffff700 1 --2- 172.21.15.123:0/730417865 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f62b0038320 0x7f62b003a7e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f62ac006fd0 tx=0x7f62ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:33.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.091+0000 7f62bdffb700 1 -- 172.21.15.123:0/730417865 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f62b401ae60 con 0x7f62c0107020 2024-05-06T13:54:33.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.297+0000 7f62c6eb7700 1 -- 172.21.15.123:0/730417865 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f62c0101e30 con 0x7f62b0038320 2024-05-06T13:54:33.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.301+0000 7f62bdffb700 1 -- 172.21.15.123:0/730417865 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f62c0101e30 con 0x7f62b0038320 2024-05-06T13:54:33.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.303+0000 7f62c6eb7700 1 -- 172.21.15.123:0/730417865 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f62b0038320 msgr2=0x7f62b003a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:33.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.303+0000 7f62c6eb7700 1 --2- 172.21.15.123:0/730417865 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f62b0038320 0x7f62b003a7e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f62ac006fd0 tx=0x7f62ac006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:33.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.303+0000 7f62c6eb7700 1 -- 172.21.15.123:0/730417865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 msgr2=0x7f62c019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:33.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.303+0000 7f62c6eb7700 1 --2- 172.21.15.123:0/730417865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 0x7f62c019a170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62b4000c00 tx=0x7f62b4011b20 comp rx=0 tx=0).stop 2024-05-06T13:54:33.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.303+0000 7f62c6eb7700 1 -- 172.21.15.123:0/730417865 shutdown_connections 2024-05-06T13:54:33.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.303+0000 7f62c6eb7700 1 --2- 172.21.15.123:0/730417865 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f62b0038320 0x7f62b003a7e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:33.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.303+0000 7f62c6eb7700 1 --2- 172.21.15.123:0/730417865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0107020 0x7f62c019a170 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:33.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.303+0000 7f62c6eb7700 1 -- 172.21.15.123:0/730417865 >> 172.21.15.123:0/730417865 conn(0x7f62c01009f0 msgr2=0x7f62c0101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:33.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.303+0000 7f62c6eb7700 1 -- 172.21.15.123:0/730417865 shutdown_connections 2024-05-06T13:54:33.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:32.303+0000 7f62c6eb7700 1 -- 172.21.15.123:0/730417865 wait complete. 2024-05-06T13:54:33.718 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying mgr service with default placement... 2024-05-06T13:54:34.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-06T13:54:34.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.137+0000 7f3e99ae2700 1 Processor -- start 2024-05-06T13:54:34.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.137+0000 7f3e99ae2700 1 -- start start 2024-05-06T13:54:34.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.138+0000 7f3e99ae2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 0x7f3e94105d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:34.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.138+0000 7f3e99ae2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e94106340 con 0x7f3e94105950 2024-05-06T13:54:34.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.138+0000 7f3e937fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 0x7f3e94105d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:34.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.138+0000 7f3e937fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 0x7f3e94105d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51986/0 (socket says 172.21.15.123:51986) 2024-05-06T13:54:34.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.138+0000 7f3e937fe700 1 -- 172.21.15.123:0/297962551 learned_addr learned my addr 172.21.15.123:0/297962551 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:34.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.138+0000 7f3e937fe700 1 -- 172.21.15.123:0/297962551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e94106670 con 0x7f3e94105950 2024-05-06T13:54:34.978 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.138+0000 7f3e937fe700 1 --2- 172.21.15.123:0/297962551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 0x7f3e94105d70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009e80 tx=0x7f3e8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ed2c6ab24b0a28 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.138+0000 7f3e927fc700 1 -- 172.21.15.123:0/297962551 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e8c00e070 con 0x7f3e94105950 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.138+0000 7f3e927fc700 1 -- 172.21.15.123:0/297962551 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3e8c00b8c0 con 0x7f3e94105950 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.138+0000 7f3e927fc700 1 -- 172.21.15.123:0/297962551 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e8c0044d0 con 0x7f3e94105950 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.139+0000 7f3e99ae2700 1 -- 172.21.15.123:0/297962551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 msgr2=0x7f3e94105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.139+0000 7f3e99ae2700 1 --2- 172.21.15.123:0/297962551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 0x7f3e94105d70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009e80 tx=0x7f3e8c00b330 comp rx=0 tx=0).stop 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.139+0000 7f3e99ae2700 1 -- 172.21.15.123:0/297962551 shutdown_connections 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.139+0000 7f3e99ae2700 1 --2- 172.21.15.123:0/297962551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 0x7f3e94105d70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.139+0000 7f3e99ae2700 1 -- 172.21.15.123:0/297962551 >> 172.21.15.123:0/297962551 conn(0x7f3e94100170 msgr2=0x7f3e941025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.139+0000 7f3e99ae2700 1 -- 172.21.15.123:0/297962551 shutdown_connections 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.139+0000 7f3e99ae2700 1 -- 172.21.15.123:0/297962551 wait complete. 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.140+0000 7f3e99ae2700 1 Processor -- start 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.140+0000 7f3e99ae2700 1 -- start start 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.140+0000 7f3e99ae2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 0x7f3e9419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:34.979 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.140+0000 7f3e99ae2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9419a6f0 con 0x7f3e94105950 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.140+0000 7f3e937fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 0x7f3e9419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.140+0000 7f3e937fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 0x7f3e9419a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51998/0 (socket says 172.21.15.123:51998) 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.140+0000 7f3e937fe700 1 -- 172.21.15.123:0/3901499087 learned_addr learned my addr 172.21.15.123:0/3901499087 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.140+0000 7f3e937fe700 1 -- 172.21.15.123:0/3901499087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c009b30 con 0x7f3e94105950 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.141+0000 7f3e937fe700 1 --2- 172.21.15.123:0/3901499087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 0x7f3e9419a1b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c000f80 tx=0x7f3e8c0049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.141+0000 7f3e90ff9700 1 -- 172.21.15.123:0/3901499087 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e8c00e040 con 0x7f3e94105950 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.141+0000 7f3e90ff9700 1 -- 172.21.15.123:0/3901499087 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3e8c00bd00 con 0x7f3e94105950 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.141+0000 7f3e99ae2700 1 -- 172.21.15.123:0/3901499087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9419a8f0 con 0x7f3e94105950 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.141+0000 7f3e90ff9700 1 -- 172.21.15.123:0/3901499087 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e8c012770 con 0x7f3e94105950 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.141+0000 7f3e99ae2700 1 -- 172.21.15.123:0/3901499087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9419adf0 con 0x7f3e94105950 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.142+0000 7f3e90ff9700 1 -- 172.21.15.123:0/3901499087 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f3e8c019040 con 0x7f3e94105950 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.142+0000 7f3e99ae2700 1 -- 172.21.15.123:0/3901499087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e940623c0 con 0x7f3e94105950 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.142+0000 7f3e90ff9700 1 --2- 172.21.15.123:0/3901499087 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f3e7c038320 0x7f3e7c03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.142+0000 7f3e90ff9700 1 -- 172.21.15.123:0/3901499087 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3e8c04bca0 con 0x7f3e94105950 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.142+0000 7f3e92ffd700 1 --2- 172.21.15.123:0/3901499087 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f3e7c038320 0x7f3e7c03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.142+0000 7f3e92ffd700 1 --2- 172.21.15.123:0/3901499087 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f3e7c038320 0x7f3e7c03a7e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3e88006fd0 tx=0x7f3e88006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.146+0000 7f3e90ff9700 1 -- 172.21.15.123:0/3901499087 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3e8c01a9e0 con 0x7f3e94105950 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.370+0000 7f3e99ae2700 1 -- 172.21.15.123:0/3901499087 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e94109870 con 0x7f3e7c038320 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.377+0000 7f3e90ff9700 1 -- 172.21.15.123:0/3901499087 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3e94109870 con 0x7f3e7c038320 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.379+0000 7f3e99ae2700 1 -- 172.21.15.123:0/3901499087 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f3e7c038320 msgr2=0x7f3e7c03a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.379+0000 7f3e99ae2700 1 --2- 172.21.15.123:0/3901499087 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f3e7c038320 0x7f3e7c03a7e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3e88006fd0 tx=0x7f3e88006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.379+0000 7f3e99ae2700 1 -- 172.21.15.123:0/3901499087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 msgr2=0x7f3e9419a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.379+0000 7f3e99ae2700 1 --2- 172.21.15.123:0/3901499087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 0x7f3e9419a1b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c000f80 tx=0x7f3e8c0049f0 comp rx=0 tx=0).stop 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.379+0000 7f3e99ae2700 1 -- 172.21.15.123:0/3901499087 shutdown_connections 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.379+0000 7f3e99ae2700 1 --2- 172.21.15.123:0/3901499087 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f3e7c038320 0x7f3e7c03a7e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.379+0000 7f3e99ae2700 1 --2- 172.21.15.123:0/3901499087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e94105950 0x7f3e9419a1b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.379+0000 7f3e99ae2700 1 -- 172.21.15.123:0/3901499087 >> 172.21.15.123:0/3901499087 conn(0x7f3e94100170 msgr2=0x7f3e94104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.379+0000 7f3e99ae2700 1 -- 172.21.15.123:0/3901499087 shutdown_connections 2024-05-06T13:54:34.981 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:34.379+0000 7f3e99ae2700 1 -- 172.21.15.123:0/3901499087 wait complete. 2024-05-06T13:54:34.982 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying crash service with default placement... 2024-05-06T13:54:35.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:35 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:35.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:35 smithi123 ceph-mon[27254]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:35.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:35 smithi123 ceph-mon[27254]: Saving service mgr spec with placement count:2 2024-05-06T13:54:35.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:35 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:36.770 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.389+0000 7f76ffd77700 1 Processor -- start 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.389+0000 7f76ffd77700 1 -- start start 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.390+0000 7f76ffd77700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 0x7f76f8105010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.390+0000 7f76ffd77700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f81055e0 con 0x7f76f8104bf0 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.390+0000 7f76fdb13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 0x7f76f8105010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.390+0000 7f76fdb13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 0x7f76f8105010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52014/0 (socket says 172.21.15.123:52014) 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.390+0000 7f76fdb13700 1 -- 172.21.15.123:0/103859891 learned_addr learned my addr 172.21.15.123:0/103859891 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.390+0000 7f76fdb13700 1 -- 172.21.15.123:0/103859891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f8105df0 con 0x7f76f8104bf0 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.390+0000 7f76fdb13700 1 --2- 172.21.15.123:0/103859891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 0x7f76f8105010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f76f400bb40 tx=0x7f76f400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745486a2e15613b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.390+0000 7f76fcb11700 1 -- 172.21.15.123:0/103859891 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76f400d9a0 con 0x7f76f8104bf0 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.390+0000 7f76fcb11700 1 -- 172.21.15.123:0/103859891 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f76f4004030 con 0x7f76f8104bf0 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.390+0000 7f76fcb11700 1 -- 172.21.15.123:0/103859891 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76f4003d00 con 0x7f76f8104bf0 2024-05-06T13:54:36.771 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.391+0000 7f76ffd77700 1 -- 172.21.15.123:0/103859891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 msgr2=0x7f76f8105010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.391+0000 7f76ffd77700 1 --2- 172.21.15.123:0/103859891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 0x7f76f8105010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f76f400bb40 tx=0x7f76f400be50 comp rx=0 tx=0).stop 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.391+0000 7f76ffd77700 1 -- 172.21.15.123:0/103859891 shutdown_connections 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.391+0000 7f76ffd77700 1 --2- 172.21.15.123:0/103859891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 0x7f76f8105010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.391+0000 7f76ffd77700 1 -- 172.21.15.123:0/103859891 >> 172.21.15.123:0/103859891 conn(0x7f76f8100190 msgr2=0x7f76f81025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.391+0000 7f76ffd77700 1 -- 172.21.15.123:0/103859891 shutdown_connections 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.391+0000 7f76ffd77700 1 -- 172.21.15.123:0/103859891 wait complete. 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76ffd77700 1 Processor -- start 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76ffd77700 1 -- start start 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76ffd77700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 0x7f76f8198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76ffd77700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8198590 con 0x7f76f8104bf0 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76fdb13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 0x7f76f8198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76fdb13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 0x7f76f8198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52022/0 (socket says 172.21.15.123:52022) 2024-05-06T13:54:36.772 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76fdb13700 1 -- 172.21.15.123:0/1388542990 learned_addr learned my addr 172.21.15.123:0/1388542990 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76fdb13700 1 -- 172.21.15.123:0/1388542990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f400b7f0 con 0x7f76f8104bf0 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76fdb13700 1 --2- 172.21.15.123:0/1388542990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 0x7f76f8198050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f76f400df40 tx=0x7f76f40037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76eeffd700 1 -- 172.21.15.123:0/1388542990 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76f40045d0 con 0x7f76f8104bf0 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76eeffd700 1 -- 172.21.15.123:0/1388542990 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f76f4017960 con 0x7f76f8104bf0 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76ffd77700 1 -- 172.21.15.123:0/1388542990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f8198790 con 0x7f76f8104bf0 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76eeffd700 1 -- 172.21.15.123:0/1388542990 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76f4021790 con 0x7f76f8104bf0 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.392+0000 7f76ffd77700 1 -- 172.21.15.123:0/1388542990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f8198c30 con 0x7f76f8104bf0 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.393+0000 7f76eeffd700 1 -- 172.21.15.123:0/1388542990 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f76f4015070 con 0x7f76f8104bf0 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.393+0000 7f76ffd77700 1 -- 172.21.15.123:0/1388542990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f81918e0 con 0x7f76f8104bf0 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.393+0000 7f76eeffd700 1 --2- 172.21.15.123:0/1388542990 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f76e4038320 0x7f76e403a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.393+0000 7f76eeffd700 1 -- 172.21.15.123:0/1388542990 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f76f401c070 con 0x7f76f8104bf0 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.394+0000 7f76fd312700 1 --2- 172.21.15.123:0/1388542990 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f76e4038320 0x7f76e403a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.394+0000 7f76fd312700 1 --2- 172.21.15.123:0/1388542990 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f76e4038320 0x7f76e403a7e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f76e8006fd0 tx=0x7f76e8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:36.773 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.398+0000 7f76eeffd700 1 -- 172.21.15.123:0/1388542990 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f76f4017ad0 con 0x7f76f8104bf0 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.611+0000 7f76ffd77700 1 -- 172.21.15.123:0/1388542990 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f76f80611d0 con 0x7f76e4038320 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.615+0000 7f76eeffd700 1 -- 172.21.15.123:0/1388542990 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f76f80611d0 con 0x7f76e4038320 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.617+0000 7f76ffd77700 1 -- 172.21.15.123:0/1388542990 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f76e4038320 msgr2=0x7f76e403a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.617+0000 7f76ffd77700 1 --2- 172.21.15.123:0/1388542990 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f76e4038320 0x7f76e403a7e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f76e8006fd0 tx=0x7f76e8006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.617+0000 7f76ffd77700 1 -- 172.21.15.123:0/1388542990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 msgr2=0x7f76f8198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.617+0000 7f76ffd77700 1 --2- 172.21.15.123:0/1388542990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 0x7f76f8198050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f76f400df40 tx=0x7f76f40037c0 comp rx=0 tx=0).stop 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.617+0000 7f76ffd77700 1 -- 172.21.15.123:0/1388542990 shutdown_connections 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.617+0000 7f76ffd77700 1 --2- 172.21.15.123:0/1388542990 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f76e4038320 0x7f76e403a7e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.617+0000 7f76ffd77700 1 --2- 172.21.15.123:0/1388542990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76f8104bf0 0x7f76f8198050 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.617+0000 7f76ffd77700 1 -- 172.21.15.123:0/1388542990 >> 172.21.15.123:0/1388542990 conn(0x7f76f8100190 msgr2=0x7f76f818c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.617+0000 7f76ffd77700 1 -- 172.21.15.123:0/1388542990 shutdown_connections 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:35.617+0000 7f76ffd77700 1 -- 172.21.15.123:0/1388542990 wait complete. 2024-05-06T13:54:36.774 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying ceph-exporter service with default placement... 2024-05-06T13:54:36.785 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:36 smithi123 ceph-mon[27254]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:36.785 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:36 smithi123 ceph-mon[27254]: Saving service crash spec with placement * 2024-05-06T13:54:36.785 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:36 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:36.785 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:36 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:38.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-05-06T13:54:38.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.201+0000 7f7ed4157700 1 Processor -- start 2024-05-06T13:54:38.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.201+0000 7f7ed4157700 1 -- start start 2024-05-06T13:54:38.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.202+0000 7f7ed4157700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 0x7f7ecc07a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:38.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.202+0000 7f7ed4157700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc07a890 con 0x7f7ecc07be60 2024-05-06T13:54:38.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.202+0000 7f7ed1ef3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 0x7f7ecc07a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:38.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.202+0000 7f7ed1ef3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 0x7f7ecc07a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52038/0 (socket says 172.21.15.123:52038) 2024-05-06T13:54:38.078 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.202+0000 7f7ed1ef3700 1 -- 172.21.15.123:0/2889110625 learned_addr learned my addr 172.21.15.123:0/2889110625 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.202+0000 7f7ed1ef3700 1 -- 172.21.15.123:0/2889110625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc07a9d0 con 0x7f7ecc07be60 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.202+0000 7f7ed1ef3700 1 --2- 172.21.15.123:0/2889110625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 0x7f7ecc07a2c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80098a0 tx=0x7f7ec8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13580327a145d98 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.203+0000 7f7ed0ef1700 1 -- 172.21.15.123:0/2889110625 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ec8004180 con 0x7f7ecc07be60 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.203+0000 7f7ed0ef1700 1 -- 172.21.15.123:0/2889110625 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7ec80042e0 con 0x7f7ecc07be60 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.203+0000 7f7ed0ef1700 1 -- 172.21.15.123:0/2889110625 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ec8011af0 con 0x7f7ecc07be60 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.203+0000 7f7ed4157700 1 -- 172.21.15.123:0/2889110625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 msgr2=0x7f7ecc07a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.203+0000 7f7ed4157700 1 --2- 172.21.15.123:0/2889110625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 0x7f7ecc07a2c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80098a0 tx=0x7f7ec8009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.203+0000 7f7ed4157700 1 -- 172.21.15.123:0/2889110625 shutdown_connections 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.203+0000 7f7ed4157700 1 --2- 172.21.15.123:0/2889110625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 0x7f7ecc07a2c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.203+0000 7f7ed4157700 1 -- 172.21.15.123:0/2889110625 >> 172.21.15.123:0/2889110625 conn(0x7f7ecc101b40 msgr2=0x7f7ecc103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.204+0000 7f7ed4157700 1 -- 172.21.15.123:0/2889110625 shutdown_connections 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.204+0000 7f7ed4157700 1 -- 172.21.15.123:0/2889110625 wait complete. 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.204+0000 7f7ed4157700 1 Processor -- start 2024-05-06T13:54:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.204+0000 7f7ed4157700 1 -- start start 2024-05-06T13:54:38.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.204+0000 7f7ed4157700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 0x7f7ecc19c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:38.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.204+0000 7f7ed4157700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc19c8f0 con 0x7f7ecc07be60 2024-05-06T13:54:38.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.204+0000 7f7ed1ef3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 0x7f7ecc19c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:38.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.205+0000 7f7ed1ef3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 0x7f7ecc19c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52050/0 (socket says 172.21.15.123:52050) 2024-05-06T13:54:38.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.205+0000 7f7ed1ef3700 1 -- 172.21.15.123:0/3517143428 learned_addr learned my addr 172.21.15.123:0/3517143428 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:38.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.205+0000 7f7ed1ef3700 1 -- 172.21.15.123:0/3517143428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec8009550 con 0x7f7ecc07be60 2024-05-06T13:54:38.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.205+0000 7f7ed1ef3700 1 --2- 172.21.15.123:0/3517143428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 0x7f7ecc19c3b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8006ba0 tx=0x7f7ec8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:38.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.205+0000 7f7ec2ffd700 1 -- 172.21.15.123:0/3517143428 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ec8003b00 con 0x7f7ecc07be60 2024-05-06T13:54:38.080 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.205+0000 7f7ed4157700 1 -- 172.21.15.123:0/3517143428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc19caf0 con 0x7f7ecc07be60 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.205+0000 7f7ec2ffd700 1 -- 172.21.15.123:0/3517143428 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7ec801a8e0 con 0x7f7ecc07be60 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.205+0000 7f7ec2ffd700 1 -- 172.21.15.123:0/3517143428 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ec80199c0 con 0x7f7ecc07be60 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.205+0000 7f7ed4157700 1 -- 172.21.15.123:0/3517143428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc19cf90 con 0x7f7ecc07be60 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.206+0000 7f7ed4157700 1 -- 172.21.15.123:0/3517143428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc10c940 con 0x7f7ecc07be60 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.206+0000 7f7ec2ffd700 1 -- 172.21.15.123:0/3517143428 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f7ec8019c80 con 0x7f7ecc07be60 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.207+0000 7f7ec2ffd700 1 --2- 172.21.15.123:0/3517143428 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f7eb80382d0 0x7f7eb803a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.207+0000 7f7ec2ffd700 1 -- 172.21.15.123:0/3517143428 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7ec804c5b0 con 0x7f7ecc07be60 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.207+0000 7f7ed16f2700 1 --2- 172.21.15.123:0/3517143428 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f7eb80382d0 0x7f7eb803a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.208+0000 7f7ed16f2700 1 --2- 172.21.15.123:0/3517143428 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f7eb80382d0 0x7f7eb803a790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc006fd0 tx=0x7f7ebc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.211+0000 7f7ec2ffd700 1 -- 172.21.15.123:0/3517143428 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7ec802d440 con 0x7f7ecc07be60 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.441+0000 7f7ed4157700 1 -- 172.21.15.123:0/3517143428 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ecc102fb0 con 0x7f7eb80382d0 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.446+0000 7f7ec2ffd700 1 -- 172.21.15.123:0/3517143428 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f7ecc102fb0 con 0x7f7eb80382d0 2024-05-06T13:54:38.081 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.448+0000 7f7ed4157700 1 -- 172.21.15.123:0/3517143428 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f7eb80382d0 msgr2=0x7f7eb803a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:38.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.448+0000 7f7ed4157700 1 --2- 172.21.15.123:0/3517143428 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f7eb80382d0 0x7f7eb803a790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc006fd0 tx=0x7f7ebc006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:38.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.448+0000 7f7ed4157700 1 -- 172.21.15.123:0/3517143428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 msgr2=0x7f7ecc19c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:38.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.448+0000 7f7ed4157700 1 --2- 172.21.15.123:0/3517143428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 0x7f7ecc19c3b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8006ba0 tx=0x7f7ec8011b50 comp rx=0 tx=0).stop 2024-05-06T13:54:38.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.449+0000 7f7ed4157700 1 -- 172.21.15.123:0/3517143428 shutdown_connections 2024-05-06T13:54:38.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.449+0000 7f7ed4157700 1 --2- 172.21.15.123:0/3517143428 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f7eb80382d0 0x7f7eb803a790 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:38.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.449+0000 7f7ed4157700 1 --2- 172.21.15.123:0/3517143428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ecc07be60 0x7f7ecc19c3b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:38.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.449+0000 7f7ed4157700 1 -- 172.21.15.123:0/3517143428 >> 172.21.15.123:0/3517143428 conn(0x7f7ecc101b40 msgr2=0x7f7ecc1028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:38.082 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.449+0000 7f7ed4157700 1 -- 172.21.15.123:0/3517143428 shutdown_connections 2024-05-06T13:54:38.083 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:37.449+0000 7f7ed4157700 1 -- 172.21.15.123:0/3517143428 wait complete. 2024-05-06T13:54:38.083 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying prometheus service with default placement... 2024-05-06T13:54:38.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:38 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:38.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:38 smithi123 ceph-mon[27254]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:38.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:38 smithi123 ceph-mon[27254]: Saving service ceph-exporter spec with placement * 2024-05-06T13:54:38.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:38 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:40.098 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:39 smithi123 ceph-mon[27254]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:40.099 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:39 smithi123 ceph-mon[27254]: Saving service prometheus spec with placement count:1 2024-05-06T13:54:40.099 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:39 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:40.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.499+0000 7fd2b3252700 1 Processor -- start 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.499+0000 7fd2b3252700 1 -- start start 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.499+0000 7fd2b3252700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 0x7fd2ac1069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.499+0000 7fd2b3252700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac106f70 con 0x7fd2ac106580 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.499+0000 7fd2b0fee700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 0x7fd2ac1069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.499+0000 7fd2b0fee700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 0x7fd2ac1069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48240/0 (socket says 172.21.15.123:48240) 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.499+0000 7fd2b0fee700 1 -- 172.21.15.123:0/338916348 learned_addr learned my addr 172.21.15.123:0/338916348 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.500+0000 7fd2b0fee700 1 -- 172.21.15.123:0/338916348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac107780 con 0x7fd2ac106580 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.500+0000 7fd2b0fee700 1 --2- 172.21.15.123:0/338916348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 0x7fd2ac1069a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00098a0 tx=0x7fd2a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329f8b74c67be60c server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.500+0000 7fd2ab7fe700 1 -- 172.21.15.123:0/338916348 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2a0004180 con 0x7fd2ac106580 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.500+0000 7fd2ab7fe700 1 -- 172.21.15.123:0/338916348 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd2a00042e0 con 0x7fd2ac106580 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.500+0000 7fd2ab7fe700 1 -- 172.21.15.123:0/338916348 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2a0011af0 con 0x7fd2ac106580 2024-05-06T13:54:40.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.501+0000 7fd2b3252700 1 -- 172.21.15.123:0/338916348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 msgr2=0x7fd2ac1069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.501+0000 7fd2b3252700 1 --2- 172.21.15.123:0/338916348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 0x7fd2ac1069a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00098a0 tx=0x7fd2a0009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.501+0000 7fd2b3252700 1 -- 172.21.15.123:0/338916348 shutdown_connections 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.501+0000 7fd2b3252700 1 --2- 172.21.15.123:0/338916348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 0x7fd2ac1069a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.501+0000 7fd2b3252700 1 -- 172.21.15.123:0/338916348 >> 172.21.15.123:0/338916348 conn(0x7fd2ac101b00 msgr2=0x7fd2ac103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.501+0000 7fd2b3252700 1 -- 172.21.15.123:0/338916348 shutdown_connections 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.501+0000 7fd2b3252700 1 -- 172.21.15.123:0/338916348 wait complete. 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.501+0000 7fd2b3252700 1 Processor -- start 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.501+0000 7fd2b3252700 1 -- start start 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.501+0000 7fd2b3252700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 0x7fd2ac07bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.501+0000 7fd2b3252700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac07c170 con 0x7fd2ac106580 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.501+0000 7fd2b0fee700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 0x7fd2ac07bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.502+0000 7fd2b0fee700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 0x7fd2ac07bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48252/0 (socket says 172.21.15.123:48252) 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.502+0000 7fd2b0fee700 1 -- 172.21.15.123:0/1753406155 learned_addr learned my addr 172.21.15.123:0/1753406155 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:40.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.502+0000 7fd2b0fee700 1 -- 172.21.15.123:0/1753406155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a0009550 con 0x7fd2ac106580 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.502+0000 7fd2b0fee700 1 --2- 172.21.15.123:0/1753406155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 0x7fd2ac07bc30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0011670 tx=0x7fd2a0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.502+0000 7fd2a9ffb700 1 -- 172.21.15.123:0/1753406155 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2a00039c0 con 0x7fd2ac106580 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.502+0000 7fd2a9ffb700 1 -- 172.21.15.123:0/1753406155 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd2a0003b20 con 0x7fd2ac106580 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.502+0000 7fd2b3252700 1 -- 172.21.15.123:0/1753406155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ac07a280 con 0x7fd2ac106580 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.502+0000 7fd2a9ffb700 1 -- 172.21.15.123:0/1753406155 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2a00247f0 con 0x7fd2ac106580 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.502+0000 7fd2b3252700 1 -- 172.21.15.123:0/1753406155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ac07a720 con 0x7fd2ac106580 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.503+0000 7fd2a9ffb700 1 -- 172.21.15.123:0/1753406155 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fd2a001ac70 con 0x7fd2ac106580 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.503+0000 7fd2b3252700 1 -- 172.21.15.123:0/1753406155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ac0623c0 con 0x7fd2ac106580 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.503+0000 7fd2a9ffb700 1 --2- 172.21.15.123:0/1753406155 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fd29c0382e0 0x7fd29c03a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.503+0000 7fd2a9ffb700 1 -- 172.21.15.123:0/1753406155 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd2a004c290 con 0x7fd2ac106580 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.503+0000 7fd2abfff700 1 --2- 172.21.15.123:0/1753406155 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fd29c0382e0 0x7fd29c03a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.504+0000 7fd2abfff700 1 --2- 172.21.15.123:0/1753406155 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fd29c0382e0 0x7fd29c03a7a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd298006fd0 tx=0x7fd298006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.508+0000 7fd2a9ffb700 1 -- 172.21.15.123:0/1753406155 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd2a0018760 con 0x7fd2ac106580 2024-05-06T13:54:40.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.720+0000 7fd2b3252700 1 -- 172.21.15.123:0/1753406155 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2ac10a980 con 0x7fd29c0382e0 2024-05-06T13:54:40.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.725+0000 7fd2a9ffb700 1 -- 172.21.15.123:0/1753406155 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fd2ac10a980 con 0x7fd29c0382e0 2024-05-06T13:54:40.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.727+0000 7fd2b3252700 1 -- 172.21.15.123:0/1753406155 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fd29c0382e0 msgr2=0x7fd29c03a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:40.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.727+0000 7fd2b3252700 1 --2- 172.21.15.123:0/1753406155 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fd29c0382e0 0x7fd29c03a7a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd298006fd0 tx=0x7fd298006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:40.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.727+0000 7fd2b3252700 1 -- 172.21.15.123:0/1753406155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 msgr2=0x7fd2ac07bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:40.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.727+0000 7fd2b3252700 1 --2- 172.21.15.123:0/1753406155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 0x7fd2ac07bc30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0011670 tx=0x7fd2a0011aa0 comp rx=0 tx=0).stop 2024-05-06T13:54:40.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.728+0000 7fd2b3252700 1 -- 172.21.15.123:0/1753406155 shutdown_connections 2024-05-06T13:54:40.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.728+0000 7fd2b3252700 1 --2- 172.21.15.123:0/1753406155 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fd29c0382e0 0x7fd29c03a7a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:40.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.728+0000 7fd2b3252700 1 --2- 172.21.15.123:0/1753406155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2ac106580 0x7fd2ac07bc30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:40.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.728+0000 7fd2b3252700 1 -- 172.21.15.123:0/1753406155 >> 172.21.15.123:0/1753406155 conn(0x7fd2ac101b00 msgr2=0x7fd2ac1031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:40.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.728+0000 7fd2b3252700 1 -- 172.21.15.123:0/1753406155 shutdown_connections 2024-05-06T13:54:40.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:38.728+0000 7fd2b3252700 1 -- 172.21.15.123:0/1753406155 wait complete. 2024-05-06T13:54:40.111 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying grafana service with default placement... 2024-05-06T13:54:41.338 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-05-06T13:54:41.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.547+0000 7f17d6367700 1 Processor -- start 2024-05-06T13:54:41.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.547+0000 7f17d6367700 1 -- start start 2024-05-06T13:54:41.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.548+0000 7f17d6367700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 0x7f17d01093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:41.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.548+0000 7f17d6367700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d0079e30 con 0x7f17d0106fc0 2024-05-06T13:54:41.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.548+0000 7f17cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 0x7f17d01093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:41.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.548+0000 7f17cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 0x7f17d01093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48266/0 (socket says 172.21.15.123:48266) 2024-05-06T13:54:41.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.548+0000 7f17cffff700 1 -- 172.21.15.123:0/4250878463 learned_addr learned my addr 172.21.15.123:0/4250878463 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:41.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.548+0000 7f17cffff700 1 -- 172.21.15.123:0/4250878463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d01098f0 con 0x7f17d0106fc0 2024-05-06T13:54:41.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.548+0000 7f17cffff700 1 --2- 172.21.15.123:0/4250878463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 0x7f17d01093b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17c00098a0 tx=0x7f17c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc294f91c7ac2886 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:41.339 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.548+0000 7f17ceffd700 1 -- 172.21.15.123:0/4250878463 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17c0004180 con 0x7f17d0106fc0 2024-05-06T13:54:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.548+0000 7f17ceffd700 1 -- 172.21.15.123:0/4250878463 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17c00042e0 con 0x7f17d0106fc0 2024-05-06T13:54:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.548+0000 7f17ceffd700 1 -- 172.21.15.123:0/4250878463 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17c0011af0 con 0x7f17d0106fc0 2024-05-06T13:54:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.549+0000 7f17d6367700 1 -- 172.21.15.123:0/4250878463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 msgr2=0x7f17d01093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.549+0000 7f17d6367700 1 --2- 172.21.15.123:0/4250878463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 0x7f17d01093b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17c00098a0 tx=0x7f17c0009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.549+0000 7f17d6367700 1 -- 172.21.15.123:0/4250878463 shutdown_connections 2024-05-06T13:54:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.549+0000 7f17d6367700 1 --2- 172.21.15.123:0/4250878463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 0x7f17d01093b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.549+0000 7f17d6367700 1 -- 172.21.15.123:0/4250878463 >> 172.21.15.123:0/4250878463 conn(0x7f17d0100970 msgr2=0x7f17d0102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.549+0000 7f17d6367700 1 -- 172.21.15.123:0/4250878463 shutdown_connections 2024-05-06T13:54:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.549+0000 7f17d6367700 1 -- 172.21.15.123:0/4250878463 wait complete. 2024-05-06T13:54:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.550+0000 7f17d6367700 1 Processor -- start 2024-05-06T13:54:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.550+0000 7f17d6367700 1 -- start start 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.550+0000 7f17d6367700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 0x7f17d0106920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.550+0000 7f17d6367700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d0106e60 con 0x7f17d0106fc0 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.550+0000 7f17cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 0x7f17d0106920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.550+0000 7f17cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 0x7f17d0106920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48278/0 (socket says 172.21.15.123:48278) 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.550+0000 7f17cffff700 1 -- 172.21.15.123:0/816530553 learned_addr learned my addr 172.21.15.123:0/816530553 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.550+0000 7f17cffff700 1 -- 172.21.15.123:0/816530553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0009550 con 0x7f17d0106fc0 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.550+0000 7f17cffff700 1 --2- 172.21.15.123:0/816530553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 0x7f17d0106920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17c0011670 tx=0x7f17c0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.551+0000 7f17cd7fa700 1 -- 172.21.15.123:0/816530553 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17c0003a40 con 0x7f17d0106fc0 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.551+0000 7f17cd7fa700 1 -- 172.21.15.123:0/816530553 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17c0003ba0 con 0x7f17d0106fc0 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.551+0000 7f17d6367700 1 -- 172.21.15.123:0/816530553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d0104f70 con 0x7f17d0106fc0 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.551+0000 7f17cd7fa700 1 -- 172.21.15.123:0/816530553 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17c0024790 con 0x7f17d0106fc0 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.551+0000 7f17d6367700 1 -- 172.21.15.123:0/816530553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d0105410 con 0x7f17d0106fc0 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.552+0000 7f17cd7fa700 1 -- 172.21.15.123:0/816530553 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f17c001a430 con 0x7f17d0106fc0 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.552+0000 7f17d6367700 1 -- 172.21.15.123:0/816530553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d0062430 con 0x7f17d0106fc0 2024-05-06T13:54:41.341 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.552+0000 7f17cd7fa700 1 --2- 172.21.15.123:0/816530553 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f17b8038370 0x7f17b803a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:41.342 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.552+0000 7f17cd7fa700 1 -- 172.21.15.123:0/816530553 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f17c004c450 con 0x7f17d0106fc0 2024-05-06T13:54:41.342 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.552+0000 7f17cf7fe700 1 --2- 172.21.15.123:0/816530553 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f17b8038370 0x7f17b803a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:41.342 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.552+0000 7f17cf7fe700 1 --2- 172.21.15.123:0/816530553 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f17b8038370 0x7f17b803a830 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f17c4006fd0 tx=0x7f17c4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:41.342 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.557+0000 7f17cd7fa700 1 -- 172.21.15.123:0/816530553 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f17d0062430 con 0x7f17d0106fc0 2024-05-06T13:54:41.342 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.756+0000 7f17d6367700 1 -- 172.21.15.123:0/816530553 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f17d00623c0 con 0x7f17b8038370 2024-05-06T13:54:41.342 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.761+0000 7f17cd7fa700 1 -- 172.21.15.123:0/816530553 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f17d00623c0 con 0x7f17b8038370 2024-05-06T13:54:41.342 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.763+0000 7f17d6367700 1 -- 172.21.15.123:0/816530553 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f17b8038370 msgr2=0x7f17b803a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:41.342 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.763+0000 7f17d6367700 1 --2- 172.21.15.123:0/816530553 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f17b8038370 0x7f17b803a830 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f17c4006fd0 tx=0x7f17c4006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:41.343 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.763+0000 7f17d6367700 1 -- 172.21.15.123:0/816530553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 msgr2=0x7f17d0106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:41.343 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.763+0000 7f17d6367700 1 --2- 172.21.15.123:0/816530553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 0x7f17d0106920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17c0011670 tx=0x7f17c0011b50 comp rx=0 tx=0).stop 2024-05-06T13:54:41.343 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.763+0000 7f17d6367700 1 -- 172.21.15.123:0/816530553 shutdown_connections 2024-05-06T13:54:41.343 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.763+0000 7f17d6367700 1 --2- 172.21.15.123:0/816530553 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f17b8038370 0x7f17b803a830 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:41.343 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.763+0000 7f17d6367700 1 --2- 172.21.15.123:0/816530553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0106fc0 0x7f17d0106920 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:41.343 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.763+0000 7f17d6367700 1 -- 172.21.15.123:0/816530553 >> 172.21.15.123:0/816530553 conn(0x7f17d0100970 msgr2=0x7f17d0101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:41.343 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.763+0000 7f17d6367700 1 -- 172.21.15.123:0/816530553 shutdown_connections 2024-05-06T13:54:41.343 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:40.763+0000 7f17d6367700 1 -- 172.21.15.123:0/816530553 wait complete. 2024-05-06T13:54:41.343 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying node-exporter service with default placement... 2024-05-06T13:54:41.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:41 smithi123 ceph-mon[27254]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:41.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:41 smithi123 ceph-mon[27254]: Saving service grafana spec with placement count:1 2024-05-06T13:54:41.970 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:41 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:42.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-05-06T13:54:42.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.759+0000 7f3305849700 1 Processor -- start 2024-05-06T13:54:42.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.759+0000 7f3305849700 1 -- start start 2024-05-06T13:54:42.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.759+0000 7f3305849700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 0x7f3300106e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:42.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.759+0000 7f3305849700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300107440 con 0x7f3300106a50 2024-05-06T13:54:42.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.759+0000 7f32feffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 0x7f3300106e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:42.485 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.759+0000 7f32feffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 0x7f3300106e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48294/0 (socket says 172.21.15.123:48294) 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.759+0000 7f32feffd700 1 -- 172.21.15.123:0/1393410964 learned_addr learned my addr 172.21.15.123:0/1393410964 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.759+0000 7f32feffd700 1 -- 172.21.15.123:0/1393410964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3300105660 con 0x7f3300106a50 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.760+0000 7f32feffd700 1 --2- 172.21.15.123:0/1393410964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 0x7f3300106e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32f00098a0 tx=0x7f32f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5bf11952f62bda server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.760+0000 7f32fdffb700 1 -- 172.21.15.123:0/1393410964 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32f0004180 con 0x7f3300106a50 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.760+0000 7f32fdffb700 1 -- 172.21.15.123:0/1393410964 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f32f00042e0 con 0x7f3300106a50 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.760+0000 7f32fdffb700 1 -- 172.21.15.123:0/1393410964 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32f0011af0 con 0x7f3300106a50 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.760+0000 7f3305849700 1 -- 172.21.15.123:0/1393410964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 msgr2=0x7f3300106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.760+0000 7f3305849700 1 --2- 172.21.15.123:0/1393410964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 0x7f3300106e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32f00098a0 tx=0x7f32f0009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.760+0000 7f3305849700 1 -- 172.21.15.123:0/1393410964 shutdown_connections 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.760+0000 7f3305849700 1 --2- 172.21.15.123:0/1393410964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 0x7f3300106e70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.760+0000 7f3305849700 1 -- 172.21.15.123:0/1393410964 >> 172.21.15.123:0/1393410964 conn(0x7f3300100190 msgr2=0x7f33001025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.760+0000 7f3305849700 1 -- 172.21.15.123:0/1393410964 shutdown_connections 2024-05-06T13:54:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.760+0000 7f3305849700 1 -- 172.21.15.123:0/1393410964 wait complete. 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.761+0000 7f3305849700 1 Processor -- start 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.761+0000 7f3305849700 1 -- start start 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.761+0000 7f3305849700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 0x7f330019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.761+0000 7f3305849700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330019a750 con 0x7f3300106a50 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.761+0000 7f32feffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 0x7f330019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.761+0000 7f32feffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 0x7f330019a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48310/0 (socket says 172.21.15.123:48310) 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.761+0000 7f32feffd700 1 -- 172.21.15.123:0/148674621 learned_addr learned my addr 172.21.15.123:0/148674621 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.762+0000 7f32feffd700 1 -- 172.21.15.123:0/148674621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f0009550 con 0x7f3300106a50 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.762+0000 7f32feffd700 1 --2- 172.21.15.123:0/148674621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 0x7f330019a210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f32f0000c00 tx=0x7f32f0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.763+0000 7f3304847700 1 -- 172.21.15.123:0/148674621 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32f0003a70 con 0x7f3300106a50 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.763+0000 7f3305849700 1 -- 172.21.15.123:0/148674621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330019a950 con 0x7f3300106a50 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.763+0000 7f3304847700 1 -- 172.21.15.123:0/148674621 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f32f0003bd0 con 0x7f3300106a50 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.763+0000 7f3304847700 1 -- 172.21.15.123:0/148674621 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32f00238c0 con 0x7f3300106a50 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.763+0000 7f3305849700 1 -- 172.21.15.123:0/148674621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330019adf0 con 0x7f3300106a50 2024-05-06T13:54:42.487 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.763+0000 7f3304847700 1 -- 172.21.15.123:0/148674621 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f32f0023b80 con 0x7f3300106a50 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.764+0000 7f3305849700 1 -- 172.21.15.123:0/148674621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33000623c0 con 0x7f3300106a50 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.764+0000 7f3304847700 1 --2- 172.21.15.123:0/148674621 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f32e8038320 0x7f32e803a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.764+0000 7f3304847700 1 -- 172.21.15.123:0/148674621 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f32f004c340 con 0x7f3300106a50 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.764+0000 7f32fe7fc700 1 --2- 172.21.15.123:0/148674621 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f32e8038320 0x7f32e803a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.764+0000 7f32fe7fc700 1 --2- 172.21.15.123:0/148674621 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f32e8038320 0x7f32e803a7e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f32f4006fd0 tx=0x7f32f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.768+0000 7f3304847700 1 -- 172.21.15.123:0/148674621 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f32f002b300 con 0x7f3300106a50 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.969+0000 7f3305849700 1 -- 172.21.15.123:0/148674621 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f3300102300 con 0x7f32e8038320 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.973+0000 7f3304847700 1 -- 172.21.15.123:0/148674621 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f3300102300 con 0x7f32e8038320 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.975+0000 7f3305849700 1 -- 172.21.15.123:0/148674621 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f32e8038320 msgr2=0x7f32e803a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.975+0000 7f3305849700 1 --2- 172.21.15.123:0/148674621 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f32e8038320 0x7f32e803a7e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f32f4006fd0 tx=0x7f32f4006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.975+0000 7f3305849700 1 -- 172.21.15.123:0/148674621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 msgr2=0x7f330019a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.975+0000 7f3305849700 1 --2- 172.21.15.123:0/148674621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 0x7f330019a210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f32f0000c00 tx=0x7f32f0011b50 comp rx=0 tx=0).stop 2024-05-06T13:54:42.488 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.976+0000 7f3305849700 1 -- 172.21.15.123:0/148674621 shutdown_connections 2024-05-06T13:54:42.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.976+0000 7f3305849700 1 --2- 172.21.15.123:0/148674621 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f32e8038320 0x7f32e803a7e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:42.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.976+0000 7f3305849700 1 --2- 172.21.15.123:0/148674621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3300106a50 0x7f330019a210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:42.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.976+0000 7f3305849700 1 -- 172.21.15.123:0/148674621 >> 172.21.15.123:0/148674621 conn(0x7f3300100190 msgr2=0x7f3300104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:42.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.976+0000 7f3305849700 1 -- 172.21.15.123:0/148674621 shutdown_connections 2024-05-06T13:54:42.489 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:41.976+0000 7f3305849700 1 -- 172.21.15.123:0/148674621 wait complete. 2024-05-06T13:54:42.489 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying alertmanager service with default placement... 2024-05-06T13:54:43.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:42 smithi123 ceph-mon[27254]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:54:43.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:42 smithi123 ceph-mon[27254]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:43.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:42 smithi123 ceph-mon[27254]: Saving service node-exporter spec with placement * 2024-05-06T13:54:43.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:42 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:43.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-05-06T13:54:43.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.902+0000 7ffb568e1700 1 Processor -- start 2024-05-06T13:54:43.716 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.902+0000 7ffb568e1700 1 -- start start 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.902+0000 7ffb568e1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 0x7ffb50109450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.902+0000 7ffb568e1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50079e30 con 0x7ffb50107060 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.902+0000 7ffb4ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 0x7ffb50109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.902+0000 7ffb4ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 0x7ffb50109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48314/0 (socket says 172.21.15.123:48314) 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.902+0000 7ffb4ffff700 1 -- 172.21.15.123:0/721348031 learned_addr learned my addr 172.21.15.123:0/721348031 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.902+0000 7ffb4ffff700 1 -- 172.21.15.123:0/721348031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb50109990 con 0x7ffb50107060 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.903+0000 7ffb4ffff700 1 --2- 172.21.15.123:0/721348031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 0x7ffb50109450 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb400098a0 tx=0x7ffb40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983d3754d504e546 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.903+0000 7ffb4effd700 1 -- 172.21.15.123:0/721348031 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb40004180 con 0x7ffb50107060 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.903+0000 7ffb4effd700 1 -- 172.21.15.123:0/721348031 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb400042e0 con 0x7ffb50107060 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.903+0000 7ffb4effd700 1 -- 172.21.15.123:0/721348031 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb40011af0 con 0x7ffb50107060 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.903+0000 7ffb568e1700 1 -- 172.21.15.123:0/721348031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 msgr2=0x7ffb50109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.903+0000 7ffb568e1700 1 --2- 172.21.15.123:0/721348031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 0x7ffb50109450 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb400098a0 tx=0x7ffb40009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.903+0000 7ffb568e1700 1 -- 172.21.15.123:0/721348031 shutdown_connections 2024-05-06T13:54:43.717 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.903+0000 7ffb568e1700 1 --2- 172.21.15.123:0/721348031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 0x7ffb50109450 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.903+0000 7ffb568e1700 1 -- 172.21.15.123:0/721348031 >> 172.21.15.123:0/721348031 conn(0x7ffb50100a50 msgr2=0x7ffb50102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.903+0000 7ffb568e1700 1 -- 172.21.15.123:0/721348031 shutdown_connections 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.903+0000 7ffb568e1700 1 -- 172.21.15.123:0/721348031 wait complete. 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.904+0000 7ffb568e1700 1 Processor -- start 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.904+0000 7ffb568e1700 1 -- start start 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.904+0000 7ffb568e1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 0x7ffb5019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.904+0000 7ffb568e1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5019a790 con 0x7ffb50107060 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.904+0000 7ffb4ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 0x7ffb5019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.904+0000 7ffb4ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 0x7ffb5019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48328/0 (socket says 172.21.15.123:48328) 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.904+0000 7ffb4ffff700 1 -- 172.21.15.123:0/1766207807 learned_addr learned my addr 172.21.15.123:0/1766207807 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.905+0000 7ffb4ffff700 1 -- 172.21.15.123:0/1766207807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb40009550 con 0x7ffb50107060 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.905+0000 7ffb4ffff700 1 --2- 172.21.15.123:0/1766207807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 0x7ffb5019a250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb40011670 tx=0x7ffb40011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:43.718 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.905+0000 7ffb4d7fa700 1 -- 172.21.15.123:0/1766207807 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb40003a40 con 0x7ffb50107060 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.905+0000 7ffb4d7fa700 1 -- 172.21.15.123:0/1766207807 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb40003ba0 con 0x7ffb50107060 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.905+0000 7ffb568e1700 1 -- 172.21.15.123:0/1766207807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5019a990 con 0x7ffb50107060 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.905+0000 7ffb4d7fa700 1 -- 172.21.15.123:0/1766207807 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb40024790 con 0x7ffb50107060 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.905+0000 7ffb568e1700 1 -- 172.21.15.123:0/1766207807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5019ae30 con 0x7ffb50107060 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.906+0000 7ffb4d7fa700 1 -- 172.21.15.123:0/1766207807 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7ffb4002d3f0 con 0x7ffb50107060 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.906+0000 7ffb4d7fa700 1 --2- 172.21.15.123:0/1766207807 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7ffb38038320 0x7ffb3803a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.906+0000 7ffb4d7fa700 1 -- 172.21.15.123:0/1766207807 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ffb4004c560 con 0x7ffb50107060 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.906+0000 7ffb568e1700 1 -- 172.21.15.123:0/1766207807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5010a720 con 0x7ffb50107060 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.906+0000 7ffb4f7fe700 1 --2- 172.21.15.123:0/1766207807 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7ffb38038320 0x7ffb3803a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.906+0000 7ffb4f7fe700 1 --2- 172.21.15.123:0/1766207807 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7ffb38038320 0x7ffb3803a7e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffb44006fd0 tx=0x7ffb44006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:42.911+0000 7ffb4d7fa700 1 -- 172.21.15.123:0/1766207807 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ffb4002d6f0 con 0x7ffb50107060 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:43.115+0000 7ffb568e1700 1 -- 172.21.15.123:0/1766207807 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb50101ed0 con 0x7ffb38038320 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:43.120+0000 7ffb4d7fa700 1 -- 172.21.15.123:0/1766207807 <== mgr.14120 v2:172.21.15.123:6800/2710951021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7ffb50101ed0 con 0x7ffb38038320 2024-05-06T13:54:43.719 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:43.122+0000 7ffb568e1700 1 -- 172.21.15.123:0/1766207807 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7ffb38038320 msgr2=0x7ffb3803a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:43.720 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:43.122+0000 7ffb568e1700 1 --2- 172.21.15.123:0/1766207807 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7ffb38038320 0x7ffb3803a7e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffb44006fd0 tx=0x7ffb44006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:43.720 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:43.122+0000 7ffb568e1700 1 -- 172.21.15.123:0/1766207807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 msgr2=0x7ffb5019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:43.720 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:43.122+0000 7ffb568e1700 1 --2- 172.21.15.123:0/1766207807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 0x7ffb5019a250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb40011670 tx=0x7ffb40011b50 comp rx=0 tx=0).stop 2024-05-06T13:54:43.720 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:43.122+0000 7ffb568e1700 1 -- 172.21.15.123:0/1766207807 shutdown_connections 2024-05-06T13:54:43.720 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:43.122+0000 7ffb568e1700 1 --2- 172.21.15.123:0/1766207807 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7ffb38038320 0x7ffb3803a7e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:43.720 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:43.122+0000 7ffb568e1700 1 --2- 172.21.15.123:0/1766207807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb50107060 0x7ffb5019a250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:43.720 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:43.122+0000 7ffb568e1700 1 -- 172.21.15.123:0/1766207807 >> 172.21.15.123:0/1766207807 conn(0x7ffb50100a50 msgr2=0x7ffb501017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:43.720 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:43.122+0000 7ffb568e1700 1 -- 172.21.15.123:0/1766207807 shutdown_connections 2024-05-06T13:54:43.720 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:43.122+0000 7ffb568e1700 1 -- 172.21.15.123:0/1766207807 wait complete. 2024-05-06T13:54:44.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:44 smithi123 ceph-mon[27254]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:44.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:44 smithi123 ceph-mon[27254]: Saving service alertmanager spec with placement count:1 2024-05-06T13:54:44.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:44 smithi123 ceph-mon[27254]: from='mgr.14120 172.21.15.123:0/642186214' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:44.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:44 smithi123 ceph-mon[27254]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:54:45.041 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.183+0000 7f54feff8700 1 Processor -- start 2024-05-06T13:54:45.041 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.183+0000 7f54feff8700 1 -- start start 2024-05-06T13:54:45.041 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.183+0000 7f54feff8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 0x7f54f807a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:45.041 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.183+0000 7f54feff8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f807a8b0 con 0x7f54f807be80 2024-05-06T13:54:45.042 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.183+0000 7f54fcd94700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 0x7f54f807a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:45.042 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.183+0000 7f54fcd94700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 0x7f54f807a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48332/0 (socket says 172.21.15.123:48332) 2024-05-06T13:54:45.042 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.183+0000 7f54fcd94700 1 -- 172.21.15.123:0/1804475660 learned_addr learned my addr 172.21.15.123:0/1804475660 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:45.042 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.184+0000 7f54fcd94700 1 -- 172.21.15.123:0/1804475660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f807a9f0 con 0x7f54f807be80 2024-05-06T13:54:45.042 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.184+0000 7f54fcd94700 1 --2- 172.21.15.123:0/1804475660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 0x7f54f807a2e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0098a0 tx=0x7f54ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ffbf335cc5fb1f server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:45.042 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.184+0000 7f54f77fe700 1 -- 172.21.15.123:0/1804475660 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54ec004180 con 0x7f54f807be80 2024-05-06T13:54:45.042 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.184+0000 7f54f77fe700 1 -- 172.21.15.123:0/1804475660 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f54ec0042e0 con 0x7f54f807be80 2024-05-06T13:54:45.042 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.184+0000 7f54f77fe700 1 -- 172.21.15.123:0/1804475660 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54ec011af0 con 0x7f54f807be80 2024-05-06T13:54:45.042 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.184+0000 7f54feff8700 1 -- 172.21.15.123:0/1804475660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 msgr2=0x7f54f807a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:45.042 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.184+0000 7f54feff8700 1 --2- 172.21.15.123:0/1804475660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 0x7f54f807a2e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0098a0 tx=0x7f54ec009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:45.042 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.184+0000 7f54feff8700 1 -- 172.21.15.123:0/1804475660 shutdown_connections 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.185+0000 7f54feff8700 1 --2- 172.21.15.123:0/1804475660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 0x7f54f807a2e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.185+0000 7f54feff8700 1 -- 172.21.15.123:0/1804475660 >> 172.21.15.123:0/1804475660 conn(0x7f54f8101b40 msgr2=0x7f54f8103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.185+0000 7f54feff8700 1 -- 172.21.15.123:0/1804475660 shutdown_connections 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.185+0000 7f54feff8700 1 -- 172.21.15.123:0/1804475660 wait complete. 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.185+0000 7f54feff8700 1 Processor -- start 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.185+0000 7f54feff8700 1 -- start start 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.185+0000 7f54feff8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 0x7f54f819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.185+0000 7f54feff8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f819ca10 con 0x7f54f807be80 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.185+0000 7f54fcd94700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 0x7f54f819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.185+0000 7f54fcd94700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 0x7f54f819c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48334/0 (socket says 172.21.15.123:48334) 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.185+0000 7f54fcd94700 1 -- 172.21.15.123:0/4104575724 learned_addr learned my addr 172.21.15.123:0/4104575724 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.186+0000 7f54fcd94700 1 -- 172.21.15.123:0/4104575724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec009550 con 0x7f54f807be80 2024-05-06T13:54:45.043 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.186+0000 7f54fcd94700 1 --2- 172.21.15.123:0/4104575724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 0x7f54f819c4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f54ec011670 tx=0x7f54ec011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:45.044 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.186+0000 7f54f5ffb700 1 -- 172.21.15.123:0/4104575724 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54ec0039f0 con 0x7f54f807be80 2024-05-06T13:54:45.044 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.186+0000 7f54f5ffb700 1 -- 172.21.15.123:0/4104575724 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f54ec003b50 con 0x7f54f807be80 2024-05-06T13:54:45.044 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.186+0000 7f54feff8700 1 -- 172.21.15.123:0/4104575724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f819cc10 con 0x7f54f807be80 2024-05-06T13:54:45.044 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.186+0000 7f54f5ffb700 1 -- 172.21.15.123:0/4104575724 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54ec0247c0 con 0x7f54f807be80 2024-05-06T13:54:45.044 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.186+0000 7f54feff8700 1 -- 172.21.15.123:0/4104575724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f819d0b0 con 0x7f54f807be80 2024-05-06T13:54:45.044 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.187+0000 7f54f5ffb700 1 -- 172.21.15.123:0/4104575724 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f54ec02d3f0 con 0x7f54f807be80 2024-05-06T13:54:45.044 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.187+0000 7f54feff8700 1 -- 172.21.15.123:0/4104575724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f810c900 con 0x7f54f807be80 2024-05-06T13:54:45.044 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.187+0000 7f54f5ffb700 1 --2- 172.21.15.123:0/4104575724 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f54e8038370 0x7f54e803a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:45.044 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.187+0000 7f54f5ffb700 1 -- 172.21.15.123:0/4104575724 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f54ec04c350 con 0x7f54f807be80 2024-05-06T13:54:45.044 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.187+0000 7f54f7fff700 1 --2- 172.21.15.123:0/4104575724 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f54e8038370 0x7f54e803a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:45.044 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.188+0000 7f54f7fff700 1 --2- 172.21.15.123:0/4104575724 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f54e8038370 0x7f54e803a830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f54e4006fd0 tx=0x7f54e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:45.045 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.192+0000 7f54f5ffb700 1 -- 172.21.15.123:0/4104575724 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f54ec010970 con 0x7f54f807be80 2024-05-06T13:54:45.045 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.382+0000 7f54feff8700 1 -- 172.21.15.123:0/4104575724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f54f81a0220 con 0x7f54f807be80 2024-05-06T13:54:45.045 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.385+0000 7f54f5ffb700 1 -- 172.21.15.123:0/4104575724 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f54ec020220 con 0x7f54f807be80 2024-05-06T13:54:45.045 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.387+0000 7f54feff8700 1 -- 172.21.15.123:0/4104575724 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f54e8038370 msgr2=0x7f54e803a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:45.045 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.387+0000 7f54feff8700 1 --2- 172.21.15.123:0/4104575724 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f54e8038370 0x7f54e803a830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f54e4006fd0 tx=0x7f54e4006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:45.045 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.387+0000 7f54feff8700 1 -- 172.21.15.123:0/4104575724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 msgr2=0x7f54f819c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:45.045 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.387+0000 7f54feff8700 1 --2- 172.21.15.123:0/4104575724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 0x7f54f819c4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f54ec011670 tx=0x7f54ec011b50 comp rx=0 tx=0).stop 2024-05-06T13:54:45.045 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.387+0000 7f54feff8700 1 -- 172.21.15.123:0/4104575724 shutdown_connections 2024-05-06T13:54:45.045 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.387+0000 7f54feff8700 1 --2- 172.21.15.123:0/4104575724 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f54e8038370 0x7f54e803a830 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:45.045 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.387+0000 7f54feff8700 1 --2- 172.21.15.123:0/4104575724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f807be80 0x7f54f819c4d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:45.045 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.387+0000 7f54feff8700 1 -- 172.21.15.123:0/4104575724 >> 172.21.15.123:0/4104575724 conn(0x7f54f8101b40 msgr2=0x7f54f8103240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:45.045 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.387+0000 7f54feff8700 1 -- 172.21.15.123:0/4104575724 shutdown_connections 2024-05-06T13:54:45.046 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:44.387+0000 7f54feff8700 1 -- 172.21.15.123:0/4104575724 wait complete. 2024-05-06T13:54:45.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:45 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/4104575724' entity='client.admin' 2024-05-06T13:54:46.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.450+0000 7fb7533d2700 1 Processor -- start 2024-05-06T13:54:46.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.450+0000 7fb7533d2700 1 -- start start 2024-05-06T13:54:46.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.451+0000 7fb7533d2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 0x7fb74c105270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:46.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.451+0000 7fb7533d2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c074600 con 0x7fb74c104e50 2024-05-06T13:54:46.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.451+0000 7fb75116e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 0x7fb74c105270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:46.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.451+0000 7fb75116e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 0x7fb74c105270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48344/0 (socket says 172.21.15.123:48344) 2024-05-06T13:54:46.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.451+0000 7fb75116e700 1 -- 172.21.15.123:0/2746133576 learned_addr learned my addr 172.21.15.123:0/2746133576 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:46.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.451+0000 7fb75116e700 1 -- 172.21.15.123:0/2746133576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c1057b0 con 0x7fb74c104e50 2024-05-06T13:54:46.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.451+0000 7fb75116e700 1 --2- 172.21.15.123:0/2746133576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 0x7fb74c105270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0098a0 tx=0x7fb73c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c23f2ee87b5a98d server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:46.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.451+0000 7fb743fff700 1 -- 172.21.15.123:0/2746133576 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb73c004180 con 0x7fb74c104e50 2024-05-06T13:54:46.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.451+0000 7fb743fff700 1 -- 172.21.15.123:0/2746133576 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb73c0042e0 con 0x7fb74c104e50 2024-05-06T13:54:46.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.451+0000 7fb743fff700 1 -- 172.21.15.123:0/2746133576 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb73c011af0 con 0x7fb74c104e50 2024-05-06T13:54:46.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.452+0000 7fb7533d2700 1 -- 172.21.15.123:0/2746133576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 msgr2=0x7fb74c105270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:46.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.452+0000 7fb7533d2700 1 --2- 172.21.15.123:0/2746133576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 0x7fb74c105270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0098a0 tx=0x7fb73c009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:46.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.452+0000 7fb7533d2700 1 -- 172.21.15.123:0/2746133576 shutdown_connections 2024-05-06T13:54:46.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.452+0000 7fb7533d2700 1 --2- 172.21.15.123:0/2746133576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 0x7fb74c105270 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:46.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.452+0000 7fb7533d2700 1 -- 172.21.15.123:0/2746133576 >> 172.21.15.123:0/2746133576 conn(0x7fb74c1009f0 msgr2=0x7fb74c102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:46.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.452+0000 7fb7533d2700 1 -- 172.21.15.123:0/2746133576 shutdown_connections 2024-05-06T13:54:46.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.452+0000 7fb7533d2700 1 -- 172.21.15.123:0/2746133576 wait complete. 2024-05-06T13:54:46.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.453+0000 7fb7533d2700 1 Processor -- start 2024-05-06T13:54:46.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.453+0000 7fb7533d2700 1 -- start start 2024-05-06T13:54:46.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.453+0000 7fb7533d2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 0x7fb74c19c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:46.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.453+0000 7fb7533d2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c19c8e0 con 0x7fb74c104e50 2024-05-06T13:54:46.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.453+0000 7fb75116e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 0x7fb74c19c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:46.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.453+0000 7fb75116e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 0x7fb74c19c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48360/0 (socket says 172.21.15.123:48360) 2024-05-06T13:54:46.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.453+0000 7fb75116e700 1 -- 172.21.15.123:0/2469603908 learned_addr learned my addr 172.21.15.123:0/2469603908 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:46.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.453+0000 7fb75116e700 1 -- 172.21.15.123:0/2469603908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c009550 con 0x7fb74c104e50 2024-05-06T13:54:46.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.453+0000 7fb75116e700 1 --2- 172.21.15.123:0/2469603908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 0x7fb74c19c3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb73c006ba0 tx=0x7fb73c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:46.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.453+0000 7fb7427fc700 1 -- 172.21.15.123:0/2469603908 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb73c003b00 con 0x7fb74c104e50 2024-05-06T13:54:46.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.454+0000 7fb7427fc700 1 -- 172.21.15.123:0/2469603908 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb73c01a8e0 con 0x7fb74c104e50 2024-05-06T13:54:46.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.454+0000 7fb7533d2700 1 -- 172.21.15.123:0/2469603908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74c19cae0 con 0x7fb74c104e50 2024-05-06T13:54:46.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.454+0000 7fb7427fc700 1 -- 172.21.15.123:0/2469603908 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb73c0199c0 con 0x7fb74c104e50 2024-05-06T13:54:46.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.454+0000 7fb7533d2700 1 -- 172.21.15.123:0/2469603908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74c19cf80 con 0x7fb74c104e50 2024-05-06T13:54:46.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.454+0000 7fb7427fc700 1 -- 172.21.15.123:0/2469603908 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fb73c019c30 con 0x7fb74c104e50 2024-05-06T13:54:46.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.454+0000 7fb7533d2700 1 -- 172.21.15.123:0/2469603908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74c195c50 con 0x7fb74c104e50 2024-05-06T13:54:46.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.455+0000 7fb7427fc700 1 --2- 172.21.15.123:0/2469603908 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb738038320 0x7fb73803a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:46.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.455+0000 7fb7427fc700 1 -- 172.21.15.123:0/2469603908 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb73c04c530 con 0x7fb74c104e50 2024-05-06T13:54:46.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.455+0000 7fb75096d700 1 --2- 172.21.15.123:0/2469603908 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb738038320 0x7fb73803a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:46.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.455+0000 7fb75096d700 1 --2- 172.21.15.123:0/2469603908 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb738038320 0x7fb73803a7e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb748006fd0 tx=0x7fb748006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:46.253 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.459+0000 7fb7427fc700 1 -- 172.21.15.123:0/2469603908 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb73c01a430 con 0x7fb74c104e50 2024-05-06T13:54:46.254 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.646+0000 7fb7533d2700 1 -- 172.21.15.123:0/2469603908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fb74c02cc70 con 0x7fb74c104e50 2024-05-06T13:54:46.254 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.653+0000 7fb7427fc700 1 -- 172.21.15.123:0/2469603908 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fb73c018b40 con 0x7fb74c104e50 2024-05-06T13:54:46.254 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.655+0000 7fb7533d2700 1 -- 172.21.15.123:0/2469603908 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb738038320 msgr2=0x7fb73803a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:46.254 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.655+0000 7fb7533d2700 1 --2- 172.21.15.123:0/2469603908 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb738038320 0x7fb73803a7e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb748006fd0 tx=0x7fb748006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:46.254 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.655+0000 7fb7533d2700 1 -- 172.21.15.123:0/2469603908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 msgr2=0x7fb74c19c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:46.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.655+0000 7fb7533d2700 1 --2- 172.21.15.123:0/2469603908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 0x7fb74c19c3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb73c006ba0 tx=0x7fb73c011b50 comp rx=0 tx=0).stop 2024-05-06T13:54:46.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.655+0000 7fb7533d2700 1 -- 172.21.15.123:0/2469603908 shutdown_connections 2024-05-06T13:54:46.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.655+0000 7fb7533d2700 1 --2- 172.21.15.123:0/2469603908 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb738038320 0x7fb73803a7e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:46.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.655+0000 7fb7533d2700 1 --2- 172.21.15.123:0/2469603908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb74c104e50 0x7fb74c19c3a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:46.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.655+0000 7fb7533d2700 1 -- 172.21.15.123:0/2469603908 >> 172.21.15.123:0/2469603908 conn(0x7fb74c1009f0 msgr2=0x7fb74c190a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:46.255 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.655+0000 7fb7533d2700 1 -- 172.21.15.123:0/2469603908 shutdown_connections 2024-05-06T13:54:46.256 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:45.655+0000 7fb7533d2700 1 -- 172.21.15.123:0/2469603908 wait complete. 2024-05-06T13:54:46.256 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling the dashboard module... 2024-05-06T13:54:46.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:46 smithi123 ceph-mon[27254]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:54:46.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:46 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2469603908' entity='client.admin' 2024-05-06T13:54:48.003 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:47 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2795195209' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-06T13:54:48.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.625+0000 7fec334c3700 1 Processor -- start 2024-05-06T13:54:48.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.625+0000 7fec334c3700 1 -- start start 2024-05-06T13:54:48.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.625+0000 7fec334c3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 0x7fec2c105270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:48.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.625+0000 7fec334c3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c074600 con 0x7fec2c104e50 2024-05-06T13:54:48.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.626+0000 7fec3125f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 0x7fec2c105270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:48.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.626+0000 7fec3125f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 0x7fec2c105270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48376/0 (socket says 172.21.15.123:48376) 2024-05-06T13:54:48.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.626+0000 7fec3125f700 1 -- 172.21.15.123:0/251187271 learned_addr learned my addr 172.21.15.123:0/251187271 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:48.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.626+0000 7fec3125f700 1 -- 172.21.15.123:0/251187271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c1057b0 con 0x7fec2c104e50 2024-05-06T13:54:48.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.626+0000 7fec3125f700 1 --2- 172.21.15.123:0/251187271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 0x7fec2c105270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec28009e80 tx=0x7fec2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b600991dea89648d server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:48.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.626+0000 7fec23fff700 1 -- 172.21.15.123:0/251187271 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec2800e070 con 0x7fec2c104e50 2024-05-06T13:54:48.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.626+0000 7fec23fff700 1 -- 172.21.15.123:0/251187271 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fec2800b8c0 con 0x7fec2c104e50 2024-05-06T13:54:48.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.626+0000 7fec23fff700 1 -- 172.21.15.123:0/251187271 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec280044d0 con 0x7fec2c104e50 2024-05-06T13:54:48.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.627+0000 7fec334c3700 1 -- 172.21.15.123:0/251187271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 msgr2=0x7fec2c105270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:48.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.627+0000 7fec334c3700 1 --2- 172.21.15.123:0/251187271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 0x7fec2c105270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec28009e80 tx=0x7fec2800b330 comp rx=0 tx=0).stop 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.627+0000 7fec334c3700 1 -- 172.21.15.123:0/251187271 shutdown_connections 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.627+0000 7fec334c3700 1 --2- 172.21.15.123:0/251187271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 0x7fec2c105270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.627+0000 7fec334c3700 1 -- 172.21.15.123:0/251187271 >> 172.21.15.123:0/251187271 conn(0x7fec2c1009f0 msgr2=0x7fec2c102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.627+0000 7fec334c3700 1 -- 172.21.15.123:0/251187271 shutdown_connections 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.627+0000 7fec334c3700 1 -- 172.21.15.123:0/251187271 wait complete. 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.627+0000 7fec334c3700 1 Processor -- start 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.627+0000 7fec334c3700 1 -- start start 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.628+0000 7fec334c3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 0x7fec2c19c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.628+0000 7fec334c3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c19c8b0 con 0x7fec2c104e50 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.628+0000 7fec3125f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 0x7fec2c19c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.628+0000 7fec3125f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 0x7fec2c19c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48392/0 (socket says 172.21.15.123:48392) 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.628+0000 7fec3125f700 1 -- 172.21.15.123:0/2795195209 learned_addr learned my addr 172.21.15.123:0/2795195209 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.628+0000 7fec3125f700 1 -- 172.21.15.123:0/2795195209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec28009b30 con 0x7fec2c104e50 2024-05-06T13:54:48.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.628+0000 7fec3125f700 1 --2- 172.21.15.123:0/2795195209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 0x7fec2c19c370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fec280072a0 tx=0x7fec280049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.628+0000 7fec227fc700 1 -- 172.21.15.123:0/2795195209 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec2800e040 con 0x7fec2c104e50 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.628+0000 7fec227fc700 1 -- 172.21.15.123:0/2795195209 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fec2800bd80 con 0x7fec2c104e50 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.628+0000 7fec334c3700 1 -- 172.21.15.123:0/2795195209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c19cab0 con 0x7fec2c104e50 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.628+0000 7fec227fc700 1 -- 172.21.15.123:0/2795195209 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec280126c0 con 0x7fec2c104e50 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.628+0000 7fec334c3700 1 -- 172.21.15.123:0/2795195209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c19cfb0 con 0x7fec2c104e50 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.629+0000 7fec227fc700 1 -- 172.21.15.123:0/2795195209 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fec28019040 con 0x7fec2c104e50 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.629+0000 7fec334c3700 1 -- 172.21.15.123:0/2795195209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c195c20 con 0x7fec2c104e50 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.629+0000 7fec227fc700 1 --2- 172.21.15.123:0/2795195209 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fec180382e0 0x7fec1803a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.629+0000 7fec227fc700 1 -- 172.21.15.123:0/2795195209 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fec2804be20 con 0x7fec2c104e50 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.629+0000 7fec30a5e700 1 --2- 172.21.15.123:0/2795195209 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fec180382e0 0x7fec1803a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.630+0000 7fec30a5e700 1 --2- 172.21.15.123:0/2795195209 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fec180382e0 0x7fec1803a7a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fec1c006fd0 tx=0x7fec1c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.634+0000 7fec227fc700 1 -- 172.21.15.123:0/2795195209 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fec2801a570 con 0x7fec2c104e50 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:46.877+0000 7fec334c3700 1 -- 172.21.15.123:0/2795195209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fec2c02cc70 con 0x7fec2c104e50 2024-05-06T13:54:48.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:47.659+0000 7fec227fc700 1 -- 172.21.15.123:0/2795195209 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 9) v1 ==== 45296+0+0 (secure 0 0 0) 0x7fec28051020 con 0x7fec2c104e50 2024-05-06T13:54:48.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:47.660+0000 7fec227fc700 1 -- 172.21.15.123:0/2795195209 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fec2802ad60 con 0x7fec2c104e50 2024-05-06T13:54:48.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:47.662+0000 7fec334c3700 1 -- 172.21.15.123:0/2795195209 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fec180382e0 msgr2=0x7fec1803a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:48.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:47.662+0000 7fec334c3700 1 --2- 172.21.15.123:0/2795195209 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fec180382e0 0x7fec1803a7a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fec1c006fd0 tx=0x7fec1c006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:48.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:47.662+0000 7fec334c3700 1 -- 172.21.15.123:0/2795195209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 msgr2=0x7fec2c19c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:48.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:47.662+0000 7fec334c3700 1 --2- 172.21.15.123:0/2795195209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 0x7fec2c19c370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fec280072a0 tx=0x7fec280049f0 comp rx=0 tx=0).stop 2024-05-06T13:54:48.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:47.662+0000 7fec334c3700 1 -- 172.21.15.123:0/2795195209 shutdown_connections 2024-05-06T13:54:48.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:47.662+0000 7fec334c3700 1 --2- 172.21.15.123:0/2795195209 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fec180382e0 0x7fec1803a7a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:48.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:47.662+0000 7fec334c3700 1 --2- 172.21.15.123:0/2795195209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec2c104e50 0x7fec2c19c370 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:48.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:47.662+0000 7fec334c3700 1 -- 172.21.15.123:0/2795195209 >> 172.21.15.123:0/2795195209 conn(0x7fec2c1009f0 msgr2=0x7fec2c190a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:48.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:47.663+0000 7fec334c3700 1 -- 172.21.15.123:0/2795195209 shutdown_connections 2024-05-06T13:54:48.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:47.663+0000 7fec334c3700 1 -- 172.21.15.123:0/2795195209 wait complete. 2024-05-06T13:54:48.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:48 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2795195209' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-06T13:54:48.864 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:48 smithi123 ceph-mon[27254]: mgrmap e9: smithi123.vjztrj(active, since 26s) 2024-05-06T13:54:49.476 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-05-06T13:54:49.476 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-06T13:54:49.476 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-06T13:54:49.476 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "active_name": "smithi123.vjztrj", 2024-05-06T13:54:49.476 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-06T13:54:49.476 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-05-06T13:54:49.476 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.604+0000 7fb2f6397700 1 Processor -- start 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.604+0000 7fb2f6397700 1 -- start start 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.605+0000 7fb2f6397700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 0x7fb2f0109430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.605+0000 7fb2f6397700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0079e30 con 0x7fb2f0107040 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.605+0000 7fb2effff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 0x7fb2f0109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.605+0000 7fb2effff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 0x7fb2f0109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47238/0 (socket says 172.21.15.123:47238) 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.605+0000 7fb2effff700 1 -- 172.21.15.123:0/876859176 learned_addr learned my addr 172.21.15.123:0/876859176 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.605+0000 7fb2effff700 1 -- 172.21.15.123:0/876859176 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0109970 con 0x7fb2f0107040 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.605+0000 7fb2effff700 1 --2- 172.21.15.123:0/876859176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 0x7fb2f0109430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40098a0 tx=0x7fb2e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d2d613ea802cd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.605+0000 7fb2eeffd700 1 -- 172.21.15.123:0/876859176 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2e4004180 con 0x7fb2f0107040 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.605+0000 7fb2eeffd700 1 -- 172.21.15.123:0/876859176 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb2e40042e0 con 0x7fb2f0107040 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.605+0000 7fb2eeffd700 1 -- 172.21.15.123:0/876859176 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2e4011af0 con 0x7fb2f0107040 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.606+0000 7fb2f6397700 1 -- 172.21.15.123:0/876859176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 msgr2=0x7fb2f0109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.606+0000 7fb2f6397700 1 --2- 172.21.15.123:0/876859176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 0x7fb2f0109430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40098a0 tx=0x7fb2e4009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:49.477 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.606+0000 7fb2f6397700 1 -- 172.21.15.123:0/876859176 shutdown_connections 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.606+0000 7fb2f6397700 1 --2- 172.21.15.123:0/876859176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 0x7fb2f0109430 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.606+0000 7fb2f6397700 1 -- 172.21.15.123:0/876859176 >> 172.21.15.123:0/876859176 conn(0x7fb2f01009f0 msgr2=0x7fb2f0102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.606+0000 7fb2f6397700 1 -- 172.21.15.123:0/876859176 shutdown_connections 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.606+0000 7fb2f6397700 1 -- 172.21.15.123:0/876859176 wait complete. 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.607+0000 7fb2f6397700 1 Processor -- start 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.607+0000 7fb2f6397700 1 -- start start 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.607+0000 7fb2f6397700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 0x7fb2f019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.607+0000 7fb2f6397700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f019a6e0 con 0x7fb2f0107040 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.607+0000 7fb2effff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 0x7fb2f019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.607+0000 7fb2effff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 0x7fb2f019a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47250/0 (socket says 172.21.15.123:47250) 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.607+0000 7fb2effff700 1 -- 172.21.15.123:0/1958320613 learned_addr learned my addr 172.21.15.123:0/1958320613 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.607+0000 7fb2effff700 1 -- 172.21.15.123:0/1958320613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4009550 con 0x7fb2f0107040 2024-05-06T13:54:49.478 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.607+0000 7fb2effff700 1 --2- 172.21.15.123:0/1958320613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 0x7fb2f019a1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4006ba0 tx=0x7fb2e4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.607+0000 7fb2ed7fa700 1 -- 172.21.15.123:0/1958320613 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2e4003b00 con 0x7fb2f0107040 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.608+0000 7fb2f6397700 1 -- 172.21.15.123:0/1958320613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f019a8e0 con 0x7fb2f0107040 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.608+0000 7fb2ed7fa700 1 -- 172.21.15.123:0/1958320613 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb2e401a8e0 con 0x7fb2f0107040 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.608+0000 7fb2ed7fa700 1 -- 172.21.15.123:0/1958320613 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2e40199c0 con 0x7fb2f0107040 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.608+0000 7fb2f6397700 1 -- 172.21.15.123:0/1958320613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f019ad80 con 0x7fb2f0107040 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.609+0000 7fb2f6397700 1 -- 172.21.15.123:0/1958320613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f010a700 con 0x7fb2f0107040 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.609+0000 7fb2ed7fa700 1 -- 172.21.15.123:0/1958320613 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 9) v1 ==== 45296+0+0 (secure 0 0 0) 0x7fb2e4019c80 con 0x7fb2f0107040 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.609+0000 7fb2ed7fa700 1 --2- 172.21.15.123:0/1958320613 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb2d8038320 0x7fb2d803a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.609+0000 7fb2ed7fa700 1 -- 172.21.15.123:0/1958320613 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb2e404c850 con 0x7fb2f0107040 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.609+0000 7fb2ef7fe700 1 -- 172.21.15.123:0/1958320613 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb2d8038320 msgr2=0x7fb2d803a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/2710951021 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.609+0000 7fb2ef7fe700 1 --2- 172.21.15.123:0/1958320613 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb2d8038320 0x7fb2d803a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.613+0000 7fb2ed7fa700 1 -- 172.21.15.123:0/1958320613 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb2e402d440 con 0x7fb2f0107040 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.810+0000 7fb2ef7fe700 1 -- 172.21.15.123:0/1958320613 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb2d8038320 msgr2=0x7fb2d803a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/2710951021 2024-05-06T13:54:49.479 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.810+0000 7fb2ef7fe700 1 --2- 172.21.15.123:0/1958320613 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb2d8038320 0x7fb2d803a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.863+0000 7fb2f6397700 1 -- 172.21.15.123:0/1958320613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb2f019db60 con 0x7fb2f0107040 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.864+0000 7fb2ed7fa700 1 -- 172.21.15.123:0/1958320613 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fb2e402b340 con 0x7fb2f0107040 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.866+0000 7fb2f6397700 1 -- 172.21.15.123:0/1958320613 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb2d8038320 msgr2=0x7fb2d803a7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.866+0000 7fb2f6397700 1 --2- 172.21.15.123:0/1958320613 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb2d8038320 0x7fb2d803a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.866+0000 7fb2f6397700 1 -- 172.21.15.123:0/1958320613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 msgr2=0x7fb2f019a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.866+0000 7fb2f6397700 1 --2- 172.21.15.123:0/1958320613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 0x7fb2f019a1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4006ba0 tx=0x7fb2e4011b50 comp rx=0 tx=0).stop 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.866+0000 7fb2f6397700 1 -- 172.21.15.123:0/1958320613 shutdown_connections 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.866+0000 7fb2f6397700 1 --2- 172.21.15.123:0/1958320613 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7fb2d8038320 0x7fb2d803a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.866+0000 7fb2f6397700 1 --2- 172.21.15.123:0/1958320613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2f0107040 0x7fb2f019a1a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.866+0000 7fb2f6397700 1 -- 172.21.15.123:0/1958320613 >> 172.21.15.123:0/1958320613 conn(0x7fb2f01009f0 msgr2=0x7fb2f0101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.866+0000 7fb2f6397700 1 -- 172.21.15.123:0/1958320613 shutdown_connections 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:48.866+0000 7fb2f6397700 1 -- 172.21.15.123:0/1958320613 wait complete. 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for the mgr to restart... 2024-05-06T13:54:49.480 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr epoch 9... 2024-05-06T13:54:49.795 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:49 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1958320613' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-06T13:54:54.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: Active manager daemon smithi123.vjztrj restarted 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: Activating manager daemon smithi123.vjztrj 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: osdmap e3: 0 total, 0 up, 0 in 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: mgrmap e10: smithi123.vjztrj(active, starting, since 0.00338112s) 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr metadata", "who": "smithi123.vjztrj", "id": "smithi123.vjztrj"}]: dispatch 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: Manager daemon smithi123.vjztrj is now available 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.vjztrj/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:54:54.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:54 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.vjztrj/trash_purge_schedule"}]: dispatch 2024-05-06T13:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-05-06T13:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-06T13:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-06T13:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-05-06T13:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.894+0000 7f5fd6356700 1 Processor -- start 2024-05-06T13:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.895+0000 7f5fd6356700 1 -- start start 2024-05-06T13:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.895+0000 7f5fd6356700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 0x7f5fd007a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.895+0000 7f5fd6356700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd007a8b0 con 0x7f5fd007be80 2024-05-06T13:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.895+0000 7f5fcffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 0x7f5fd007a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:56.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.895+0000 7f5fcffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 0x7f5fd007a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47258/0 (socket says 172.21.15.123:47258) 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.895+0000 7f5fcffff700 1 -- 172.21.15.123:0/1862629003 learned_addr learned my addr 172.21.15.123:0/1862629003 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.895+0000 7f5fcffff700 1 -- 172.21.15.123:0/1862629003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd007a9f0 con 0x7f5fd007be80 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.895+0000 7f5fcffff700 1 --2- 172.21.15.123:0/1862629003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 0x7f5fd007a2e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00098a0 tx=0x7f5fc0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d07d3db85ae4808 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.895+0000 7f5fceffd700 1 -- 172.21.15.123:0/1862629003 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fc0004180 con 0x7f5fd007be80 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.896+0000 7f5fceffd700 1 -- 172.21.15.123:0/1862629003 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5fc00042e0 con 0x7f5fd007be80 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.896+0000 7f5fceffd700 1 -- 172.21.15.123:0/1862629003 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fc0011af0 con 0x7f5fd007be80 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.896+0000 7f5fd6356700 1 -- 172.21.15.123:0/1862629003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 msgr2=0x7f5fd007a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.896+0000 7f5fd6356700 1 --2- 172.21.15.123:0/1862629003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 0x7f5fd007a2e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00098a0 tx=0x7f5fc0009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.896+0000 7f5fd6356700 1 -- 172.21.15.123:0/1862629003 shutdown_connections 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.896+0000 7f5fd6356700 1 --2- 172.21.15.123:0/1862629003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 0x7f5fd007a2e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.896+0000 7f5fd6356700 1 -- 172.21.15.123:0/1862629003 >> 172.21.15.123:0/1862629003 conn(0x7f5fd0101b40 msgr2=0x7f5fd0103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.896+0000 7f5fd6356700 1 -- 172.21.15.123:0/1862629003 shutdown_connections 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.896+0000 7f5fd6356700 1 -- 172.21.15.123:0/1862629003 wait complete. 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.897+0000 7f5fd6356700 1 Processor -- start 2024-05-06T13:54:56.104 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.897+0000 7f5fd6356700 1 -- start start 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.897+0000 7f5fd6356700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 0x7f5fd019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.897+0000 7f5fd6356700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd019c960 con 0x7f5fd007be80 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.897+0000 7f5fcffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 0x7f5fd019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.897+0000 7f5fcffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 0x7f5fd019c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47266/0 (socket says 172.21.15.123:47266) 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.897+0000 7f5fcffff700 1 -- 172.21.15.123:0/2720418585 learned_addr learned my addr 172.21.15.123:0/2720418585 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.898+0000 7f5fcffff700 1 -- 172.21.15.123:0/2720418585 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc0009550 con 0x7f5fd007be80 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.898+0000 7f5fcffff700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 0x7f5fd019c420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0000c00 tx=0x7f5fc0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.898+0000 7f5fcd7fa700 1 -- 172.21.15.123:0/2720418585 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fc0003a70 con 0x7f5fd007be80 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.898+0000 7f5fd6356700 1 -- 172.21.15.123:0/2720418585 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd019cb60 con 0x7f5fd007be80 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.898+0000 7f5fcd7fa700 1 -- 172.21.15.123:0/2720418585 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5fc0003bd0 con 0x7f5fd007be80 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.898+0000 7f5fcd7fa700 1 -- 172.21.15.123:0/2720418585 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fc00238c0 con 0x7f5fd007be80 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.898+0000 7f5fd6356700 1 -- 172.21.15.123:0/2720418585 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd019d000 con 0x7f5fd007be80 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.899+0000 7f5fcd7fa700 1 -- 172.21.15.123:0/2720418585 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 9) v1 ==== 45296+0+0 (secure 0 0 0) 0x7f5fc0023b30 con 0x7f5fd007be80 2024-05-06T13:54:56.105 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.899+0000 7f5fcd7fa700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 0x7f5fb803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.899+0000 7f5fcd7fa700 1 -- 172.21.15.123:0/2720418585 --> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fb803af90 con 0x7f5fb80383c0 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.899+0000 7f5fcd7fa700 1 -- 172.21.15.123:0/2720418585 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5fc004c2e0 con 0x7f5fd007be80 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.899+0000 7f5fcf7fe700 1 -- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 msgr2=0x7f5fb803a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/2710951021 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:49.899+0000 7f5fcf7fe700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 0x7f5fb803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:50.100+0000 7f5fcf7fe700 1 -- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 msgr2=0x7f5fb803a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/2710951021 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:50.100+0000 7f5fcf7fe700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 0x7f5fb803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:50.501+0000 7f5fcf7fe700 1 -- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 msgr2=0x7f5fb803a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/2710951021 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:50.501+0000 7f5fcf7fe700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 0x7f5fb803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:51.302+0000 7f5fcf7fe700 1 -- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 msgr2=0x7f5fb803a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/2710951021 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:51.302+0000 7f5fcf7fe700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 0x7f5fb803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:52.903+0000 7f5fcf7fe700 1 -- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 msgr2=0x7f5fb803a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/2710951021 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:52.903+0000 7f5fcf7fe700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 0x7f5fb803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T13:54:56.106 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:54.369+0000 7f5fcd7fa700 1 -- 172.21.15.123:0/2720418585 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mgrmap(e 10) v1 ==== 45063+0+0 (secure 0 0 0) 0x7f5fc002ad00 con 0x7f5fd007be80 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:54.369+0000 7f5fcd7fa700 1 -- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 msgr2=0x7f5fb803a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:54.369+0000 7f5fcd7fa700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 0x7f5fb803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.370+0000 7f5fcd7fa700 1 -- 172.21.15.123:0/2720418585 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 11) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f5fc004dee0 con 0x7f5fd007be80 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.370+0000 7f5fcd7fa700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f5fb803be30 0x7f5fb803e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.370+0000 7f5fcd7fa700 1 -- 172.21.15.123:0/2720418585 --> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fb803af90 con 0x7f5fb803be30 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.370+0000 7f5fcf7fe700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f5fb803be30 0x7f5fb803e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.371+0000 7f5fcf7fe700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f5fb803be30 0x7f5fb803e220 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4003a10 tx=0x7f5fc4009270 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.372+0000 7f5fcd7fa700 1 -- 172.21.15.123:0/2720418585 <== mgr.14164 v2:172.21.15.123:6800/388885730 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f5fb803af90 con 0x7f5fb803be30 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.378+0000 7f5fd6356700 1 -- 172.21.15.123:0/2720418585 --> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f5fbc002630 con 0x7f5fb803be30 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.378+0000 7f5fcd7fa700 1 -- 172.21.15.123:0/2720418585 <== mgr.14164 v2:172.21.15.123:6800/388885730 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f5fbc002630 con 0x7f5fb803be30 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.378+0000 7f5fd6356700 1 -- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f5fb803be30 msgr2=0x7f5fb803e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.378+0000 7f5fd6356700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f5fb803be30 0x7f5fb803e220 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4003a10 tx=0x7f5fc4009270 comp rx=0 tx=0).stop 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.378+0000 7f5fd6356700 1 -- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 msgr2=0x7f5fd019c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.378+0000 7f5fd6356700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 0x7f5fd019c420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0000c00 tx=0x7f5fc0011b50 comp rx=0 tx=0).stop 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.379+0000 7f5fd6356700 1 -- 172.21.15.123:0/2720418585 shutdown_connections 2024-05-06T13:54:56.107 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.379+0000 7f5fd6356700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f5fb803be30 0x7f5fb803e220 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:56.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.379+0000 7f5fd6356700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd007be80 0x7f5fd019c420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:56.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.379+0000 7f5fd6356700 1 --2- 172.21.15.123:0/2720418585 >> [v2:172.21.15.123:6800/2710951021,v1:172.21.15.123:6801/2710951021] conn(0x7f5fb80383c0 0x7f5fb803a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:56.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.379+0000 7f5fd6356700 1 -- 172.21.15.123:0/2720418585 >> 172.21.15.123:0/2720418585 conn(0x7f5fd0101b40 msgr2=0x7f5fd01028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:56.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.379+0000 7f5fd6356700 1 -- 172.21.15.123:0/2720418585 shutdown_connections 2024-05-06T13:54:56.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:55.379+0000 7f5fd6356700 1 -- 172.21.15.123:0/2720418585 wait complete. 2024-05-06T13:54:56.108 INFO:teuthology.orchestra.run.smithi123.stdout:mgr epoch 9 is available 2024-05-06T13:54:56.108 INFO:teuthology.orchestra.run.smithi123.stdout:Generating a dashboard self-signed certificate... 2024-05-06T13:54:56.719 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:56 smithi123 ceph-mon[27254]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-06T13:54:56.719 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:56 smithi123 ceph-mon[27254]: mgrmap e11: smithi123.vjztrj(active, since 1.00581s) 2024-05-06T13:54:56.719 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:56 smithi123 ceph-mon[27254]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-06T13:54:56.719 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:56 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:57.532 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-06T13:54:57.532 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.598+0000 7fced3092700 1 Processor -- start 2024-05-06T13:54:57.532 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.598+0000 7fced3092700 1 -- start start 2024-05-06T13:54:57.532 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.599+0000 7fced3092700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 0x7fcecc105890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:57.532 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.599+0000 7fced3092700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc105e60 con 0x7fcecc105470 2024-05-06T13:54:57.532 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.599+0000 7fced0e2e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 0x7fcecc105890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:57.532 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.599+0000 7fced0e2e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 0x7fcecc105890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47336/0 (socket says 172.21.15.123:47336) 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.599+0000 7fced0e2e700 1 -- 172.21.15.123:0/1716271090 learned_addr learned my addr 172.21.15.123:0/1716271090 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.599+0000 7fced0e2e700 1 -- 172.21.15.123:0/1716271090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc106670 con 0x7fcecc105470 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.599+0000 7fced0e2e700 1 --2- 172.21.15.123:0/1716271090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 0x7fcecc105890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcec00098a0 tx=0x7fcec0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4395164753801171 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.600+0000 7fcecb7fe700 1 -- 172.21.15.123:0/1716271090 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcec0004180 con 0x7fcecc105470 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.600+0000 7fcecb7fe700 1 -- 172.21.15.123:0/1716271090 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcec00042e0 con 0x7fcecc105470 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.600+0000 7fcecb7fe700 1 -- 172.21.15.123:0/1716271090 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcec0011af0 con 0x7fcecc105470 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.600+0000 7fced3092700 1 -- 172.21.15.123:0/1716271090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 msgr2=0x7fcecc105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.600+0000 7fced3092700 1 --2- 172.21.15.123:0/1716271090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 0x7fcecc105890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcec00098a0 tx=0x7fcec0009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.601+0000 7fced3092700 1 -- 172.21.15.123:0/1716271090 shutdown_connections 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.601+0000 7fced3092700 1 --2- 172.21.15.123:0/1716271090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 0x7fcecc105890 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.601+0000 7fced3092700 1 -- 172.21.15.123:0/1716271090 >> 172.21.15.123:0/1716271090 conn(0x7fcecc1009f0 msgr2=0x7fcecc102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.601+0000 7fced3092700 1 -- 172.21.15.123:0/1716271090 shutdown_connections 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.601+0000 7fced3092700 1 -- 172.21.15.123:0/1716271090 wait complete. 2024-05-06T13:54:57.533 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.601+0000 7fced3092700 1 Processor -- start 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.601+0000 7fced3092700 1 -- start start 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.601+0000 7fced3092700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 0x7fcecc074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.601+0000 7fced3092700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc19acf0 con 0x7fcecc105470 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.602+0000 7fced0e2e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 0x7fcecc074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.602+0000 7fced0e2e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 0x7fcecc074300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47352/0 (socket says 172.21.15.123:47352) 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.602+0000 7fced0e2e700 1 -- 172.21.15.123:0/3307772900 learned_addr learned my addr 172.21.15.123:0/3307772900 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.602+0000 7fced0e2e700 1 -- 172.21.15.123:0/3307772900 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec0009550 con 0x7fcecc105470 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.602+0000 7fced0e2e700 1 --2- 172.21.15.123:0/3307772900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 0x7fcecc074300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcec0000c00 tx=0x7fcec0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.602+0000 7fcec9ffb700 1 -- 172.21.15.123:0/3307772900 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcec0003a70 con 0x7fcecc105470 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.602+0000 7fced3092700 1 -- 172.21.15.123:0/3307772900 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc19f300 con 0x7fcecc105470 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.602+0000 7fcec9ffb700 1 -- 172.21.15.123:0/3307772900 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcec0003bd0 con 0x7fcecc105470 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.602+0000 7fcec9ffb700 1 -- 172.21.15.123:0/3307772900 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcec00238c0 con 0x7fcecc105470 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.602+0000 7fced3092700 1 -- 172.21.15.123:0/3307772900 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc19f660 con 0x7fcecc105470 2024-05-06T13:54:57.534 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.603+0000 7fcec9ffb700 1 -- 172.21.15.123:0/3307772900 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 11) v1 ==== 45190+0+0 (secure 0 0 0) 0x7fcec0023b30 con 0x7fcecc105470 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.603+0000 7fced3092700 1 -- 172.21.15.123:0/3307772900 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc0623c0 con 0x7fcecc105470 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.604+0000 7fcec9ffb700 1 --2- 172.21.15.123:0/3307772900 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fcebc0382a0 0x7fcebc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.604+0000 7fcec9ffb700 1 -- 172.21.15.123:0/3307772900 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcec004c3f0 con 0x7fcecc105470 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.604+0000 7fcecbfff700 1 --2- 172.21.15.123:0/3307772900 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fcebc0382a0 0x7fcebc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.604+0000 7fcecbfff700 1 --2- 172.21.15.123:0/3307772900 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fcebc0382a0 0x7fcebc03a760 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fceb8006fd0 tx=0x7fceb8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.608+0000 7fcec9ffb700 1 -- 172.21.15.123:0/3307772900 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcec002b300 con 0x7fcecc105470 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.718+0000 7fcec9ffb700 1 -- 172.21.15.123:0/3307772900 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 12) v1 ==== 45296+0+0 (secure 0 0 0) 0x7fcec001ad00 con 0x7fcecc105470 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.812+0000 7fced3092700 1 -- 172.21.15.123:0/3307772900 --> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fcecc101e60 con 0x7fcebc0382a0 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.933+0000 7fcec9ffb700 1 -- 172.21.15.123:0/3307772900 <== mgr.14164 v2:172.21.15.123:6800/388885730 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fcecc101e60 con 0x7fcebc0382a0 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.935+0000 7fced3092700 1 -- 172.21.15.123:0/3307772900 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fcebc0382a0 msgr2=0x7fcebc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.935+0000 7fced3092700 1 --2- 172.21.15.123:0/3307772900 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fcebc0382a0 0x7fcebc03a760 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fceb8006fd0 tx=0x7fceb8006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.935+0000 7fced3092700 1 -- 172.21.15.123:0/3307772900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 msgr2=0x7fcecc074300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.935+0000 7fced3092700 1 --2- 172.21.15.123:0/3307772900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 0x7fcecc074300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcec0000c00 tx=0x7fcec0011b50 comp rx=0 tx=0).stop 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.935+0000 7fced3092700 1 -- 172.21.15.123:0/3307772900 shutdown_connections 2024-05-06T13:54:57.535 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.935+0000 7fced3092700 1 --2- 172.21.15.123:0/3307772900 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fcebc0382a0 0x7fcebc03a760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:57.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.935+0000 7fced3092700 1 --2- 172.21.15.123:0/3307772900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcecc105470 0x7fcecc074300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:57.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.935+0000 7fced3092700 1 -- 172.21.15.123:0/3307772900 >> 172.21.15.123:0/3307772900 conn(0x7fcecc1009f0 msgr2=0x7fcecc101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:57.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.936+0000 7fced3092700 1 -- 172.21.15.123:0/3307772900 shutdown_connections 2024-05-06T13:54:57.536 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:56.936+0000 7fced3092700 1 -- 172.21.15.123:0/3307772900 wait complete. 2024-05-06T13:54:57.536 INFO:teuthology.orchestra.run.smithi123.stdout:Creating initial admin user... 2024-05-06T13:54:57.936 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:57 smithi123 ceph-mon[27254]: [06/May/2024:13:54:56] ENGINE Bus STARTING 2024-05-06T13:54:58.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:57 smithi123 ceph-mon[27254]: [06/May/2024:13:54:56] ENGINE Serving on http://172.21.15.123:8765 2024-05-06T13:54:58.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:57 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:58.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:57 smithi123 ceph-mon[27254]: [06/May/2024:13:54:56] ENGINE Serving on https://172.21.15.123:7150 2024-05-06T13:54:58.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:57 smithi123 ceph-mon[27254]: [06/May/2024:13:54:56] ENGINE Bus STARTED 2024-05-06T13:54:58.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:57 smithi123 ceph-mon[27254]: mgrmap e12: smithi123.vjztrj(active, since 2s) 2024-05-06T13:54:58.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:57 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:58.300 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:57 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:58.852 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:58 smithi123 ceph-mon[27254]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:54:58.852 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:58 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:54:59.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$J.pbq1iieJYq1MIWGlsRHewKkuG69u4IucznXSs5t7I92PN6YCsHi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715003698, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-06T13:54:59.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.963+0000 7f2f0d179700 1 Processor -- start 2024-05-06T13:54:59.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.963+0000 7f2f0d179700 1 -- start start 2024-05-06T13:54:59.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.963+0000 7f2f0d179700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 0x7f2f08106990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:59.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.963+0000 7f2f0d179700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f08106f60 con 0x7f2f08106570 2024-05-06T13:54:59.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.963+0000 7f2f06d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 0x7f2f08106990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:59.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.963+0000 7f2f06d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 0x7f2f08106990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50808/0 (socket says 172.21.15.123:50808) 2024-05-06T13:54:59.118 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.963+0000 7f2f06d9d700 1 -- 172.21.15.123:0/2539453153 learned_addr learned my addr 172.21.15.123:0/2539453153 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.963+0000 7f2f06d9d700 1 -- 172.21.15.123:0/2539453153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08107770 con 0x7f2f08106570 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.963+0000 7f2f06d9d700 1 --2- 172.21.15.123:0/2539453153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 0x7f2f08106990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80098a0 tx=0x7f2ef8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8f6458f7d0507d server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.964+0000 7f2f05d9b700 1 -- 172.21.15.123:0/2539453153 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ef8004180 con 0x7f2f08106570 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.964+0000 7f2f05d9b700 1 -- 172.21.15.123:0/2539453153 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ef80042e0 con 0x7f2f08106570 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.964+0000 7f2f05d9b700 1 -- 172.21.15.123:0/2539453153 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ef8011af0 con 0x7f2f08106570 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.964+0000 7f2f0d179700 1 -- 172.21.15.123:0/2539453153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 msgr2=0x7f2f08106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.964+0000 7f2f0d179700 1 --2- 172.21.15.123:0/2539453153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 0x7f2f08106990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80098a0 tx=0x7f2ef8009bb0 comp rx=0 tx=0).stop 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.964+0000 7f2f0d179700 1 -- 172.21.15.123:0/2539453153 shutdown_connections 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.964+0000 7f2f0d179700 1 --2- 172.21.15.123:0/2539453153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 0x7f2f08106990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.964+0000 7f2f0d179700 1 -- 172.21.15.123:0/2539453153 >> 172.21.15.123:0/2539453153 conn(0x7f2f08101b10 msgr2=0x7f2f08103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.964+0000 7f2f0d179700 1 -- 172.21.15.123:0/2539453153 shutdown_connections 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.964+0000 7f2f0d179700 1 -- 172.21.15.123:0/2539453153 wait complete. 2024-05-06T13:54:59.119 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.965+0000 7f2f0d179700 1 Processor -- start 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.965+0000 7f2f0d179700 1 -- start start 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.965+0000 7f2f0d179700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 0x7f2f0819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.965+0000 7f2f0d179700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0819a780 con 0x7f2f08106570 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.965+0000 7f2f06d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 0x7f2f0819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.965+0000 7f2f06d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 0x7f2f0819a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50814/0 (socket says 172.21.15.123:50814) 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.965+0000 7f2f06d9d700 1 -- 172.21.15.123:0/1299103150 learned_addr learned my addr 172.21.15.123:0/1299103150 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.966+0000 7f2f06d9d700 1 -- 172.21.15.123:0/1299103150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef8009550 con 0x7f2f08106570 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.966+0000 7f2f06d9d700 1 --2- 172.21.15.123:0/1299103150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 0x7f2f0819a240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8011670 tx=0x7f2ef8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.966+0000 7f2eeffff700 1 -- 172.21.15.123:0/1299103150 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ef80039f0 con 0x7f2f08106570 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.966+0000 7f2eeffff700 1 -- 172.21.15.123:0/1299103150 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ef8003b50 con 0x7f2f08106570 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.966+0000 7f2f0d179700 1 -- 172.21.15.123:0/1299103150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0819a980 con 0x7f2f08106570 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.966+0000 7f2eeffff700 1 -- 172.21.15.123:0/1299103150 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ef80247c0 con 0x7f2f08106570 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.966+0000 7f2f0d179700 1 -- 172.21.15.123:0/1299103150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0819ae20 con 0x7f2f08106570 2024-05-06T13:54:59.120 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.967+0000 7f2eeffff700 1 -- 172.21.15.123:0/1299103150 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 12) v1 ==== 45296+0+0 (secure 0 0 0) 0x7f2ef802d3f0 con 0x7f2f08106570 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.967+0000 7f2eeffff700 1 --2- 172.21.15.123:0/1299103150 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2ef0038370 0x7f2ef003a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.967+0000 7f2f0d179700 1 -- 172.21.15.123:0/1299103150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f080623c0 con 0x7f2f08106570 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.967+0000 7f2eeffff700 1 -- 172.21.15.123:0/1299103150 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2ef804c4c0 con 0x7f2f08106570 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.967+0000 7f2f0659c700 1 --2- 172.21.15.123:0/1299103150 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2ef0038370 0x7f2ef003a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.968+0000 7f2f0659c700 1 --2- 172.21.15.123:0/1299103150 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2ef0038370 0x7f2ef003a830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2efc006fd0 tx=0x7f2efc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:57.972+0000 7f2eeffff700 1 -- 172.21.15.123:0/1299103150 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2ef8010bb0 con 0x7f2f08106570 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:58.184+0000 7f2f0d179700 1 -- 172.21.15.123:0/1299103150 --> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f2f080621e0 con 0x7f2ef0038370 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:58.407+0000 7f2eeffff700 1 -- 172.21.15.123:0/1299103150 <== mgr.14164 v2:172.21.15.123:6800/388885730 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f2f080621e0 con 0x7f2ef0038370 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:58.409+0000 7f2f0d179700 1 -- 172.21.15.123:0/1299103150 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2ef0038370 msgr2=0x7f2ef003a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:58.409+0000 7f2f0d179700 1 --2- 172.21.15.123:0/1299103150 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2ef0038370 0x7f2ef003a830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2efc006fd0 tx=0x7f2efc006e40 comp rx=0 tx=0).stop 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:58.409+0000 7f2f0d179700 1 -- 172.21.15.123:0/1299103150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 msgr2=0x7f2f0819a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:58.409+0000 7f2f0d179700 1 --2- 172.21.15.123:0/1299103150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 0x7f2f0819a240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8011670 tx=0x7f2ef8011b50 comp rx=0 tx=0).stop 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:58.410+0000 7f2f0d179700 1 -- 172.21.15.123:0/1299103150 shutdown_connections 2024-05-06T13:54:59.121 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:58.410+0000 7f2f0d179700 1 --2- 172.21.15.123:0/1299103150 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2ef0038370 0x7f2ef003a830 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:59.122 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:58.410+0000 7f2f0d179700 1 --2- 172.21.15.123:0/1299103150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f08106570 0x7f2f0819a240 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:54:59.122 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:58.410+0000 7f2f0d179700 1 -- 172.21.15.123:0/1299103150 >> 172.21.15.123:0/1299103150 conn(0x7f2f08101b10 msgr2=0x7f2f081028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:54:59.122 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:58.410+0000 7f2f0d179700 1 -- 172.21.15.123:0/1299103150 shutdown_connections 2024-05-06T13:54:59.122 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:54:58.410+0000 7f2f0d179700 1 -- 172.21.15.123:0/1299103150 wait complete. 2024-05-06T13:54:59.122 INFO:teuthology.orchestra.run.smithi123.stdout:Fetching dashboard port number... 2024-05-06T13:54:59.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:54:59 smithi123 ceph-mon[27254]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:55:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 8443 2024-05-06T13:55:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.016+0000 7faf56386700 1 Processor -- start 2024-05-06T13:55:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.016+0000 7faf56386700 1 -- start start 2024-05-06T13:55:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.016+0000 7faf56386700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 0x7faf50106950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.016+0000 7faf56386700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf50106f20 con 0x7faf50106530 2024-05-06T13:55:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.016+0000 7faf4ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 0x7faf50106950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.016+0000 7faf4ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 0x7faf50106950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50828/0 (socket says 172.21.15.123:50828) 2024-05-06T13:55:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.016+0000 7faf4ffff700 1 -- 172.21.15.123:0/77888768 learned_addr learned my addr 172.21.15.123:0/77888768 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:55:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.016+0000 7faf4ffff700 1 -- 172.21.15.123:0/77888768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf50107730 con 0x7faf50106530 2024-05-06T13:55:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.016+0000 7faf4ffff700 1 --2- 172.21.15.123:0/77888768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 0x7faf50106950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faf400098a0 tx=0x7faf40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40940f46ee9ec6b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.017+0000 7faf4effd700 1 -- 172.21.15.123:0/77888768 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf40004180 con 0x7faf50106530 2024-05-06T13:55:00.828 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.017+0000 7faf4effd700 1 -- 172.21.15.123:0/77888768 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faf400042e0 con 0x7faf50106530 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.017+0000 7faf4effd700 1 -- 172.21.15.123:0/77888768 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf40011af0 con 0x7faf50106530 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.017+0000 7faf56386700 1 -- 172.21.15.123:0/77888768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 msgr2=0x7faf50106950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.017+0000 7faf56386700 1 --2- 172.21.15.123:0/77888768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 0x7faf50106950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faf400098a0 tx=0x7faf40009bb0 comp rx=0 tx=0).stop 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.017+0000 7faf56386700 1 -- 172.21.15.123:0/77888768 shutdown_connections 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.017+0000 7faf56386700 1 --2- 172.21.15.123:0/77888768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 0x7faf50106950 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.017+0000 7faf56386700 1 -- 172.21.15.123:0/77888768 >> 172.21.15.123:0/77888768 conn(0x7faf50101ad0 msgr2=0x7faf50103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.017+0000 7faf56386700 1 -- 172.21.15.123:0/77888768 shutdown_connections 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.017+0000 7faf56386700 1 -- 172.21.15.123:0/77888768 wait complete. 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.018+0000 7faf56386700 1 Processor -- start 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.018+0000 7faf56386700 1 -- start start 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.018+0000 7faf56386700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 0x7faf5019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.018+0000 7faf56386700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5019a790 con 0x7faf50106530 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.018+0000 7faf4ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 0x7faf5019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.018+0000 7faf4ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 0x7faf5019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50838/0 (socket says 172.21.15.123:50838) 2024-05-06T13:55:00.829 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.018+0000 7faf4ffff700 1 -- 172.21.15.123:0/2279639118 learned_addr learned my addr 172.21.15.123:0/2279639118 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.018+0000 7faf4ffff700 1 -- 172.21.15.123:0/2279639118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf40009550 con 0x7faf50106530 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.019+0000 7faf4ffff700 1 --2- 172.21.15.123:0/2279639118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 0x7faf5019a250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf40011670 tx=0x7faf40011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.019+0000 7faf4d7fa700 1 -- 172.21.15.123:0/2279639118 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf400039c0 con 0x7faf50106530 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.019+0000 7faf4d7fa700 1 -- 172.21.15.123:0/2279639118 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faf40003b20 con 0x7faf50106530 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.019+0000 7faf4d7fa700 1 -- 172.21.15.123:0/2279639118 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf400247f0 con 0x7faf50106530 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.019+0000 7faf56386700 1 -- 172.21.15.123:0/2279639118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5019a990 con 0x7faf50106530 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.019+0000 7faf56386700 1 -- 172.21.15.123:0/2279639118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5019ae30 con 0x7faf50106530 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.019+0000 7faf4d7fa700 1 -- 172.21.15.123:0/2279639118 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 12) v1 ==== 45296+0+0 (secure 0 0 0) 0x7faf40024a60 con 0x7faf50106530 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.020+0000 7faf4d7fa700 1 --2- 172.21.15.123:0/2279639118 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7faf38038380 0x7faf3803a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.020+0000 7faf4d7fa700 1 -- 172.21.15.123:0/2279639118 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7faf4004c380 con 0x7faf50106530 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.020+0000 7faf56386700 1 -- 172.21.15.123:0/2279639118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf500623c0 con 0x7faf50106530 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.020+0000 7faf4f7fe700 1 --2- 172.21.15.123:0/2279639118 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7faf38038380 0x7faf3803a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:00.830 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.020+0000 7faf4f7fe700 1 --2- 172.21.15.123:0/2279639118 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7faf38038380 0x7faf3803a840 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faf44006fd0 tx=0x7faf44006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.025+0000 7faf4d7fa700 1 -- 172.21.15.123:0/2279639118 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7faf40024d60 con 0x7faf50106530 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.215+0000 7faf56386700 1 -- 172.21.15.123:0/2279639118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7faf5019deb0 con 0x7faf50106530 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.216+0000 7faf4d7fa700 1 -- 172.21.15.123:0/2279639118 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7faf4001ac70 con 0x7faf50106530 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.218+0000 7faf56386700 1 -- 172.21.15.123:0/2279639118 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7faf38038380 msgr2=0x7faf3803a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.218+0000 7faf56386700 1 --2- 172.21.15.123:0/2279639118 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7faf38038380 0x7faf3803a840 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faf44006fd0 tx=0x7faf44006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.218+0000 7faf56386700 1 -- 172.21.15.123:0/2279639118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 msgr2=0x7faf5019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.218+0000 7faf56386700 1 --2- 172.21.15.123:0/2279639118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 0x7faf5019a250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf40011670 tx=0x7faf40011aa0 comp rx=0 tx=0).stop 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.218+0000 7faf56386700 1 -- 172.21.15.123:0/2279639118 shutdown_connections 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.218+0000 7faf56386700 1 --2- 172.21.15.123:0/2279639118 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7faf38038380 0x7faf3803a840 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.218+0000 7faf56386700 1 --2- 172.21.15.123:0/2279639118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf50106530 0x7faf5019a250 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.218+0000 7faf56386700 1 -- 172.21.15.123:0/2279639118 >> 172.21.15.123:0/2279639118 conn(0x7faf50101ad0 msgr2=0x7faf50103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.218+0000 7faf56386700 1 -- 172.21.15.123:0/2279639118 shutdown_connections 2024-05-06T13:55:00.831 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:00.218+0000 7faf56386700 1 -- 172.21.15.123:0/2279639118 wait complete. 2024-05-06T13:55:00.836 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-06T13:55:00.836 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-05-06T13:55:00.843 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-06T13:55:00.843 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-05-06T13:55:00.843 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-05-06T13:55:00.843 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-06T13:55:00.845 INFO:teuthology.orchestra.run.smithi123.stdout:Ceph Dashboard is now available at: 2024-05-06T13:55:00.845 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:55:00.845 INFO:teuthology.orchestra.run.smithi123.stdout: URL: https://smithi123:8443/ 2024-05-06T13:55:00.845 INFO:teuthology.orchestra.run.smithi123.stdout: User: admin 2024-05-06T13:55:00.845 INFO:teuthology.orchestra.run.smithi123.stdout: Password: w0mto4gtzh 2024-05-06T13:55:00.845 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:55:00.846 INFO:teuthology.orchestra.run.smithi123.stdout:Saving cluster configuration to /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config directory 2024-05-06T13:55:00.846 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling autotune for osd_memory_target 2024-05-06T13:55:01.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:00 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2279639118' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-06T13:55:01.966 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.260+0000 7f61587cf700 1 Processor -- start 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.260+0000 7f61587cf700 1 -- start start 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.260+0000 7f61587cf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 0x7f61501093d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.261+0000 7f61587cf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6150074680 con 0x7f6150106fe0 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.261+0000 7f615656b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 0x7f61501093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.261+0000 7f615656b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 0x7f61501093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50846/0 (socket says 172.21.15.123:50846) 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.261+0000 7f615656b700 1 -- 172.21.15.123:0/1440250346 learned_addr learned my addr 172.21.15.123:0/1440250346 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.261+0000 7f615656b700 1 -- 172.21.15.123:0/1440250346 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6150109910 con 0x7f6150106fe0 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.261+0000 7f615656b700 1 --2- 172.21.15.123:0/1440250346 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 0x7f61501093d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61400098a0 tx=0x7f6140009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347d55d34f288e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.261+0000 7f6155569700 1 -- 172.21.15.123:0/1440250346 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6140004180 con 0x7f6150106fe0 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.261+0000 7f6155569700 1 -- 172.21.15.123:0/1440250346 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f61400042e0 con 0x7f6150106fe0 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.261+0000 7f6155569700 1 -- 172.21.15.123:0/1440250346 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6140011af0 con 0x7f6150106fe0 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.262+0000 7f61587cf700 1 -- 172.21.15.123:0/1440250346 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 msgr2=0x7f61501093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.262+0000 7f61587cf700 1 --2- 172.21.15.123:0/1440250346 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 0x7f61501093d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61400098a0 tx=0x7f6140009bb0 comp rx=0 tx=0).stop 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.262+0000 7f61587cf700 1 -- 172.21.15.123:0/1440250346 shutdown_connections 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.262+0000 7f61587cf700 1 --2- 172.21.15.123:0/1440250346 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 0x7f61501093d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.262+0000 7f61587cf700 1 -- 172.21.15.123:0/1440250346 >> 172.21.15.123:0/1440250346 conn(0x7f61501009f0 msgr2=0x7f6150102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.262+0000 7f61587cf700 1 -- 172.21.15.123:0/1440250346 shutdown_connections 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.262+0000 7f61587cf700 1 -- 172.21.15.123:0/1440250346 wait complete. 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.263+0000 7f61587cf700 1 Processor -- start 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.263+0000 7f61587cf700 1 -- start start 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.263+0000 7f61587cf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 0x7f615019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.263+0000 7f61587cf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615019a6b0 con 0x7f6150106fe0 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.263+0000 7f615656b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 0x7f615019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.263+0000 7f615656b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 0x7f615019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50862/0 (socket says 172.21.15.123:50862) 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.263+0000 7f615656b700 1 -- 172.21.15.123:0/3143963561 learned_addr learned my addr 172.21.15.123:0/3143963561 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.263+0000 7f615656b700 1 -- 172.21.15.123:0/3143963561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140009550 con 0x7f6150106fe0 2024-05-06T13:55:01.968 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.263+0000 7f615656b700 1 --2- 172.21.15.123:0/3143963561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 0x7f615019a170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6140006ba0 tx=0x7f6140011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.264+0000 7f61477fe700 1 -- 172.21.15.123:0/3143963561 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6140003b00 con 0x7f6150106fe0 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.264+0000 7f61477fe700 1 -- 172.21.15.123:0/3143963561 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f614001a8e0 con 0x7f6150106fe0 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.264+0000 7f61587cf700 1 -- 172.21.15.123:0/3143963561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615019a8b0 con 0x7f6150106fe0 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.264+0000 7f61477fe700 1 -- 172.21.15.123:0/3143963561 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61400199c0 con 0x7f6150106fe0 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.264+0000 7f61587cf700 1 -- 172.21.15.123:0/3143963561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615019ad50 con 0x7f6150106fe0 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.264+0000 7f61477fe700 1 -- 172.21.15.123:0/3143963561 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f6140019c80 con 0x7f6150106fe0 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.265+0000 7f61587cf700 1 -- 172.21.15.123:0/3143963561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615010a700 con 0x7f6150106fe0 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.265+0000 7f61477fe700 1 --2- 172.21.15.123:0/3143963561 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f613c0383c0 0x7f613c03a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.265+0000 7f61477fe700 1 -- 172.21.15.123:0/3143963561 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f614004c9f0 con 0x7f6150106fe0 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.265+0000 7f6155d6a700 1 --2- 172.21.15.123:0/3143963561 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f613c0383c0 0x7f613c03a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.265+0000 7f6155d6a700 1 --2- 172.21.15.123:0/3143963561 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f613c0383c0 0x7f613c03a880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f614c006fd0 tx=0x7f614c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.269+0000 7f61477fe700 1 -- 172.21.15.123:0/3143963561 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f614002b700 con 0x7f6150106fe0 2024-05-06T13:55:01.969 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.457+0000 7f61587cf700 1 -- 172.21.15.123:0/3143963561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f615019db30 con 0x7f6150106fe0 2024-05-06T13:55:01.970 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.458+0000 7f61477fe700 1 -- 172.21.15.123:0/3143963561 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f614002b340 con 0x7f6150106fe0 2024-05-06T13:55:01.970 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.460+0000 7f61587cf700 1 -- 172.21.15.123:0/3143963561 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f613c0383c0 msgr2=0x7f613c03a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:01.970 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.460+0000 7f61587cf700 1 --2- 172.21.15.123:0/3143963561 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f613c0383c0 0x7f613c03a880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f614c006fd0 tx=0x7f614c006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:01.970 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.460+0000 7f61587cf700 1 -- 172.21.15.123:0/3143963561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 msgr2=0x7f615019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:01.970 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.460+0000 7f61587cf700 1 --2- 172.21.15.123:0/3143963561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 0x7f615019a170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6140006ba0 tx=0x7f6140011b50 comp rx=0 tx=0).stop 2024-05-06T13:55:01.970 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.460+0000 7f61587cf700 1 -- 172.21.15.123:0/3143963561 shutdown_connections 2024-05-06T13:55:01.970 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.460+0000 7f61587cf700 1 --2- 172.21.15.123:0/3143963561 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f613c0383c0 0x7f613c03a880 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:01.970 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.460+0000 7f61587cf700 1 --2- 172.21.15.123:0/3143963561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6150106fe0 0x7f615019a170 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:01.970 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.460+0000 7f61587cf700 1 -- 172.21.15.123:0/3143963561 >> 172.21.15.123:0/3143963561 conn(0x7f61501009f0 msgr2=0x7f6150101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:01.970 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.460+0000 7f61587cf700 1 -- 172.21.15.123:0/3143963561 shutdown_connections 2024-05-06T13:55:01.970 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:01.460+0000 7f61587cf700 1 -- 172.21.15.123:0/3143963561 wait complete. 2024-05-06T13:55:02.199 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:01 smithi123 ceph-mon[27254]: mgrmap e13: smithi123.vjztrj(active, since 6s) 2024-05-06T13:55:03.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.402+0000 7f581292a700 1 Processor -- start 2024-05-06T13:55:03.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.402+0000 7f581292a700 1 -- start start 2024-05-06T13:55:03.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.402+0000 7f581292a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 0x7f580c105890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:03.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.402+0000 7f581292a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c105e60 con 0x7f580c105470 2024-05-06T13:55:03.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.403+0000 7f580bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 0x7f580c105890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:03.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.403+0000 7f580bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 0x7f580c105890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50878/0 (socket says 172.21.15.123:50878) 2024-05-06T13:55:03.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.403+0000 7f580bfff700 1 -- 172.21.15.123:0/868478175 learned_addr learned my addr 172.21.15.123:0/868478175 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:55:03.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.403+0000 7f580bfff700 1 -- 172.21.15.123:0/868478175 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c106670 con 0x7f580c105470 2024-05-06T13:55:03.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.403+0000 7f580bfff700 1 --2- 172.21.15.123:0/868478175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 0x7f580c105890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0098a0 tx=0x7f57fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df81c732047b448 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:03.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.403+0000 7f580affd700 1 -- 172.21.15.123:0/868478175 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57fc004180 con 0x7f580c105470 2024-05-06T13:55:03.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.403+0000 7f580affd700 1 -- 172.21.15.123:0/868478175 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f57fc0042e0 con 0x7f580c105470 2024-05-06T13:55:03.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.403+0000 7f580affd700 1 -- 172.21.15.123:0/868478175 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57fc011af0 con 0x7f580c105470 2024-05-06T13:55:03.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.404+0000 7f581292a700 1 -- 172.21.15.123:0/868478175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 msgr2=0x7f580c105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:03.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.404+0000 7f581292a700 1 --2- 172.21.15.123:0/868478175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 0x7f580c105890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0098a0 tx=0x7f57fc009bb0 comp rx=0 tx=0).stop 2024-05-06T13:55:03.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.404+0000 7f581292a700 1 -- 172.21.15.123:0/868478175 shutdown_connections 2024-05-06T13:55:03.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.404+0000 7f581292a700 1 --2- 172.21.15.123:0/868478175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 0x7f580c105890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:03.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.404+0000 7f581292a700 1 -- 172.21.15.123:0/868478175 >> 172.21.15.123:0/868478175 conn(0x7f580c1009f0 msgr2=0x7f580c102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:03.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.404+0000 7f581292a700 1 -- 172.21.15.123:0/868478175 shutdown_connections 2024-05-06T13:55:03.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.404+0000 7f581292a700 1 -- 172.21.15.123:0/868478175 wait complete. 2024-05-06T13:55:03.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.404+0000 7f581292a700 1 Processor -- start 2024-05-06T13:55:03.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.404+0000 7f581292a700 1 -- start start 2024-05-06T13:55:03.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.405+0000 7f581292a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 0x7f580c190660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:03.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.405+0000 7f581292a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c190ba0 con 0x7f580c105470 2024-05-06T13:55:03.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.405+0000 7f580bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 0x7f580c190660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:03.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.405+0000 7f580bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 0x7f580c190660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50886/0 (socket says 172.21.15.123:50886) 2024-05-06T13:55:03.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.405+0000 7f580bfff700 1 -- 172.21.15.123:0/1517406617 learned_addr learned my addr 172.21.15.123:0/1517406617 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.405+0000 7f580bfff700 1 -- 172.21.15.123:0/1517406617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc009550 con 0x7f580c105470 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.405+0000 7f580bfff700 1 --2- 172.21.15.123:0/1517406617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 0x7f580c190660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f57fc006ba0 tx=0x7f57fc011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.405+0000 7f58097fa700 1 -- 172.21.15.123:0/1517406617 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57fc003b00 con 0x7f580c105470 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.405+0000 7f58097fa700 1 -- 172.21.15.123:0/1517406617 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f57fc01a8e0 con 0x7f580c105470 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.405+0000 7f581292a700 1 -- 172.21.15.123:0/1517406617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580c18ecb0 con 0x7f580c105470 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.405+0000 7f58097fa700 1 -- 172.21.15.123:0/1517406617 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57fc019990 con 0x7f580c105470 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.405+0000 7f581292a700 1 -- 172.21.15.123:0/1517406617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580c18f150 con 0x7f580c105470 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.406+0000 7f58097fa700 1 -- 172.21.15.123:0/1517406617 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f57fc019c50 con 0x7f580c105470 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.406+0000 7f581292a700 1 -- 172.21.15.123:0/1517406617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580c0623c0 con 0x7f580c105470 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.406+0000 7f58097fa700 1 --2- 172.21.15.123:0/1517406617 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f57f40383c0 0x7f57f403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.406+0000 7f58097fa700 1 -- 172.21.15.123:0/1517406617 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f57fc04c790 con 0x7f580c105470 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.407+0000 7f580b7fe700 1 --2- 172.21.15.123:0/1517406617 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f57f40383c0 0x7f57f403a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.407+0000 7f580b7fe700 1 --2- 172.21.15.123:0/1517406617 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f57f40383c0 0x7f57f403a880 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5800006fd0 tx=0x7f5800006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:03.300 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.411+0000 7f58097fa700 1 -- 172.21.15.123:0/1517406617 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f57fc02d440 con 0x7f580c105470 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.705+0000 7f581292a700 1 -- 172.21.15.123:0/1517406617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f580c18fb20 con 0x7f580c105470 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.708+0000 7f58097fa700 1 -- 172.21.15.123:0/1517406617 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f57fc0172b0 con 0x7f580c105470 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.710+0000 7f581292a700 1 -- 172.21.15.123:0/1517406617 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f57f40383c0 msgr2=0x7f57f403a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.710+0000 7f581292a700 1 --2- 172.21.15.123:0/1517406617 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f57f40383c0 0x7f57f403a880 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5800006fd0 tx=0x7f5800006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.710+0000 7f581292a700 1 -- 172.21.15.123:0/1517406617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 msgr2=0x7f580c190660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.710+0000 7f581292a700 1 --2- 172.21.15.123:0/1517406617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 0x7f580c190660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f57fc006ba0 tx=0x7f57fc011b50 comp rx=0 tx=0).stop 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.710+0000 7f581292a700 1 -- 172.21.15.123:0/1517406617 shutdown_connections 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.710+0000 7f581292a700 1 --2- 172.21.15.123:0/1517406617 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f57f40383c0 0x7f57f403a880 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.710+0000 7f581292a700 1 --2- 172.21.15.123:0/1517406617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580c105470 0x7f580c190660 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.710+0000 7f581292a700 1 -- 172.21.15.123:0/1517406617 >> 172.21.15.123:0/1517406617 conn(0x7f580c1009f0 msgr2=0x7f580c079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.710+0000 7f581292a700 1 -- 172.21.15.123:0/1517406617 shutdown_connections 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-05-06T13:55:02.710+0000 7f581292a700 1 -- 172.21.15.123:0/1517406617 wait complete. 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-06T13:55:03.301 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout:Or, if you are only running a single cluster on this host: 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout: ceph telemetry on 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout:For more information see: 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:55:03.302 INFO:teuthology.orchestra.run.smithi123.stdout:Bootstrap complete. 2024-05-06T13:55:03.329 INFO:tasks.cephadm:Fetching config... 2024-05-06T13:55:03.330 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:55:03.330 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-06T13:55:03.346 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-06T13:55:03.346 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:55:03.346 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-06T13:55:03.402 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-06T13:55:03.402 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:55:03.402 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/keyring of=/dev/stdout 2024-05-06T13:55:03.466 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-06T13:55:03.466 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:55:03.466 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-06T13:55:03.522 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-06T13:55:03.522 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLAeeOOrFTApeYIabkUxFTAFYPDQGkDuFmcd0O/7Ia9/Cj3piSf7bwNjx31ekG1imaPpzC4HhK08UTQhW3wTKLtNkwDs7ojCP/8Jtfa5QuyxD9J5MPLlgXtrQ30v3XvMXIcfW9XJzLwgFkzag7KRyN6N0WtYTkl5WiBX/sP0QHFTtFdf7mQZJjOiIXh8ckJImvnh6l6s55M5nsuixrNY5qMs9LDy3xTm99O0U4hGIm2fw/zCZ74b1Y+v4Qlas65n4d/Rl3ccCEVY/S5cjbvIkDUWO8e+VTiqWzuY7ctXcZoOkwo3wI5o86vwSu75KbZbR82BebP9+aS4l858Z5pwDNjAMLKAjvQ10Ehv/bCgRklXT7/Hc7pNrki/dPuhaH8MQrGMl6S2ghqIAlKUo33XHxxnP4ANY09USwjU6zxpnhRvY/8DZI1SkLMZQhIbx5AH7z+GB6TqRa32YMlj6mEiBH9GUtaU+k7QSINf1L/I46EHXBmLAg0khcFPt9MUMoySc= ceph-f22edd3c-0baf-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-06T13:55:03.593 INFO:teuthology.orchestra.run.smithi123.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLAeeOOrFTApeYIabkUxFTAFYPDQGkDuFmcd0O/7Ia9/Cj3piSf7bwNjx31ekG1imaPpzC4HhK08UTQhW3wTKLtNkwDs7ojCP/8Jtfa5QuyxD9J5MPLlgXtrQ30v3XvMXIcfW9XJzLwgFkzag7KRyN6N0WtYTkl5WiBX/sP0QHFTtFdf7mQZJjOiIXh8ckJImvnh6l6s55M5nsuixrNY5qMs9LDy3xTm99O0U4hGIm2fw/zCZ74b1Y+v4Qlas65n4d/Rl3ccCEVY/S5cjbvIkDUWO8e+VTiqWzuY7ctXcZoOkwo3wI5o86vwSu75KbZbR82BebP9+aS4l858Z5pwDNjAMLKAjvQ10Ehv/bCgRklXT7/Hc7pNrki/dPuhaH8MQrGMl6S2ghqIAlKUo33XHxxnP4ANY09USwjU6zxpnhRvY/8DZI1SkLMZQhIbx5AH7z+GB6TqRa32YMlj6mEiBH9GUtaU+k7QSINf1L/I46EHXBmLAg0khcFPt9MUMoySc= ceph-f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:55:03.604 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLAeeOOrFTApeYIabkUxFTAFYPDQGkDuFmcd0O/7Ia9/Cj3piSf7bwNjx31ekG1imaPpzC4HhK08UTQhW3wTKLtNkwDs7ojCP/8Jtfa5QuyxD9J5MPLlgXtrQ30v3XvMXIcfW9XJzLwgFkzag7KRyN6N0WtYTkl5WiBX/sP0QHFTtFdf7mQZJjOiIXh8ckJImvnh6l6s55M5nsuixrNY5qMs9LDy3xTm99O0U4hGIm2fw/zCZ74b1Y+v4Qlas65n4d/Rl3ccCEVY/S5cjbvIkDUWO8e+VTiqWzuY7ctXcZoOkwo3wI5o86vwSu75KbZbR82BebP9+aS4l858Z5pwDNjAMLKAjvQ10Ehv/bCgRklXT7/Hc7pNrki/dPuhaH8MQrGMl6S2ghqIAlKUo33XHxxnP4ANY09USwjU6zxpnhRvY/8DZI1SkLMZQhIbx5AH7z+GB6TqRa32YMlj6mEiBH9GUtaU+k7QSINf1L/I46EHXBmLAg0khcFPt9MUMoySc= ceph-f22edd3c-0baf-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-06T13:55:03.643 INFO:teuthology.orchestra.run.smithi174.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLAeeOOrFTApeYIabkUxFTAFYPDQGkDuFmcd0O/7Ia9/Cj3piSf7bwNjx31ekG1imaPpzC4HhK08UTQhW3wTKLtNkwDs7ojCP/8Jtfa5QuyxD9J5MPLlgXtrQ30v3XvMXIcfW9XJzLwgFkzag7KRyN6N0WtYTkl5WiBX/sP0QHFTtFdf7mQZJjOiIXh8ckJImvnh6l6s55M5nsuixrNY5qMs9LDy3xTm99O0U4hGIm2fw/zCZ74b1Y+v4Qlas65n4d/Rl3ccCEVY/S5cjbvIkDUWO8e+VTiqWzuY7ctXcZoOkwo3wI5o86vwSu75KbZbR82BebP9+aS4l858Z5pwDNjAMLKAjvQ10Ehv/bCgRklXT7/Hc7pNrki/dPuhaH8MQrGMl6S2ghqIAlKUo33XHxxnP4ANY09USwjU6zxpnhRvY/8DZI1SkLMZQhIbx5AH7z+GB6TqRa32YMlj6mEiBH9GUtaU+k7QSINf1L/I46EHXBmLAg0khcFPt9MUMoySc= ceph-f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:55:03.655 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-06T13:55:03.801 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:03 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1517406617' entity='client.admin' 2024-05-06T13:55:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:55:06.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.025+0000 7f6da26ed700 1 -- 172.21.15.123:0/427912630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d9c1008b0 msgr2=0x7f6d9c100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:06.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.025+0000 7f6da26ed700 1 --2- 172.21.15.123:0/427912630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d9c1008b0 0x7f6d9c100cd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009910 tx=0x7f6d8c009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:06.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.025+0000 7f6da26ed700 1 -- 172.21.15.123:0/427912630 shutdown_connections 2024-05-06T13:55:06.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.025+0000 7f6da26ed700 1 --2- 172.21.15.123:0/427912630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d9c1008b0 0x7f6d9c100cd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:06.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.025+0000 7f6da26ed700 1 -- 172.21.15.123:0/427912630 >> 172.21.15.123:0/427912630 conn(0x7f6d9c0fbe30 msgr2=0x7f6d9c0fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:06.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.025+0000 7f6da26ed700 1 -- 172.21.15.123:0/427912630 shutdown_connections 2024-05-06T13:55:06.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.025+0000 7f6da26ed700 1 -- 172.21.15.123:0/427912630 wait complete. 2024-05-06T13:55:06.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.026+0000 7f6da26ed700 1 Processor -- start 2024-05-06T13:55:06.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.026+0000 7f6da26ed700 1 -- start start 2024-05-06T13:55:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.026+0000 7f6da26ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d9c1008b0 0x7f6d9c1959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.026+0000 7f6da26ed700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c195f00 con 0x7f6d9c1008b0 2024-05-06T13:55:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.026+0000 7f6d9bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d9c1008b0 0x7f6d9c1959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.026+0000 7f6d9bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d9c1008b0 0x7f6d9c1959c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50906/0 (socket says 172.21.15.123:50906) 2024-05-06T13:55:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.026+0000 7f6d9bfff700 1 -- 172.21.15.123:0/1851187053 learned_addr learned my addr 172.21.15.123:0/1851187053 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:55:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.026+0000 7f6d9bfff700 1 -- 172.21.15.123:0/1851187053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c0095f0 con 0x7f6d9c1008b0 2024-05-06T13:55:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.027+0000 7f6d9bfff700 1 --2- 172.21.15.123:0/1851187053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d9c1008b0 0x7f6d9c1959c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c005b40 tx=0x7f6d8c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.027+0000 7f6d997fa700 1 -- 172.21.15.123:0/1851187053 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d8c01d070 con 0x7f6d9c1008b0 2024-05-06T13:55:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.027+0000 7f6da26ed700 1 -- 172.21.15.123:0/1851187053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c196100 con 0x7f6d9c1008b0 2024-05-06T13:55:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.027+0000 7f6d997fa700 1 -- 172.21.15.123:0/1851187053 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d8c00be10 con 0x7f6d9c1008b0 2024-05-06T13:55:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.027+0000 7f6d997fa700 1 -- 172.21.15.123:0/1851187053 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d8c00f460 con 0x7f6d9c1008b0 2024-05-06T13:55:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.027+0000 7f6da26ed700 1 -- 172.21.15.123:0/1851187053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c1965a0 con 0x7f6d9c1008b0 2024-05-06T13:55:06.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.028+0000 7f6d997fa700 1 -- 172.21.15.123:0/1851187053 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f6d8c00f6d0 con 0x7f6d9c1008b0 2024-05-06T13:55:06.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.028+0000 7f6da26ed700 1 -- 172.21.15.123:0/1851187053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c18f4d0 con 0x7f6d9c1008b0 2024-05-06T13:55:06.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.028+0000 7f6d997fa700 1 --2- 172.21.15.123:0/1851187053 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f6d840383c0 0x7f6d8403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:06.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.028+0000 7f6d997fa700 1 -- 172.21.15.123:0/1851187053 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6d8c04c520 con 0x7f6d9c1008b0 2024-05-06T13:55:06.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.028+0000 7f6d9b7fe700 1 --2- 172.21.15.123:0/1851187053 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f6d840383c0 0x7f6d8403a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:06.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.028+0000 7f6d9b7fe700 1 --2- 172.21.15.123:0/1851187053 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f6d840383c0 0x7f6d8403a880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d90006fd0 tx=0x7f6d90006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.033+0000 7f6d997fa700 1 -- 172.21.15.123:0/1851187053 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6d8c02a360 con 0x7f6d9c1008b0 2024-05-06T13:55:06.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.226+0000 7f6da26ed700 1 -- 172.21.15.123:0/1851187053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f6d9c02cc70 con 0x7f6d9c1008b0 2024-05-06T13:55:06.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.230+0000 7f6d997fa700 1 -- 172.21.15.123:0/1851187053 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6d8c027070 con 0x7f6d9c1008b0 2024-05-06T13:55:06.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.232+0000 7f6da26ed700 1 -- 172.21.15.123:0/1851187053 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f6d840383c0 msgr2=0x7f6d8403a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:06.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.232+0000 7f6da26ed700 1 --2- 172.21.15.123:0/1851187053 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f6d840383c0 0x7f6d8403a880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d90006fd0 tx=0x7f6d90006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:06.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.232+0000 7f6da26ed700 1 -- 172.21.15.123:0/1851187053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d9c1008b0 msgr2=0x7f6d9c1959c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:06.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.232+0000 7f6da26ed700 1 --2- 172.21.15.123:0/1851187053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d9c1008b0 0x7f6d9c1959c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c005b40 tx=0x7f6d8c004740 comp rx=0 tx=0).stop 2024-05-06T13:55:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.232+0000 7f6da26ed700 1 -- 172.21.15.123:0/1851187053 shutdown_connections 2024-05-06T13:55:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.232+0000 7f6da26ed700 1 --2- 172.21.15.123:0/1851187053 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f6d840383c0 0x7f6d8403a880 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.232+0000 7f6da26ed700 1 --2- 172.21.15.123:0/1851187053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d9c1008b0 0x7f6d9c1959c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.232+0000 7f6da26ed700 1 -- 172.21.15.123:0/1851187053 >> 172.21.15.123:0/1851187053 conn(0x7f6d9c0fbe30 msgr2=0x7f6d9c0fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.233+0000 7f6da26ed700 1 -- 172.21.15.123:0/1851187053 shutdown_connections 2024-05-06T13:55:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:06.233+0000 7f6da26ed700 1 -- 172.21.15.123:0/1851187053 wait complete. 2024-05-06T13:55:07.126 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-06T13:55:07.126 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-06T13:55:07.407 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:07 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1851187053' entity='client.admin' 2024-05-06T13:55:07.754 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:55:08.941 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:08 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:08.941 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:08 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:08.941 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:08 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi123", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:55:08.941 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:08 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:08.941 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:08 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi123", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T13:55:08.941 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:08 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi123", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-05-06T13:55:08.941 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:08 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:55:08.941 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:08 smithi123 ceph-mon[27254]: Deploying daemon ceph-exporter.smithi123 on smithi123 2024-05-06T13:55:09.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.153+0000 7f9da312b700 1 -- 172.21.15.123:0/2689594782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d9c0ff790 msgr2=0x7f9d9c0ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:09.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.153+0000 7f9da312b700 1 --2- 172.21.15.123:0/2689594782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d9c0ff790 0x7f9d9c0ffbb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009910 tx=0x7f9d90009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:09.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.153+0000 7f9da312b700 1 -- 172.21.15.123:0/2689594782 shutdown_connections 2024-05-06T13:55:09.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.153+0000 7f9da312b700 1 --2- 172.21.15.123:0/2689594782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d9c0ff790 0x7f9d9c0ffbb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:09.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.153+0000 7f9da312b700 1 -- 172.21.15.123:0/2689594782 >> 172.21.15.123:0/2689594782 conn(0x7f9d9c0fad30 msgr2=0x7f9d9c0fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:09.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.153+0000 7f9da312b700 1 -- 172.21.15.123:0/2689594782 shutdown_connections 2024-05-06T13:55:09.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.153+0000 7f9da312b700 1 -- 172.21.15.123:0/2689594782 wait complete. 2024-05-06T13:55:09.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.154+0000 7f9da312b700 1 Processor -- start 2024-05-06T13:55:09.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.154+0000 7f9da312b700 1 -- start start 2024-05-06T13:55:09.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.154+0000 7f9da312b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d9c0ff790 0x7f9d9c197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:09.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.154+0000 7f9da312b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c1980e0 con 0x7f9d9c0ff790 2024-05-06T13:55:09.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.154+0000 7f9da0ec7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d9c0ff790 0x7f9d9c197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:09.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.154+0000 7f9da0ec7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d9c0ff790 0x7f9d9c197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50624/0 (socket says 172.21.15.123:50624) 2024-05-06T13:55:09.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.154+0000 7f9da0ec7700 1 -- 172.21.15.123:0/3807095440 learned_addr learned my addr 172.21.15.123:0/3807095440 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:55:09.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.154+0000 7f9da0ec7700 1 -- 172.21.15.123:0/3807095440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900095f0 con 0x7f9d9c0ff790 2024-05-06T13:55:09.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.155+0000 7f9da0ec7700 1 --2- 172.21.15.123:0/3807095440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d9c0ff790 0x7f9d9c197ba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d90005950 tx=0x7f9d90009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:09.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.155+0000 7f9d99ffb700 1 -- 172.21.15.123:0/3807095440 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d9001d070 con 0x7f9d9c0ff790 2024-05-06T13:55:09.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.155+0000 7f9da312b700 1 -- 172.21.15.123:0/3807095440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9c1982e0 con 0x7f9d9c0ff790 2024-05-06T13:55:09.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.155+0000 7f9d99ffb700 1 -- 172.21.15.123:0/3807095440 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d9000be10 con 0x7f9d9c0ff790 2024-05-06T13:55:09.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.155+0000 7f9d99ffb700 1 -- 172.21.15.123:0/3807095440 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d9000f460 con 0x7f9d9c0ff790 2024-05-06T13:55:09.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.155+0000 7f9da312b700 1 -- 172.21.15.123:0/3807095440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9c198780 con 0x7f9d9c0ff790 2024-05-06T13:55:09.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.156+0000 7f9d99ffb700 1 -- 172.21.15.123:0/3807095440 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f9d9000f690 con 0x7f9d9c0ff790 2024-05-06T13:55:09.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.156+0000 7f9da312b700 1 -- 172.21.15.123:0/3807095440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9c1917c0 con 0x7f9d9c0ff790 2024-05-06T13:55:09.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.156+0000 7f9d99ffb700 1 --2- 172.21.15.123:0/3807095440 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9d8c0383c0 0x7f9d8c03a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:09.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.156+0000 7f9d99ffb700 1 -- 172.21.15.123:0/3807095440 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9d9004c500 con 0x7f9d9c0ff790 2024-05-06T13:55:09.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.156+0000 7f9d9bfff700 1 --2- 172.21.15.123:0/3807095440 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9d8c0383c0 0x7f9d8c03a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:09.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.156+0000 7f9d9bfff700 1 --2- 172.21.15.123:0/3807095440 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9d8c0383c0 0x7f9d8c03a880 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9d88006fd0 tx=0x7f9d88006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:09.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.161+0000 7f9d99ffb700 1 -- 172.21.15.123:0/3807095440 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9d9000fe60 con 0x7f9d9c0ff790 2024-05-06T13:55:09.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.356+0000 7f9da312b700 1 -- 172.21.15.123:0/3807095440 --> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d9c061260 con 0x7f9d8c0383c0 2024-05-06T13:55:09.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.360+0000 7f9d99ffb700 1 -- 172.21.15.123:0/3807095440 <== mgr.14164 v2:172.21.15.123:6800/388885730 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9d9c061260 con 0x7f9d8c0383c0 2024-05-06T13:55:09.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.362+0000 7f9da312b700 1 -- 172.21.15.123:0/3807095440 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9d8c0383c0 msgr2=0x7f9d8c03a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:09.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.362+0000 7f9da312b700 1 --2- 172.21.15.123:0/3807095440 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9d8c0383c0 0x7f9d8c03a880 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9d88006fd0 tx=0x7f9d88006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:09.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.362+0000 7f9da312b700 1 -- 172.21.15.123:0/3807095440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d9c0ff790 msgr2=0x7f9d9c197ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:09.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.362+0000 7f9da312b700 1 --2- 172.21.15.123:0/3807095440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d9c0ff790 0x7f9d9c197ba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d90005950 tx=0x7f9d90009e60 comp rx=0 tx=0).stop 2024-05-06T13:55:09.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.362+0000 7f9da312b700 1 -- 172.21.15.123:0/3807095440 shutdown_connections 2024-05-06T13:55:09.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.362+0000 7f9da312b700 1 --2- 172.21.15.123:0/3807095440 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9d8c0383c0 0x7f9d8c03a880 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:09.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.362+0000 7f9da312b700 1 --2- 172.21.15.123:0/3807095440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d9c0ff790 0x7f9d9c197ba0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:09.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.362+0000 7f9da312b700 1 -- 172.21.15.123:0/3807095440 >> 172.21.15.123:0/3807095440 conn(0x7f9d9c0fad30 msgr2=0x7f9d9c069120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:09.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.362+0000 7f9da312b700 1 -- 172.21.15.123:0/3807095440 shutdown_connections 2024-05-06T13:55:09.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:09.362+0000 7f9da312b700 1 -- 172.21.15.123:0/3807095440 wait complete. 2024-05-06T13:55:09.927 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi174 2024-05-06T13:55:09.927 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T13:55:09.927 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/etc/ceph/ceph.conf 2024-05-06T13:55:09.946 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T13:55:09.946 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:55:10.004 INFO:tasks.cephadm:Adding host smithi174 to orchestrator... 2024-05-06T13:55:10.004 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph orch host add smithi174 2024-05-06T13:55:10.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:10 smithi123 ceph-mon[27254]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:55:10.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:10 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:10.735 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:55:12.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.804+0000 7f4f5f12d700 1 -- 172.21.15.123:0/18992819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580ff7a0 msgr2=0x7f4f580ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.804+0000 7f4f5f12d700 1 --2- 172.21.15.123:0/18992819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580ff7a0 0x7f4f580ffbc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009910 tx=0x7f4f4c009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.804+0000 7f4f5f12d700 1 -- 172.21.15.123:0/18992819 shutdown_connections 2024-05-06T13:55:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.804+0000 7f4f5f12d700 1 --2- 172.21.15.123:0/18992819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580ff7a0 0x7f4f580ffbc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.804+0000 7f4f5f12d700 1 -- 172.21.15.123:0/18992819 >> 172.21.15.123:0/18992819 conn(0x7f4f580fad20 msgr2=0x7f4f580fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.804+0000 7f4f5f12d700 1 -- 172.21.15.123:0/18992819 shutdown_connections 2024-05-06T13:55:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.804+0000 7f4f5f12d700 1 -- 172.21.15.123:0/18992819 wait complete. 2024-05-06T13:55:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.804+0000 7f4f5f12d700 1 Processor -- start 2024-05-06T13:55:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.804+0000 7f4f5f12d700 1 -- start start 2024-05-06T13:55:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.805+0000 7f4f5f12d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580ff7a0 0x7f4f58068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.805+0000 7f4f5f12d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f581986d0 con 0x7f4f580ff7a0 2024-05-06T13:55:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.805+0000 7f4f5cec9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580ff7a0 0x7f4f58068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.805+0000 7f4f5cec9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580ff7a0 0x7f4f58068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50658/0 (socket says 172.21.15.123:50658) 2024-05-06T13:55:12.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.805+0000 7f4f5cec9700 1 -- 172.21.15.123:0/3529958222 learned_addr learned my addr 172.21.15.123:0/3529958222 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:55:12.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.805+0000 7f4f5cec9700 1 -- 172.21.15.123:0/3529958222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c0095f0 con 0x7f4f580ff7a0 2024-05-06T13:55:12.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.805+0000 7f4f5cec9700 1 --2- 172.21.15.123:0/3529958222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580ff7a0 0x7f4f58068b20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c005b40 tx=0x7f4f4c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:12.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.805+0000 7f4f55ffb700 1 -- 172.21.15.123:0/3529958222 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f4c01d070 con 0x7f4f580ff7a0 2024-05-06T13:55:12.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.805+0000 7f4f5f12d700 1 -- 172.21.15.123:0/3529958222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f58198810 con 0x7f4f580ff7a0 2024-05-06T13:55:12.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.805+0000 7f4f55ffb700 1 -- 172.21.15.123:0/3529958222 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4f4c00be10 con 0x7f4f580ff7a0 2024-05-06T13:55:12.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.806+0000 7f4f5f12d700 1 -- 172.21.15.123:0/3529958222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f58198cb0 con 0x7f4f580ff7a0 2024-05-06T13:55:12.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.806+0000 7f4f55ffb700 1 -- 172.21.15.123:0/3529958222 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f4c022dc0 con 0x7f4f580ff7a0 2024-05-06T13:55:12.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.806+0000 7f4f55ffb700 1 -- 172.21.15.123:0/3529958222 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f4f4c00f460 con 0x7f4f580ff7a0 2024-05-06T13:55:12.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.807+0000 7f4f5f12d700 1 -- 172.21.15.123:0/3529958222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f58062430 con 0x7f4f580ff7a0 2024-05-06T13:55:12.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.807+0000 7f4f55ffb700 1 --2- 172.21.15.123:0/3529958222 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f4f480383c0 0x7f4f4803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:12.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.807+0000 7f4f55ffb700 1 -- 172.21.15.123:0/3529958222 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4f4c04c170 con 0x7f4f580ff7a0 2024-05-06T13:55:12.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.807+0000 7f4f57fff700 1 --2- 172.21.15.123:0/3529958222 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f4f480383c0 0x7f4f4803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:12.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.807+0000 7f4f57fff700 1 --2- 172.21.15.123:0/3529958222 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f4f480383c0 0x7f4f4803a880 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f44006fd0 tx=0x7f4f44006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:12.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:12.812+0000 7f4f55ffb700 1 -- 172.21.15.123:0/3529958222 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4f58062430 con 0x7f4f580ff7a0 2024-05-06T13:55:13.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:13.017+0000 7f4f5f12d700 1 -- 172.21.15.123:0/3529958222 --> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f580623c0 con 0x7f4f480383c0 2024-05-06T13:55:13.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:13 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:13.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:13 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:13.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:13 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:13.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:13 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:13.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:13 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi123", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T13:55:13.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:13 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi123", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-05-06T13:55:13.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:13 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:55:13.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:13 smithi123 ceph-mon[27254]: Deploying daemon crash.smithi123 on smithi123 2024-05-06T13:55:14.766 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:14 smithi123 ceph-mon[27254]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:55:14.766 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:14 smithi123 ceph-mon[27254]: Deploying cephadm binary to smithi174 2024-05-06T13:55:14.766 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:14 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:15.537 INFO:teuthology.orchestra.run.smithi123.stdout:Added host 'smithi174' with addr '172.21.15.174' 2024-05-06T13:55:15.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:15.535+0000 7f4f55ffb700 1 -- 172.21.15.123:0/3529958222 <== mgr.14164 v2:172.21.15.123:6800/388885730 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f4f580623c0 con 0x7f4f480383c0 2024-05-06T13:55:15.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:15.537+0000 7f4f5f12d700 1 -- 172.21.15.123:0/3529958222 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f4f480383c0 msgr2=0x7f4f4803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:15.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:15.537+0000 7f4f5f12d700 1 --2- 172.21.15.123:0/3529958222 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f4f480383c0 0x7f4f4803a880 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f44006fd0 tx=0x7f4f44006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:15.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:15.537+0000 7f4f5f12d700 1 -- 172.21.15.123:0/3529958222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580ff7a0 msgr2=0x7f4f58068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:15.537+0000 7f4f5f12d700 1 --2- 172.21.15.123:0/3529958222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580ff7a0 0x7f4f58068b20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c005b40 tx=0x7f4f4c004740 comp rx=0 tx=0).stop 2024-05-06T13:55:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:15.538+0000 7f4f5f12d700 1 -- 172.21.15.123:0/3529958222 shutdown_connections 2024-05-06T13:55:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:15.538+0000 7f4f5f12d700 1 --2- 172.21.15.123:0/3529958222 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f4f480383c0 0x7f4f4803a880 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:15.538+0000 7f4f5f12d700 1 --2- 172.21.15.123:0/3529958222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580ff7a0 0x7f4f58068b20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:15.538+0000 7f4f5f12d700 1 -- 172.21.15.123:0/3529958222 >> 172.21.15.123:0/3529958222 conn(0x7f4f580fad20 msgr2=0x7f4f580fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:15.538+0000 7f4f5f12d700 1 -- 172.21.15.123:0/3529958222 shutdown_connections 2024-05-06T13:55:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:15.538+0000 7f4f5f12d700 1 -- 172.21.15.123:0/3529958222 wait complete. 2024-05-06T13:55:15.816 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:15 smithi123 ceph-mon[27254]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:15.816 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:15 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:15.816 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:15 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:15.816 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:15 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:15.816 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:15 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:16.232 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-06T13:55:16.451 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:55:16.795 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:16 smithi123 ceph-mon[27254]: Deploying daemon node-exporter.smithi123 on smithi123 2024-05-06T13:55:16.796 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:16 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:16.796 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:16 smithi123 ceph-mon[27254]: Added host smithi174 2024-05-06T13:55:17.735 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:17 smithi123 ceph-mon[27254]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:18.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.276+0000 7f1666396700 1 -- 172.21.15.123:0/2964476795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16600ff7a0 msgr2=0x7f16600ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.276+0000 7f1666396700 1 --2- 172.21.15.123:0/2964476795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16600ff7a0 0x7f16600ffbc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1648009910 tx=0x7f1648009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.276+0000 7f1666396700 1 -- 172.21.15.123:0/2964476795 shutdown_connections 2024-05-06T13:55:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.276+0000 7f1666396700 1 --2- 172.21.15.123:0/2964476795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16600ff7a0 0x7f16600ffbc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.276+0000 7f1666396700 1 -- 172.21.15.123:0/2964476795 >> 172.21.15.123:0/2964476795 conn(0x7f16600fad20 msgr2=0x7f16600fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.276+0000 7f1666396700 1 -- 172.21.15.123:0/2964476795 shutdown_connections 2024-05-06T13:55:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.276+0000 7f1666396700 1 -- 172.21.15.123:0/2964476795 wait complete. 2024-05-06T13:55:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.277+0000 7f1666396700 1 Processor -- start 2024-05-06T13:55:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.277+0000 7f1666396700 1 -- start start 2024-05-06T13:55:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.277+0000 7f1666396700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16600ff7a0 0x7f16601948a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.277+0000 7f1666396700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1660194de0 con 0x7f16600ff7a0 2024-05-06T13:55:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.277+0000 7f165ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16600ff7a0 0x7f16601948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.277+0000 7f165ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16600ff7a0 0x7f16601948a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53578/0 (socket says 172.21.15.123:53578) 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.277+0000 7f165ffff700 1 -- 172.21.15.123:0/1151990144 learned_addr learned my addr 172.21.15.123:0/1151990144 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.277+0000 7f165ffff700 1 -- 172.21.15.123:0/1151990144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480095f0 con 0x7f16600ff7a0 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.277+0000 7f165ffff700 1 --2- 172.21.15.123:0/1151990144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16600ff7a0 0x7f16601948a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1648005b40 tx=0x7f1648004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.278+0000 7f165d7fa700 1 -- 172.21.15.123:0/1151990144 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f164801d070 con 0x7f16600ff7a0 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.278+0000 7f1666396700 1 -- 172.21.15.123:0/1151990144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1660194fe0 con 0x7f16600ff7a0 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.278+0000 7f165d7fa700 1 -- 172.21.15.123:0/1151990144 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f164800be10 con 0x7f16600ff7a0 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.278+0000 7f165d7fa700 1 -- 172.21.15.123:0/1151990144 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f164800f460 con 0x7f16600ff7a0 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.278+0000 7f1666396700 1 -- 172.21.15.123:0/1151990144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1660195480 con 0x7f16600ff7a0 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.278+0000 7f165d7fa700 1 -- 172.21.15.123:0/1151990144 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f164800f6d0 con 0x7f16600ff7a0 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.279+0000 7f165d7fa700 1 --2- 172.21.15.123:0/1151990144 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f164c0383c0 0x7f164c03a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.279+0000 7f165d7fa700 1 -- 172.21.15.123:0/1151990144 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f164804c520 con 0x7f16600ff7a0 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.279+0000 7f165f7fe700 1 --2- 172.21.15.123:0/1151990144 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f164c0383c0 0x7f164c03a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.279+0000 7f1666396700 1 -- 172.21.15.123:0/1151990144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166018e3c0 con 0x7f16600ff7a0 2024-05-06T13:55:18.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.279+0000 7f165f7fe700 1 --2- 172.21.15.123:0/1151990144 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f164c0383c0 0x7f164c03a880 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1650006fd0 tx=0x7f1650006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:18.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.283+0000 7f165d7fa700 1 -- 172.21.15.123:0/1151990144 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1648027070 con 0x7f16600ff7a0 2024-05-06T13:55:18.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.500+0000 7f1666396700 1 -- 172.21.15.123:0/1151990144 --> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16600611d0 con 0x7f164c0383c0 2024-05-06T13:55:18.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.501+0000 7f165d7fa700 1 -- 172.21.15.123:0/1151990144 <== mgr.14164 v2:172.21.15.123:6800/388885730 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f16600611d0 con 0x7f164c0383c0 2024-05-06T13:55:18.502 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:55:18.502 INFO:teuthology.orchestra.run.smithi123.stdout:[{"addr": "172.21.15.123", "hostname": "smithi123", "labels": [], "status": ""}, {"addr": "172.21.15.174", "hostname": "smithi174", "labels": [], "status": ""}] 2024-05-06T13:55:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.504+0000 7f1666396700 1 -- 172.21.15.123:0/1151990144 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f164c0383c0 msgr2=0x7f164c03a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.504+0000 7f1666396700 1 --2- 172.21.15.123:0/1151990144 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f164c0383c0 0x7f164c03a880 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1650006fd0 tx=0x7f1650006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.504+0000 7f1666396700 1 -- 172.21.15.123:0/1151990144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16600ff7a0 msgr2=0x7f16601948a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.504+0000 7f1666396700 1 --2- 172.21.15.123:0/1151990144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16600ff7a0 0x7f16601948a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1648005b40 tx=0x7f1648004740 comp rx=0 tx=0).stop 2024-05-06T13:55:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.504+0000 7f1666396700 1 -- 172.21.15.123:0/1151990144 shutdown_connections 2024-05-06T13:55:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.504+0000 7f1666396700 1 --2- 172.21.15.123:0/1151990144 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f164c0383c0 0x7f164c03a880 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.504+0000 7f1666396700 1 --2- 172.21.15.123:0/1151990144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16600ff7a0 0x7f16601948a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.504+0000 7f1666396700 1 -- 172.21.15.123:0/1151990144 >> 172.21.15.123:0/1151990144 conn(0x7f16600fad20 msgr2=0x7f16600fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.504+0000 7f1666396700 1 -- 172.21.15.123:0/1151990144 shutdown_connections 2024-05-06T13:55:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:18.504+0000 7f1666396700 1 -- 172.21.15.123:0/1151990144 wait complete. 2024-05-06T13:55:19.561 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-06T13:55:19.561 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-06T13:55:19.794 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:19 smithi123 ceph-mon[27254]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:19.795 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:19 smithi123 ceph-mon[27254]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T13:55:19.795 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:19 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:20.026 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:55:21.162 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:21 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:21.162 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:21 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:21.162 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:21 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:21.162 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:21 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:21.163 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:21 smithi123 ceph-mon[27254]: Deploying daemon alertmanager.smithi123 on smithi123 2024-05-06T13:55:21.163 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:21 smithi123 ceph-mon[27254]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.626+0000 7f9d5cd22700 1 -- 172.21.15.123:0/491783160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d581008b0 msgr2=0x7f9d58100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.626+0000 7f9d5cd22700 1 --2- 172.21.15.123:0/491783160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d581008b0 0x7f9d58100cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009910 tx=0x7f9d48009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.626+0000 7f9d5cd22700 1 -- 172.21.15.123:0/491783160 shutdown_connections 2024-05-06T13:55:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.626+0000 7f9d5cd22700 1 --2- 172.21.15.123:0/491783160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d581008b0 0x7f9d58100cd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.626+0000 7f9d5cd22700 1 -- 172.21.15.123:0/491783160 >> 172.21.15.123:0/491783160 conn(0x7f9d580fbe30 msgr2=0x7f9d580fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.626+0000 7f9d5cd22700 1 -- 172.21.15.123:0/491783160 shutdown_connections 2024-05-06T13:55:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.626+0000 7f9d5cd22700 1 -- 172.21.15.123:0/491783160 wait complete. 2024-05-06T13:55:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.627+0000 7f9d5cd22700 1 Processor -- start 2024-05-06T13:55:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.627+0000 7f9d5cd22700 1 -- start start 2024-05-06T13:55:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.627+0000 7f9d5cd22700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d581008b0 0x7f9d581959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.627+0000 7f9d5cd22700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58195f10 con 0x7f9d581008b0 2024-05-06T13:55:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.627+0000 7f9d5659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d581008b0 0x7f9d581959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.627+0000 7f9d5659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d581008b0 0x7f9d581959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53602/0 (socket says 172.21.15.123:53602) 2024-05-06T13:55:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.627+0000 7f9d5659c700 1 -- 172.21.15.123:0/2757079022 learned_addr learned my addr 172.21.15.123:0/2757079022 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:55:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.628+0000 7f9d5659c700 1 -- 172.21.15.123:0/2757079022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d480095f0 con 0x7f9d581008b0 2024-05-06T13:55:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.628+0000 7f9d5659c700 1 --2- 172.21.15.123:0/2757079022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d581008b0 0x7f9d581959d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9d48005950 tx=0x7f9d48009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.628+0000 7f9d477fe700 1 -- 172.21.15.123:0/2757079022 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d4801d070 con 0x7f9d581008b0 2024-05-06T13:55:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.628+0000 7f9d477fe700 1 -- 172.21.15.123:0/2757079022 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d4800be10 con 0x7f9d581008b0 2024-05-06T13:55:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.628+0000 7f9d5cd22700 1 -- 172.21.15.123:0/2757079022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d58196110 con 0x7f9d581008b0 2024-05-06T13:55:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.628+0000 7f9d477fe700 1 -- 172.21.15.123:0/2757079022 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d4800f460 con 0x7f9d581008b0 2024-05-06T13:55:21.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.628+0000 7f9d5cd22700 1 -- 172.21.15.123:0/2757079022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d581965b0 con 0x7f9d581008b0 2024-05-06T13:55:21.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.629+0000 7f9d477fe700 1 -- 172.21.15.123:0/2757079022 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f9d4800f690 con 0x7f9d581008b0 2024-05-06T13:55:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.629+0000 7f9d5cd22700 1 -- 172.21.15.123:0/2757079022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5818f4d0 con 0x7f9d581008b0 2024-05-06T13:55:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.629+0000 7f9d477fe700 1 --2- 172.21.15.123:0/2757079022 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9d400383c0 0x7f9d4003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.629+0000 7f9d477fe700 1 -- 172.21.15.123:0/2757079022 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9d4804c400 con 0x7f9d581008b0 2024-05-06T13:55:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.629+0000 7f9d55d9b700 1 --2- 172.21.15.123:0/2757079022 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9d400383c0 0x7f9d4003a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.630+0000 7f9d55d9b700 1 --2- 172.21.15.123:0/2757079022 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9d400383c0 0x7f9d4003a880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c006fd0 tx=0x7f9d4c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.634+0000 7f9d477fe700 1 -- 172.21.15.123:0/2757079022 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9d4802a360 con 0x7f9d581008b0 2024-05-06T13:55:21.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:21.833+0000 7f9d5cd22700 1 -- 172.21.15.123:0/2757079022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9d5802cc70 con 0x7f9d581008b0 2024-05-06T13:55:22.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:22.097+0000 7f9d477fe700 1 -- 172.21.15.123:0/2757079022 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9d48027070 con 0x7f9d581008b0 2024-05-06T13:55:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:22.099+0000 7f9d5cd22700 1 -- 172.21.15.123:0/2757079022 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9d400383c0 msgr2=0x7f9d4003a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:22.099+0000 7f9d5cd22700 1 --2- 172.21.15.123:0/2757079022 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9d400383c0 0x7f9d4003a880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c006fd0 tx=0x7f9d4c006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:22.099+0000 7f9d5cd22700 1 -- 172.21.15.123:0/2757079022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d581008b0 msgr2=0x7f9d581959d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:22.099+0000 7f9d5cd22700 1 --2- 172.21.15.123:0/2757079022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d581008b0 0x7f9d581959d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9d48005950 tx=0x7f9d48009e60 comp rx=0 tx=0).stop 2024-05-06T13:55:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:22.099+0000 7f9d5cd22700 1 -- 172.21.15.123:0/2757079022 shutdown_connections 2024-05-06T13:55:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:22.099+0000 7f9d5cd22700 1 --2- 172.21.15.123:0/2757079022 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9d400383c0 0x7f9d4003a880 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:22.099+0000 7f9d5cd22700 1 --2- 172.21.15.123:0/2757079022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d581008b0 0x7f9d581959d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:22.099+0000 7f9d5cd22700 1 -- 172.21.15.123:0/2757079022 >> 172.21.15.123:0/2757079022 conn(0x7f9d580fbe30 msgr2=0x7f9d580fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:22.099+0000 7f9d5cd22700 1 -- 172.21.15.123:0/2757079022 shutdown_connections 2024-05-06T13:55:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:55:22.099+0000 7f9d5cd22700 1 -- 172.21.15.123:0/2757079022 wait complete. 2024-05-06T13:55:22.102 INFO:teuthology.orchestra.run.smithi123.stderr:adjusted tunables profile to default 2024-05-06T13:55:22.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:22 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2757079022' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-06T13:55:23.187 INFO:tasks.cephadm:Adding mon.smithi123 on smithi123 2024-05-06T13:55:23.187 INFO:tasks.cephadm:Adding mon.smithi174 on smithi174 2024-05-06T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph orch apply mon '2;smithi123:172.21.15.123=smithi123;smithi174:172.21.15.174=smithi174' 2024-05-06T13:55:23.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:23 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2757079022' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-06T13:55:23.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:23 smithi123 ceph-mon[27254]: osdmap e4: 0 total, 0 up, 0 in 2024-05-06T13:55:23.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:23 smithi123 ceph-mon[27254]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:23.416 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:23.463 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:24.919 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.916+0000 7f80c9748700 1 -- 172.21.15.174:0/2987584881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c40ff7a0 msgr2=0x7f80c40ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:24.919 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.916+0000 7f80c9748700 1 --2- 172.21.15.174:0/2987584881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c40ff7a0 0x7f80c40ffbc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009910 tx=0x7f80ac009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:24.919 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.916+0000 7f80c9748700 1 -- 172.21.15.174:0/2987584881 shutdown_connections 2024-05-06T13:55:24.919 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.916+0000 7f80c9748700 1 --2- 172.21.15.174:0/2987584881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c40ff7a0 0x7f80c40ffbc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:24.919 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.916+0000 7f80c9748700 1 -- 172.21.15.174:0/2987584881 >> 172.21.15.174:0/2987584881 conn(0x7f80c40fad20 msgr2=0x7f80c40fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:24.919 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.917+0000 7f80c9748700 1 -- 172.21.15.174:0/2987584881 shutdown_connections 2024-05-06T13:55:24.919 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.917+0000 7f80c9748700 1 -- 172.21.15.174:0/2987584881 wait complete. 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.917+0000 7f80c9748700 1 Processor -- start 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.917+0000 7f80c9748700 1 -- start start 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.918+0000 7f80c9748700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c40ff7a0 0x7f80c4068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.918+0000 7f80c9748700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c41986f0 con 0x7f80c40ff7a0 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.918+0000 7f80c2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c40ff7a0 0x7f80c4068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.918+0000 7f80c2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c40ff7a0 0x7f80c4068b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:56460/0 (socket says 172.21.15.174:56460) 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.918+0000 7f80c2ffd700 1 -- 172.21.15.174:0/604208404 learned_addr learned my addr 172.21.15.174:0/604208404 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.918+0000 7f80c2ffd700 1 -- 172.21.15.174:0/604208404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac0095f0 con 0x7f80c40ff7a0 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.918+0000 7f80c2ffd700 1 --2- 172.21.15.174:0/604208404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c40ff7a0 0x7f80c4068b00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005b40 tx=0x7f80ac004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.918+0000 7f80bbfff700 1 -- 172.21.15.174:0/604208404 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80ac01d070 con 0x7f80c40ff7a0 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.918+0000 7f80c9748700 1 -- 172.21.15.174:0/604208404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c4198830 con 0x7f80c40ff7a0 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.918+0000 7f80bbfff700 1 -- 172.21.15.174:0/604208404 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f80ac00be10 con 0x7f80c40ff7a0 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.918+0000 7f80bbfff700 1 -- 172.21.15.174:0/604208404 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80ac00f460 con 0x7f80c40ff7a0 2024-05-06T13:55:24.920 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.919+0000 7f80c9748700 1 -- 172.21.15.174:0/604208404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c4198cd0 con 0x7f80c40ff7a0 2024-05-06T13:55:24.921 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.919+0000 7f80bbfff700 1 -- 172.21.15.174:0/604208404 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f80ac00f6d0 con 0x7f80c40ff7a0 2024-05-06T13:55:24.921 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.919+0000 7f80bbfff700 1 --2- 172.21.15.174:0/604208404 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f80b00383c0 0x7f80b003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:24.921 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.919+0000 7f80bbfff700 1 -- 172.21.15.174:0/604208404 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f80ac04c4c0 con 0x7f80c40ff7a0 2024-05-06T13:55:24.922 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.920+0000 7f80c9748700 1 -- 172.21.15.174:0/604208404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c418e3c0 con 0x7f80c40ff7a0 2024-05-06T13:55:24.922 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.920+0000 7f80c27fc700 1 --2- 172.21.15.174:0/604208404 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f80b00383c0 0x7f80b003a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:24.922 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.920+0000 7f80c27fc700 1 --2- 172.21.15.174:0/604208404 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f80b00383c0 0x7f80b003a880 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f80b4006fd0 tx=0x7f80b4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:24.925 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:24.925+0000 7f80bbfff700 1 -- 172.21.15.174:0/604208404 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f80ac027070 con 0x7f80c40ff7a0 2024-05-06T13:55:25.124 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:25.123+0000 7f80c9748700 1 -- 172.21.15.174:0/604208404 --> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi123:172.21.15.123=smithi123;smithi174:172.21.15.174=smithi174", "target": ["mon-mgr", ""]}) v1 -- 0x7f80c4061340 con 0x7f80b00383c0 2024-05-06T13:55:25.130 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:25.129+0000 7f80bbfff700 1 -- 172.21.15.174:0/604208404 <== mgr.14164 v2:172.21.15.123:6800/388885730 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f80c4061340 con 0x7f80b00383c0 2024-05-06T13:55:25.130 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mon update... 2024-05-06T13:55:25.132 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:25.131+0000 7f80c9748700 1 -- 172.21.15.174:0/604208404 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f80b00383c0 msgr2=0x7f80b003a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:25.132 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:25.131+0000 7f80c9748700 1 --2- 172.21.15.174:0/604208404 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f80b00383c0 0x7f80b003a880 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f80b4006fd0 tx=0x7f80b4006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:25.132 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:25.131+0000 7f80c9748700 1 -- 172.21.15.174:0/604208404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c40ff7a0 msgr2=0x7f80c4068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:25.132 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:25.131+0000 7f80c9748700 1 --2- 172.21.15.174:0/604208404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c40ff7a0 0x7f80c4068b00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005b40 tx=0x7f80ac004740 comp rx=0 tx=0).stop 2024-05-06T13:55:25.132 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:25.131+0000 7f80c9748700 1 -- 172.21.15.174:0/604208404 shutdown_connections 2024-05-06T13:55:25.132 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:25.131+0000 7f80c9748700 1 --2- 172.21.15.174:0/604208404 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f80b00383c0 0x7f80b003a880 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:25.132 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:25.131+0000 7f80c9748700 1 --2- 172.21.15.174:0/604208404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c40ff7a0 0x7f80c4068b00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:25.132 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:25.131+0000 7f80c9748700 1 -- 172.21.15.174:0/604208404 >> 172.21.15.174:0/604208404 conn(0x7f80c40fad20 msgr2=0x7f80c40fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:25.132 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:25.131+0000 7f80c9748700 1 -- 172.21.15.174:0/604208404 shutdown_connections 2024-05-06T13:55:25.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:25.131+0000 7f80c9748700 1 -- 172.21.15.174:0/604208404 wait complete. 2024-05-06T13:55:25.518 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:25 smithi123 ceph-mon[27254]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:25.518 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:25 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:25.518 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:25 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:25.718 DEBUG:teuthology.orchestra.run.smithi174:mon.smithi174> sudo journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mon.smithi174.service 2024-05-06T13:55:25.720 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:55:25.721 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:55:25.950 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:26.008 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:26.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:26 smithi123 ceph-mon[27254]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi123:172.21.15.123=smithi123;smithi174:172.21.15.174=smithi174", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:55:26.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:26 smithi123 ceph-mon[27254]: Saving service mon spec with placement smithi123:172.21.15.123=smithi123;smithi174:172.21.15.174=smithi174;count:2 2024-05-06T13:55:27.435 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.434+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/2180293620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf4101390 msgr2=0x7f0cf4103780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:27.435 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.434+0000 7f0cfb5a0700 1 --2- 172.21.15.174:0/2180293620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf4101390 0x7f0cf4103780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009910 tx=0x7f0cf0009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:27.435 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.434+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/2180293620 shutdown_connections 2024-05-06T13:55:27.435 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.434+0000 7f0cfb5a0700 1 --2- 172.21.15.174:0/2180293620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf4101390 0x7f0cf4103780 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:27.435 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.434+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/2180293620 >> 172.21.15.174:0/2180293620 conn(0x7f0cf40fad20 msgr2=0x7f0cf40fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:27.436 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.434+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/2180293620 shutdown_connections 2024-05-06T13:55:27.436 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.434+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/2180293620 wait complete. 2024-05-06T13:55:27.437 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.435+0000 7f0cfb5a0700 1 Processor -- start 2024-05-06T13:55:27.437 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.435+0000 7f0cfb5a0700 1 -- start start 2024-05-06T13:55:27.437 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.435+0000 7f0cfb5a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf4101390 0x7f0cf4195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:27.437 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.435+0000 7f0cfb5a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4195ec0 con 0x7f0cf4101390 2024-05-06T13:55:27.437 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.436+0000 7f0cf933c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf4101390 0x7f0cf4195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:27.438 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.436+0000 7f0cf933c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf4101390 0x7f0cf4195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:56484/0 (socket says 172.21.15.174:56484) 2024-05-06T13:55:27.438 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.436+0000 7f0cf933c700 1 -- 172.21.15.174:0/3174355444 learned_addr learned my addr 172.21.15.174:0/3174355444 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:55:27.438 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.436+0000 7f0cf933c700 1 -- 172.21.15.174:0/3174355444 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf00095f0 con 0x7f0cf4101390 2024-05-06T13:55:27.438 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.436+0000 7f0cf933c700 1 --2- 172.21.15.174:0/3174355444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf4101390 0x7f0cf4195980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0005b40 tx=0x7f0cf0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:27.438 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.436+0000 7f0cea7fc700 1 -- 172.21.15.174:0/3174355444 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cf001d070 con 0x7f0cf4101390 2024-05-06T13:55:27.438 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.436+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/3174355444 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf41960c0 con 0x7f0cf4101390 2024-05-06T13:55:27.438 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.436+0000 7f0cea7fc700 1 -- 172.21.15.174:0/3174355444 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0cf000be10 con 0x7f0cf4101390 2024-05-06T13:55:27.438 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.436+0000 7f0cea7fc700 1 -- 172.21.15.174:0/3174355444 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cf000f460 con 0x7f0cf4101390 2024-05-06T13:55:27.438 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.436+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/3174355444 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf4196560 con 0x7f0cf4101390 2024-05-06T13:55:27.439 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.437+0000 7f0cea7fc700 1 -- 172.21.15.174:0/3174355444 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f0cf000b960 con 0x7f0cf4101390 2024-05-06T13:55:27.439 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.437+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/3174355444 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf418f4c0 con 0x7f0cf4101390 2024-05-06T13:55:27.439 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.437+0000 7f0cea7fc700 1 --2- 172.21.15.174:0/3174355444 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f0ce00383c0 0x7f0ce003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:27.439 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.438+0000 7f0cea7fc700 1 -- 172.21.15.174:0/3174355444 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0cf004c4b0 con 0x7f0cf4101390 2024-05-06T13:55:27.439 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.438+0000 7f0cf8b3b700 1 --2- 172.21.15.174:0/3174355444 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f0ce00383c0 0x7f0ce003a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:27.439 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.438+0000 7f0cf8b3b700 1 --2- 172.21.15.174:0/3174355444 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f0ce00383c0 0x7f0ce003a880 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4006fd0 tx=0x7f0ce4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:27.443 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.443+0000 7f0cea7fc700 1 -- 172.21.15.174:0/3174355444 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0cf002a360 con 0x7f0cf4101390 2024-05-06T13:55:27.704 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.704+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/3174355444 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0cf402cc70 con 0x7f0cf4101390 2024-05-06T13:55:27.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.705+0000 7f0cea7fc700 1 -- 172.21.15.174:0/3174355444 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f0cf0027030 con 0x7f0cf4101390 2024-05-06T13:55:27.705 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:55:27.705 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:55:27.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.707+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/3174355444 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f0ce00383c0 msgr2=0x7f0ce003a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:27.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.707+0000 7f0cfb5a0700 1 --2- 172.21.15.174:0/3174355444 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f0ce00383c0 0x7f0ce003a880 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4006fd0 tx=0x7f0ce4006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:27.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.707+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/3174355444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf4101390 msgr2=0x7f0cf4195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:27.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.707+0000 7f0cfb5a0700 1 --2- 172.21.15.174:0/3174355444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf4101390 0x7f0cf4195980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0005b40 tx=0x7f0cf0004740 comp rx=0 tx=0).stop 2024-05-06T13:55:27.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.707+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/3174355444 shutdown_connections 2024-05-06T13:55:27.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.707+0000 7f0cfb5a0700 1 --2- 172.21.15.174:0/3174355444 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f0ce00383c0 0x7f0ce003a880 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:27.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.707+0000 7f0cfb5a0700 1 --2- 172.21.15.174:0/3174355444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf4101390 0x7f0cf4195980 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:27.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.707+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/3174355444 >> 172.21.15.174:0/3174355444 conn(0x7f0cf40fad20 msgr2=0x7f0cf40fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:27.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.707+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/3174355444 shutdown_connections 2024-05-06T13:55:27.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:27.707+0000 7f0cfb5a0700 1 -- 172.21.15.174:0/3174355444 wait complete. 2024-05-06T13:55:27.709 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:55:27.835 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:27 smithi123 ceph-mon[27254]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:28.600 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:28 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/3174355444' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:55:29.302 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:55:29.302 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:55:29.507 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:29.554 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:29.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:29 smithi123 ceph-mon[27254]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:29.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:29 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:29.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:29 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:29.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:29 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:29.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:29 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:29.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:29 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:29.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:29 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:29.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:29 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:29.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:29 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:29.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:29 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:55:29.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:29 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:29.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:29 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:30.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:30 smithi123 ceph-mon[27254]: Regenerating cephadm self-signed grafana TLS certificates 2024-05-06T13:55:30.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:30 smithi123 ceph-mon[27254]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:55:30.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:30 smithi123 ceph-mon[27254]: Deploying daemon grafana.smithi123 on smithi123 2024-05-06T13:55:31.040 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.038+0000 7f2e40771700 1 -- 172.21.15.174:0/3827175077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e380ff790 msgr2=0x7f2e380ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:31.040 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.038+0000 7f2e40771700 1 --2- 172.21.15.174:0/3827175077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e380ff790 0x7f2e380ffbb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009910 tx=0x7f2e28009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:31.040 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.039+0000 7f2e40771700 1 -- 172.21.15.174:0/3827175077 shutdown_connections 2024-05-06T13:55:31.040 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.039+0000 7f2e40771700 1 --2- 172.21.15.174:0/3827175077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e380ff790 0x7f2e380ffbb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:31.040 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.039+0000 7f2e40771700 1 -- 172.21.15.174:0/3827175077 >> 172.21.15.174:0/3827175077 conn(0x7f2e380fad30 msgr2=0x7f2e380fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:31.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.039+0000 7f2e40771700 1 -- 172.21.15.174:0/3827175077 shutdown_connections 2024-05-06T13:55:31.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.039+0000 7f2e40771700 1 -- 172.21.15.174:0/3827175077 wait complete. 2024-05-06T13:55:31.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.039+0000 7f2e40771700 1 Processor -- start 2024-05-06T13:55:31.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.039+0000 7f2e40771700 1 -- start start 2024-05-06T13:55:31.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.039+0000 7f2e40771700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e380ff790 0x7f2e38069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:31.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.039+0000 7f2e40771700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e381986c0 con 0x7f2e380ff790 2024-05-06T13:55:31.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.040+0000 7f2e3e50d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e380ff790 0x7f2e38069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:31.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.040+0000 7f2e3e50d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e380ff790 0x7f2e38069410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:48512/0 (socket says 172.21.15.174:48512) 2024-05-06T13:55:31.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.040+0000 7f2e3e50d700 1 -- 172.21.15.174:0/1296775439 learned_addr learned my addr 172.21.15.174:0/1296775439 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:55:31.041 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.040+0000 7f2e3e50d700 1 -- 172.21.15.174:0/1296775439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e280095f0 con 0x7f2e380ff790 2024-05-06T13:55:31.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.040+0000 7f2e3e50d700 1 --2- 172.21.15.174:0/1296775439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e380ff790 0x7f2e38069410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009f20 tx=0x7f2e28004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:31.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.040+0000 7f2e2f7fe700 1 -- 172.21.15.174:0/1296775439 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e2801d070 con 0x7f2e380ff790 2024-05-06T13:55:31.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.040+0000 7f2e40771700 1 -- 172.21.15.174:0/1296775439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e38198800 con 0x7f2e380ff790 2024-05-06T13:55:31.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.040+0000 7f2e2f7fe700 1 -- 172.21.15.174:0/1296775439 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2e2800be10 con 0x7f2e380ff790 2024-05-06T13:55:31.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.040+0000 7f2e2f7fe700 1 -- 172.21.15.174:0/1296775439 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e2800f460 con 0x7f2e380ff790 2024-05-06T13:55:31.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.040+0000 7f2e40771700 1 -- 172.21.15.174:0/1296775439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e38198ca0 con 0x7f2e380ff790 2024-05-06T13:55:31.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.041+0000 7f2e2f7fe700 1 -- 172.21.15.174:0/1296775439 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f2e2800f6d0 con 0x7f2e380ff790 2024-05-06T13:55:31.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.041+0000 7f2e2f7fe700 1 --2- 172.21.15.174:0/1296775439 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2e240383c0 0x7f2e2403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:31.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.041+0000 7f2e2f7fe700 1 -- 172.21.15.174:0/1296775439 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2e2804c460 con 0x7f2e380ff790 2024-05-06T13:55:31.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.041+0000 7f2e40771700 1 -- 172.21.15.174:0/1296775439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3818e3b0 con 0x7f2e380ff790 2024-05-06T13:55:31.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.041+0000 7f2e3dd0c700 1 --2- 172.21.15.174:0/1296775439 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2e240383c0 0x7f2e2403a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:31.043 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.042+0000 7f2e3dd0c700 1 --2- 172.21.15.174:0/1296775439 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2e240383c0 0x7f2e2403a880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2e34006fd0 tx=0x7f2e34006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:31.047 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.047+0000 7f2e2f7fe700 1 -- 172.21.15.174:0/1296775439 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2e28027070 con 0x7f2e380ff790 2024-05-06T13:55:31.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.309+0000 7f2e40771700 1 -- 172.21.15.174:0/1296775439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2e3802cc70 con 0x7f2e380ff790 2024-05-06T13:55:31.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.310+0000 7f2e2f7fe700 1 -- 172.21.15.174:0/1296775439 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f2e28005c00 con 0x7f2e380ff790 2024-05-06T13:55:31.310 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:55:31.310 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:55:31.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.311+0000 7f2e40771700 1 -- 172.21.15.174:0/1296775439 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2e240383c0 msgr2=0x7f2e2403a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:31.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.311+0000 7f2e40771700 1 --2- 172.21.15.174:0/1296775439 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2e240383c0 0x7f2e2403a880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2e34006fd0 tx=0x7f2e34006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:31.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.311+0000 7f2e40771700 1 -- 172.21.15.174:0/1296775439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e380ff790 msgr2=0x7f2e38069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:31.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.311+0000 7f2e40771700 1 --2- 172.21.15.174:0/1296775439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e380ff790 0x7f2e38069410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009f20 tx=0x7f2e28004690 comp rx=0 tx=0).stop 2024-05-06T13:55:31.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.312+0000 7f2e40771700 1 -- 172.21.15.174:0/1296775439 shutdown_connections 2024-05-06T13:55:31.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.312+0000 7f2e40771700 1 --2- 172.21.15.174:0/1296775439 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2e240383c0 0x7f2e2403a880 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:31.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.312+0000 7f2e40771700 1 --2- 172.21.15.174:0/1296775439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e380ff790 0x7f2e38069410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:31.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.312+0000 7f2e40771700 1 -- 172.21.15.174:0/1296775439 >> 172.21.15.174:0/1296775439 conn(0x7f2e380fad30 msgr2=0x7f2e380fb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:31.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.312+0000 7f2e40771700 1 -- 172.21.15.174:0/1296775439 shutdown_connections 2024-05-06T13:55:31.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:31.312+0000 7f2e40771700 1 -- 172.21.15.174:0/1296775439 wait complete. 2024-05-06T13:55:31.313 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:55:31.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:31 smithi123 ceph-mon[27254]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:31.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:31 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/1296775439' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:55:32.822 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:55:32.822 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:55:33.022 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:33.068 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:33.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:33 smithi123 ceph-mon[27254]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:34.555 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.553+0000 7f8ba6340700 1 -- 172.21.15.174:0/1040349697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ba00ff7a0 msgr2=0x7f8ba00ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:34.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.553+0000 7f8ba6340700 1 --2- 172.21.15.174:0/1040349697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ba00ff7a0 0x7f8ba00ffbc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009910 tx=0x7f8b94009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:34.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.553+0000 7f8ba6340700 1 -- 172.21.15.174:0/1040349697 shutdown_connections 2024-05-06T13:55:34.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.553+0000 7f8ba6340700 1 --2- 172.21.15.174:0/1040349697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ba00ff7a0 0x7f8ba00ffbc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:34.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.553+0000 7f8ba6340700 1 -- 172.21.15.174:0/1040349697 >> 172.21.15.174:0/1040349697 conn(0x7f8ba00fad20 msgr2=0x7f8ba00fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:34.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.553+0000 7f8ba6340700 1 -- 172.21.15.174:0/1040349697 shutdown_connections 2024-05-06T13:55:34.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.553+0000 7f8ba6340700 1 -- 172.21.15.174:0/1040349697 wait complete. 2024-05-06T13:55:34.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.554+0000 7f8ba6340700 1 Processor -- start 2024-05-06T13:55:34.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.554+0000 7f8ba6340700 1 -- start start 2024-05-06T13:55:34.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.554+0000 7f8ba6340700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ba00ff7a0 0x7f8ba0193760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:34.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.554+0000 7f8ba6340700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba0193ca0 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.554+0000 7f8b9ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ba00ff7a0 0x7f8ba0193760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.554+0000 7f8b9ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ba00ff7a0 0x7f8ba0193760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:48536/0 (socket says 172.21.15.174:48536) 2024-05-06T13:55:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.554+0000 7f8b9ffff700 1 -- 172.21.15.174:0/3046668737 learned_addr learned my addr 172.21.15.174:0/3046668737 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:55:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.555+0000 7f8b9ffff700 1 -- 172.21.15.174:0/3046668737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940095f0 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.555+0000 7f8b9ffff700 1 --2- 172.21.15.174:0/3046668737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ba00ff7a0 0x7f8ba0193760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8b94005b40 tx=0x7f8b94004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.555+0000 7f8b9d7fa700 1 -- 172.21.15.174:0/3046668737 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b9401d070 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.555+0000 7f8b9d7fa700 1 -- 172.21.15.174:0/3046668737 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8b9400be10 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.555+0000 7f8b9d7fa700 1 -- 172.21.15.174:0/3046668737 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b9400f460 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.555+0000 7f8ba6340700 1 -- 172.21.15.174:0/3046668737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba0193ea0 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.555+0000 7f8ba6340700 1 -- 172.21.15.174:0/3046668737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba0194340 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.556+0000 7f8b9d7fa700 1 -- 172.21.15.174:0/3046668737 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f8b9400b960 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.556+0000 7f8b9d7fa700 1 --2- 172.21.15.174:0/3046668737 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f8b8803a620 0x7f8b8803cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:34.559 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.556+0000 7f8ba6340700 1 -- 172.21.15.174:0/3046668737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba018d2b0 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.559 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.556+0000 7f8b9d7fa700 1 -- 172.21.15.174:0/3046668737 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8b9404c480 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.559 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.556+0000 7f8b9f7fe700 1 --2- 172.21.15.174:0/3046668737 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f8b8803a620 0x7f8b8803cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:34.559 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.557+0000 7f8b9f7fe700 1 --2- 172.21.15.174:0/3046668737 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f8b8803a620 0x7f8b8803cae0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8b90006fd0 tx=0x7f8b90006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:34.562 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.561+0000 7f8b9d7fa700 1 -- 172.21.15.174:0/3046668737 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8b94027030 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.825 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.823+0000 7f8ba6340700 1 -- 172.21.15.174:0/3046668737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8ba002cc70 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.825 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.823+0000 7f8b9d7fa700 1 -- 172.21.15.174:0/3046668737 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f8b9402a360 con 0x7f8ba00ff7a0 2024-05-06T13:55:34.825 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:55:34.825 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:55:34.828 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.825+0000 7f8ba6340700 1 -- 172.21.15.174:0/3046668737 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f8b8803a620 msgr2=0x7f8b8803cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:34.828 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.825+0000 7f8ba6340700 1 --2- 172.21.15.174:0/3046668737 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f8b8803a620 0x7f8b8803cae0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8b90006fd0 tx=0x7f8b90006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:34.828 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.825+0000 7f8ba6340700 1 -- 172.21.15.174:0/3046668737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ba00ff7a0 msgr2=0x7f8ba0193760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:34.828 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.825+0000 7f8ba6340700 1 --2- 172.21.15.174:0/3046668737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ba00ff7a0 0x7f8ba0193760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8b94005b40 tx=0x7f8b94004740 comp rx=0 tx=0).stop 2024-05-06T13:55:34.828 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.825+0000 7f8ba6340700 1 -- 172.21.15.174:0/3046668737 shutdown_connections 2024-05-06T13:55:34.828 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.825+0000 7f8ba6340700 1 --2- 172.21.15.174:0/3046668737 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f8b8803a620 0x7f8b8803cae0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:34.828 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.825+0000 7f8ba6340700 1 --2- 172.21.15.174:0/3046668737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ba00ff7a0 0x7f8ba0193760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:34.828 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.825+0000 7f8ba6340700 1 -- 172.21.15.174:0/3046668737 >> 172.21.15.174:0/3046668737 conn(0x7f8ba00fad20 msgr2=0x7f8ba00fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:34.828 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.826+0000 7f8ba6340700 1 -- 172.21.15.174:0/3046668737 shutdown_connections 2024-05-06T13:55:34.828 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:34.826+0000 7f8ba6340700 1 -- 172.21.15.174:0/3046668737 wait complete. 2024-05-06T13:55:34.828 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:55:35.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:35 smithi123 ceph-mon[27254]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:35.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:35 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/3046668737' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:55:36.367 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:55:36.368 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:55:36.559 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:36.608 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:37.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:37 smithi123 ceph-mon[27254]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:37.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.949+0000 7fafc9ffb700 1 -- 172.21.15.174:0/2128746791 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafbc0055b0 con 0x7fafcc1008b0 2024-05-06T13:55:37.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.950+0000 7fafd1675700 1 -- 172.21.15.174:0/2128746791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafcc1008b0 msgr2=0x7fafcc100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:37.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.950+0000 7fafd1675700 1 --2- 172.21.15.174:0/2128746791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafcc1008b0 0x7fafcc100cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009910 tx=0x7fafbc009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:37.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.950+0000 7fafd1675700 1 -- 172.21.15.174:0/2128746791 shutdown_connections 2024-05-06T13:55:37.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.950+0000 7fafd1675700 1 --2- 172.21.15.174:0/2128746791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafcc1008b0 0x7fafcc100cd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:37.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.950+0000 7fafd1675700 1 -- 172.21.15.174:0/2128746791 >> 172.21.15.174:0/2128746791 conn(0x7fafcc0fbe30 msgr2=0x7fafcc0fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:37.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.950+0000 7fafd1675700 1 -- 172.21.15.174:0/2128746791 shutdown_connections 2024-05-06T13:55:37.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.950+0000 7fafd1675700 1 -- 172.21.15.174:0/2128746791 wait complete. 2024-05-06T13:55:37.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.950+0000 7fafd1675700 1 Processor -- start 2024-05-06T13:55:37.954 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.951+0000 7fafd1675700 1 -- start start 2024-05-06T13:55:37.954 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.951+0000 7fafd1675700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafcc1008b0 0x7fafcc1959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:37.954 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.951+0000 7fafd1675700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc195f20 con 0x7fafcc1008b0 2024-05-06T13:55:37.954 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.951+0000 7fafcaffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafcc1008b0 0x7fafcc1959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:37.954 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.951+0000 7fafcaffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafcc1008b0 0x7fafcc1959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:48542/0 (socket says 172.21.15.174:48542) 2024-05-06T13:55:37.954 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.951+0000 7fafcaffd700 1 -- 172.21.15.174:0/2806167456 learned_addr learned my addr 172.21.15.174:0/2806167456 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:55:37.954 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.951+0000 7fafcaffd700 1 -- 172.21.15.174:0/2806167456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc0095f0 con 0x7fafcc1008b0 2024-05-06T13:55:37.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.951+0000 7fafcaffd700 1 --2- 172.21.15.174:0/2806167456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafcc1008b0 0x7fafcc1959e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fafbc005b40 tx=0x7fafbc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:37.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.951+0000 7fafb3fff700 1 -- 172.21.15.174:0/2806167456 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafbc01d070 con 0x7fafcc1008b0 2024-05-06T13:55:37.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.951+0000 7fafd1675700 1 -- 172.21.15.174:0/2806167456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc196120 con 0x7fafcc1008b0 2024-05-06T13:55:37.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.951+0000 7fafb3fff700 1 -- 172.21.15.174:0/2806167456 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fafbc00be10 con 0x7fafcc1008b0 2024-05-06T13:55:37.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.951+0000 7fafb3fff700 1 -- 172.21.15.174:0/2806167456 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafbc00f460 con 0x7fafcc1008b0 2024-05-06T13:55:37.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.952+0000 7fafd1675700 1 -- 172.21.15.174:0/2806167456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc1965c0 con 0x7fafcc1008b0 2024-05-06T13:55:37.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.952+0000 7fafb3fff700 1 -- 172.21.15.174:0/2806167456 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7fafbc00f6d0 con 0x7fafcc1008b0 2024-05-06T13:55:37.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.952+0000 7fafd1675700 1 -- 172.21.15.174:0/2806167456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc18f4d0 con 0x7fafcc1008b0 2024-05-06T13:55:37.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.953+0000 7fafb3fff700 1 --2- 172.21.15.174:0/2806167456 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fafb40383c0 0x7fafb403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:37.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.953+0000 7fafb3fff700 1 -- 172.21.15.174:0/2806167456 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fafbc04c5c0 con 0x7fafcc1008b0 2024-05-06T13:55:37.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.953+0000 7fafca7fc700 1 --2- 172.21.15.174:0/2806167456 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fafb40383c0 0x7fafb403a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:37.956 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.953+0000 7fafca7fc700 1 --2- 172.21.15.174:0/2806167456 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fafb40383c0 0x7fafb403a880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fafc0006fd0 tx=0x7fafc0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:37.960 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:37.959+0000 7fafb3fff700 1 -- 172.21.15.174:0/2806167456 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fafbc020d40 con 0x7fafcc1008b0 2024-05-06T13:55:38.222 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:38.221+0000 7fafd1675700 1 -- 172.21.15.174:0/2806167456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fafcc02cc70 con 0x7fafcc1008b0 2024-05-06T13:55:38.223 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:38.221+0000 7fafb3fff700 1 -- 172.21.15.174:0/2806167456 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fafbc027030 con 0x7fafcc1008b0 2024-05-06T13:55:38.223 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:55:38.223 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:55:38.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:38.223+0000 7fafd1675700 1 -- 172.21.15.174:0/2806167456 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fafb40383c0 msgr2=0x7fafb403a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:38.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:38.223+0000 7fafd1675700 1 --2- 172.21.15.174:0/2806167456 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fafb40383c0 0x7fafb403a880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fafc0006fd0 tx=0x7fafc0006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:38.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:38.223+0000 7fafd1675700 1 -- 172.21.15.174:0/2806167456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafcc1008b0 msgr2=0x7fafcc1959e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:38.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:38.223+0000 7fafd1675700 1 --2- 172.21.15.174:0/2806167456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafcc1008b0 0x7fafcc1959e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fafbc005b40 tx=0x7fafbc004740 comp rx=0 tx=0).stop 2024-05-06T13:55:38.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:38.223+0000 7fafd1675700 1 -- 172.21.15.174:0/2806167456 shutdown_connections 2024-05-06T13:55:38.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:38.223+0000 7fafd1675700 1 --2- 172.21.15.174:0/2806167456 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fafb40383c0 0x7fafb403a880 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:38.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:38.223+0000 7fafd1675700 1 --2- 172.21.15.174:0/2806167456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafcc1008b0 0x7fafcc1959e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:38.226 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:38.223+0000 7fafd1675700 1 -- 172.21.15.174:0/2806167456 >> 172.21.15.174:0/2806167456 conn(0x7fafcc0fbe30 msgr2=0x7fafcc0fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:38.226 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:38.224+0000 7fafd1675700 1 -- 172.21.15.174:0/2806167456 shutdown_connections 2024-05-06T13:55:38.226 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:38.224+0000 7fafd1675700 1 -- 172.21.15.174:0/2806167456 wait complete. 2024-05-06T13:55:38.226 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:55:38.853 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:38 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/2806167456' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:55:39.803 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:55:39.803 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:55:39.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:39 smithi123 ceph-mon[27254]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:40.004 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:40.051 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:41.252 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:40 smithi123 ceph-mon[27254]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:41.580 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.577+0000 7fef04316700 1 -- 172.21.15.174:0/1909441308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feefc0ff790 msgr2=0x7feefc0ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:41.580 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.578+0000 7fef04316700 1 --2- 172.21.15.174:0/1909441308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feefc0ff790 0x7feefc0ffbb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feeec009910 tx=0x7feeec009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:41.580 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.578+0000 7fef04316700 1 -- 172.21.15.174:0/1909441308 shutdown_connections 2024-05-06T13:55:41.580 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.578+0000 7fef04316700 1 --2- 172.21.15.174:0/1909441308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feefc0ff790 0x7feefc0ffbb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:41.580 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.578+0000 7fef04316700 1 -- 172.21.15.174:0/1909441308 >> 172.21.15.174:0/1909441308 conn(0x7feefc0fad70 msgr2=0x7feefc0fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:41.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.578+0000 7fef04316700 1 -- 172.21.15.174:0/1909441308 shutdown_connections 2024-05-06T13:55:41.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.578+0000 7fef04316700 1 -- 172.21.15.174:0/1909441308 wait complete. 2024-05-06T13:55:41.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.578+0000 7fef04316700 1 Processor -- start 2024-05-06T13:55:41.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.578+0000 7fef04316700 1 -- start start 2024-05-06T13:55:41.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.578+0000 7fef04316700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feefc0ff790 0x7feefc0fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:41.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.578+0000 7fef04316700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0fd200 con 0x7feefc0ff790 2024-05-06T13:55:41.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.579+0000 7fef020b2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feefc0ff790 0x7feefc0fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:41.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.579+0000 7fef020b2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feefc0ff790 0x7feefc0fccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:42672/0 (socket says 172.21.15.174:42672) 2024-05-06T13:55:41.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.579+0000 7fef020b2700 1 -- 172.21.15.174:0/1024413512 learned_addr learned my addr 172.21.15.174:0/1024413512 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:55:41.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.579+0000 7fef020b2700 1 -- 172.21.15.174:0/1024413512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0095f0 con 0x7feefc0ff790 2024-05-06T13:55:41.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.579+0000 7fef020b2700 1 --2- 172.21.15.174:0/1024413512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feefc0ff790 0x7feefc0fccc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feeec005b40 tx=0x7feeec004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:41.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.579+0000 7feef37fe700 1 -- 172.21.15.174:0/1024413512 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feeec01d070 con 0x7feefc0ff790 2024-05-06T13:55:41.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.579+0000 7fef04316700 1 -- 172.21.15.174:0/1024413512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc0fb310 con 0x7feefc0ff790 2024-05-06T13:55:41.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.579+0000 7feef37fe700 1 -- 172.21.15.174:0/1024413512 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feeec00be10 con 0x7feefc0ff790 2024-05-06T13:55:41.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.579+0000 7feef37fe700 1 -- 172.21.15.174:0/1024413512 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feeec00f460 con 0x7feefc0ff790 2024-05-06T13:55:41.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.579+0000 7fef04316700 1 -- 172.21.15.174:0/1024413512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc0fb7b0 con 0x7feefc0ff790 2024-05-06T13:55:41.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.580+0000 7fef04316700 1 -- 172.21.15.174:0/1024413512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc0623c0 con 0x7feefc0ff790 2024-05-06T13:55:41.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.580+0000 7feef37fe700 1 -- 172.21.15.174:0/1024413512 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7feeec0227e0 con 0x7feefc0ff790 2024-05-06T13:55:41.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.581+0000 7feef37fe700 1 --2- 172.21.15.174:0/1024413512 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7feee80383c0 0x7feee803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:41.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.581+0000 7feef37fe700 1 -- 172.21.15.174:0/1024413512 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7feeec04c3b0 con 0x7feefc0ff790 2024-05-06T13:55:41.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.581+0000 7fef018b1700 1 --2- 172.21.15.174:0/1024413512 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7feee80383c0 0x7feee803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:41.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.581+0000 7fef018b1700 1 --2- 172.21.15.174:0/1024413512 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7feee80383c0 0x7feee803a880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feef8006fd0 tx=0x7feef8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:41.587 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.586+0000 7feef37fe700 1 -- 172.21.15.174:0/1024413512 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7feeec02bba0 con 0x7feefc0ff790 2024-05-06T13:55:41.849 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.847+0000 7fef04316700 1 -- 172.21.15.174:0/1024413512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7feefc18eda0 con 0x7feefc0ff790 2024-05-06T13:55:41.850 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.848+0000 7feef37fe700 1 -- 172.21.15.174:0/1024413512 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7feeec027030 con 0x7feefc0ff790 2024-05-06T13:55:41.850 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:55:41.850 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:55:41.852 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.850+0000 7fef04316700 1 -- 172.21.15.174:0/1024413512 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7feee80383c0 msgr2=0x7feee803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:41.852 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.850+0000 7fef04316700 1 --2- 172.21.15.174:0/1024413512 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7feee80383c0 0x7feee803a880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feef8006fd0 tx=0x7feef8006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:41.852 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.850+0000 7fef04316700 1 -- 172.21.15.174:0/1024413512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feefc0ff790 msgr2=0x7feefc0fccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:41.852 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.850+0000 7fef04316700 1 --2- 172.21.15.174:0/1024413512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feefc0ff790 0x7feefc0fccc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feeec005b40 tx=0x7feeec004740 comp rx=0 tx=0).stop 2024-05-06T13:55:41.852 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.850+0000 7fef04316700 1 -- 172.21.15.174:0/1024413512 shutdown_connections 2024-05-06T13:55:41.852 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.850+0000 7fef04316700 1 --2- 172.21.15.174:0/1024413512 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7feee80383c0 0x7feee803a880 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:41.852 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.850+0000 7fef04316700 1 --2- 172.21.15.174:0/1024413512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feefc0ff790 0x7feefc0fccc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:41.852 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.850+0000 7fef04316700 1 -- 172.21.15.174:0/1024413512 >> 172.21.15.174:0/1024413512 conn(0x7feefc0fad70 msgr2=0x7feefc069180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:41.852 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.850+0000 7fef04316700 1 -- 172.21.15.174:0/1024413512 shutdown_connections 2024-05-06T13:55:41.852 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:41.850+0000 7fef04316700 1 -- 172.21.15.174:0/1024413512 wait complete. 2024-05-06T13:55:41.853 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:55:42.275 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:41 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/1024413512' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:55:43.192 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:42 smithi123 ceph-mon[27254]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:43.455 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:55:43.456 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:55:43.655 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:43.701 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:44.343 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:44 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:44.343 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:44 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:44.344 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:44 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:44.344 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:44 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:44.344 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:44 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:44.344 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:44 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:44.344 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:44 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:44.344 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:44 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:44.344 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:44 smithi123 ceph-mon[27254]: Deploying daemon prometheus.smithi123 on smithi123 2024-05-06T13:55:45.017 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.015+0000 7fe26efdb700 1 -- 172.21.15.174:0/149270773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2681008b0 msgr2=0x7fe268100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:45.018 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.015+0000 7fe26efdb700 1 --2- 172.21.15.174:0/149270773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2681008b0 0x7fe268100cd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009910 tx=0x7fe25c009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:45.018 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.015+0000 7fe26efdb700 1 -- 172.21.15.174:0/149270773 shutdown_connections 2024-05-06T13:55:45.018 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.015+0000 7fe26efdb700 1 --2- 172.21.15.174:0/149270773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2681008b0 0x7fe268100cd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:45.018 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.015+0000 7fe26efdb700 1 -- 172.21.15.174:0/149270773 >> 172.21.15.174:0/149270773 conn(0x7fe2680fbe30 msgr2=0x7fe2680fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:45.018 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.015+0000 7fe26efdb700 1 -- 172.21.15.174:0/149270773 shutdown_connections 2024-05-06T13:55:45.018 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.015+0000 7fe26efdb700 1 -- 172.21.15.174:0/149270773 wait complete. 2024-05-06T13:55:45.018 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.015+0000 7fe26efdb700 1 Processor -- start 2024-05-06T13:55:45.018 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.015+0000 7fe26efdb700 1 -- start start 2024-05-06T13:55:45.018 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.015+0000 7fe26efdb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2681008b0 0x7fe268197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:45.018 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.015+0000 7fe26efdb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe268198110 con 0x7fe2681008b0 2024-05-06T13:55:45.019 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.016+0000 7fe26cd77700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2681008b0 0x7fe268197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:45.019 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.016+0000 7fe26cd77700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2681008b0 0x7fe268197bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:42692/0 (socket says 172.21.15.174:42692) 2024-05-06T13:55:45.019 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.016+0000 7fe26cd77700 1 -- 172.21.15.174:0/2774666012 learned_addr learned my addr 172.21.15.174:0/2774666012 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:55:45.019 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.016+0000 7fe26cd77700 1 -- 172.21.15.174:0/2774666012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c0095f0 con 0x7fe2681008b0 2024-05-06T13:55:45.019 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.016+0000 7fe26cd77700 1 --2- 172.21.15.174:0/2774666012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2681008b0 0x7fe268197bd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe25c005b40 tx=0x7fe25c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:45.019 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.016+0000 7fe265ffb700 1 -- 172.21.15.174:0/2774666012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe25c01d070 con 0x7fe2681008b0 2024-05-06T13:55:45.019 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.016+0000 7fe265ffb700 1 -- 172.21.15.174:0/2774666012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe25c00be10 con 0x7fe2681008b0 2024-05-06T13:55:45.019 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.016+0000 7fe26efdb700 1 -- 172.21.15.174:0/2774666012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe268198310 con 0x7fe2681008b0 2024-05-06T13:55:45.019 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.016+0000 7fe265ffb700 1 -- 172.21.15.174:0/2774666012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe25c00f460 con 0x7fe2681008b0 2024-05-06T13:55:45.020 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.016+0000 7fe26efdb700 1 -- 172.21.15.174:0/2774666012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2681987b0 con 0x7fe2681008b0 2024-05-06T13:55:45.020 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.017+0000 7fe265ffb700 1 -- 172.21.15.174:0/2774666012 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7fe25c00f6d0 con 0x7fe2681008b0 2024-05-06T13:55:45.020 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.017+0000 7fe26efdb700 1 -- 172.21.15.174:0/2774666012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2681918d0 con 0x7fe2681008b0 2024-05-06T13:55:45.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.017+0000 7fe265ffb700 1 --2- 172.21.15.174:0/2774666012 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fe2580383c0 0x7fe25803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:45.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.017+0000 7fe265ffb700 1 -- 172.21.15.174:0/2774666012 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe25c04c530 con 0x7fe2681008b0 2024-05-06T13:55:45.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.018+0000 7fe267fff700 1 --2- 172.21.15.174:0/2774666012 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fe2580383c0 0x7fe25803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:45.021 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.018+0000 7fe267fff700 1 --2- 172.21.15.174:0/2774666012 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fe2580383c0 0x7fe25803a880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe254006fd0 tx=0x7fe254006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:45.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.022+0000 7fe265ffb700 1 -- 172.21.15.174:0/2774666012 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe25c02a360 con 0x7fe2681008b0 2024-05-06T13:55:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.284+0000 7fe26efdb700 1 -- 172.21.15.174:0/2774666012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe26802cc70 con 0x7fe2681008b0 2024-05-06T13:55:45.286 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.284+0000 7fe265ffb700 1 -- 172.21.15.174:0/2774666012 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fe25c027030 con 0x7fe2681008b0 2024-05-06T13:55:45.286 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:55:45.287 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:55:45.289 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.286+0000 7fe26efdb700 1 -- 172.21.15.174:0/2774666012 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fe2580383c0 msgr2=0x7fe25803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:45.289 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.286+0000 7fe26efdb700 1 --2- 172.21.15.174:0/2774666012 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fe2580383c0 0x7fe25803a880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe254006fd0 tx=0x7fe254006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:45.289 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.286+0000 7fe26efdb700 1 -- 172.21.15.174:0/2774666012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2681008b0 msgr2=0x7fe268197bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:45.289 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.286+0000 7fe26efdb700 1 --2- 172.21.15.174:0/2774666012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2681008b0 0x7fe268197bd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe25c005b40 tx=0x7fe25c004740 comp rx=0 tx=0).stop 2024-05-06T13:55:45.289 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.287+0000 7fe26efdb700 1 -- 172.21.15.174:0/2774666012 shutdown_connections 2024-05-06T13:55:45.289 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.287+0000 7fe26efdb700 1 --2- 172.21.15.174:0/2774666012 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fe2580383c0 0x7fe25803a880 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:45.290 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.287+0000 7fe26efdb700 1 --2- 172.21.15.174:0/2774666012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2681008b0 0x7fe268197bd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:45.290 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.287+0000 7fe26efdb700 1 -- 172.21.15.174:0/2774666012 >> 172.21.15.174:0/2774666012 conn(0x7fe2680fbe30 msgr2=0x7fe2680fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:45.290 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.287+0000 7fe26efdb700 1 -- 172.21.15.174:0/2774666012 shutdown_connections 2024-05-06T13:55:45.290 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:45.287+0000 7fe26efdb700 1 -- 172.21.15.174:0/2774666012 wait complete. 2024-05-06T13:55:45.290 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:55:45.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:45 smithi123 ceph-mon[27254]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:45.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:45 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:45.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:45 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/2774666012' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:55:46.902 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:55:46.903 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:55:47.096 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:47.143 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:47.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:47 smithi123 ceph-mon[27254]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:48.591 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.589+0000 7facea356700 1 -- 172.21.15.174:0/685404059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face40ff7a0 msgr2=0x7face40ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:48.591 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.589+0000 7facea356700 1 --2- 172.21.15.174:0/685404059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face40ff7a0 0x7face40ffbc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7facd8009910 tx=0x7facd8009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:48.591 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.589+0000 7facea356700 1 -- 172.21.15.174:0/685404059 shutdown_connections 2024-05-06T13:55:48.591 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.589+0000 7facea356700 1 --2- 172.21.15.174:0/685404059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face40ff7a0 0x7face40ffbc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:48.591 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.589+0000 7facea356700 1 -- 172.21.15.174:0/685404059 >> 172.21.15.174:0/685404059 conn(0x7face40fad20 msgr2=0x7face40fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:48.591 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.589+0000 7facea356700 1 -- 172.21.15.174:0/685404059 shutdown_connections 2024-05-06T13:55:48.591 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.589+0000 7facea356700 1 -- 172.21.15.174:0/685404059 wait complete. 2024-05-06T13:55:48.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.590+0000 7facea356700 1 Processor -- start 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.590+0000 7facea356700 1 -- start start 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.590+0000 7facea356700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face40ff7a0 0x7face40fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.590+0000 7facea356700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face40fd220 con 0x7face40ff7a0 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.590+0000 7face3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face40ff7a0 0x7face40fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.590+0000 7face3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face40ff7a0 0x7face40fcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:42712/0 (socket says 172.21.15.174:42712) 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.590+0000 7face3fff700 1 -- 172.21.15.174:0/646063225 learned_addr learned my addr 172.21.15.174:0/646063225 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.590+0000 7face3fff700 1 -- 172.21.15.174:0/646063225 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd80095f0 con 0x7face40ff7a0 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.591+0000 7face3fff700 1 --2- 172.21.15.174:0/646063225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face40ff7a0 0x7face40fcce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7facd8005b40 tx=0x7facd8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.591+0000 7face17fa700 1 -- 172.21.15.174:0/646063225 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facd801d070 con 0x7face40ff7a0 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.591+0000 7facea356700 1 -- 172.21.15.174:0/646063225 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face40fb330 con 0x7face40ff7a0 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.591+0000 7face17fa700 1 -- 172.21.15.174:0/646063225 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7facd800be10 con 0x7face40ff7a0 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.591+0000 7face17fa700 1 -- 172.21.15.174:0/646063225 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facd800f460 con 0x7face40ff7a0 2024-05-06T13:55:48.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.591+0000 7facea356700 1 -- 172.21.15.174:0/646063225 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face40fb7d0 con 0x7face40ff7a0 2024-05-06T13:55:48.594 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.592+0000 7face17fa700 1 -- 172.21.15.174:0/646063225 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7facd800f6d0 con 0x7face40ff7a0 2024-05-06T13:55:48.594 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.592+0000 7facea356700 1 -- 172.21.15.174:0/646063225 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face40623c0 con 0x7face40ff7a0 2024-05-06T13:55:48.595 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.592+0000 7face17fa700 1 --2- 172.21.15.174:0/646063225 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7faccc0383c0 0x7faccc03a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:48.595 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.592+0000 7face17fa700 1 -- 172.21.15.174:0/646063225 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7facd804c580 con 0x7face40ff7a0 2024-05-06T13:55:48.595 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.592+0000 7face37fe700 1 --2- 172.21.15.174:0/646063225 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7faccc0383c0 0x7faccc03a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:48.595 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.592+0000 7face37fe700 1 --2- 172.21.15.174:0/646063225 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7faccc0383c0 0x7faccc03a880 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7facd4006fd0 tx=0x7facd4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:48.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.598+0000 7face17fa700 1 -- 172.21.15.174:0/646063225 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7facd802a360 con 0x7face40ff7a0 2024-05-06T13:55:48.861 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.859+0000 7facea356700 1 -- 172.21.15.174:0/646063225 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7face418edb0 con 0x7face40ff7a0 2024-05-06T13:55:48.862 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.860+0000 7face17fa700 1 -- 172.21.15.174:0/646063225 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7facd8027030 con 0x7face40ff7a0 2024-05-06T13:55:48.862 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:55:48.863 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:55:48.864 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.863+0000 7facea356700 1 -- 172.21.15.174:0/646063225 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7faccc0383c0 msgr2=0x7faccc03a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:48.864 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.863+0000 7facea356700 1 --2- 172.21.15.174:0/646063225 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7faccc0383c0 0x7faccc03a880 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7facd4006fd0 tx=0x7facd4006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:48.864 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.863+0000 7facea356700 1 -- 172.21.15.174:0/646063225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face40ff7a0 msgr2=0x7face40fcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:48.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.863+0000 7facea356700 1 --2- 172.21.15.174:0/646063225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face40ff7a0 0x7face40fcce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7facd8005b40 tx=0x7facd8004740 comp rx=0 tx=0).stop 2024-05-06T13:55:48.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.863+0000 7facea356700 1 -- 172.21.15.174:0/646063225 shutdown_connections 2024-05-06T13:55:48.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.863+0000 7facea356700 1 --2- 172.21.15.174:0/646063225 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7faccc0383c0 0x7faccc03a880 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:48.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.863+0000 7facea356700 1 --2- 172.21.15.174:0/646063225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face40ff7a0 0x7face40fcce0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:48.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.863+0000 7facea356700 1 -- 172.21.15.174:0/646063225 >> 172.21.15.174:0/646063225 conn(0x7face40fad20 msgr2=0x7face4068810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:48.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.863+0000 7facea356700 1 -- 172.21.15.174:0/646063225 shutdown_connections 2024-05-06T13:55:48.866 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:48.863+0000 7facea356700 1 -- 172.21.15.174:0/646063225 wait complete. 2024-05-06T13:55:48.866 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:55:49.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:49 smithi123 ceph-mon[27254]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:49.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:49 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/646063225' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:55:50.472 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:55:50.472 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:55:50.674 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:50.721 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:51.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:50 smithi123 ceph-mon[27254]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:52.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.197+0000 7f5c71082700 1 -- 172.21.15.174:0/1973112525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c6c0ff790 msgr2=0x7f5c6c0ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:52.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.197+0000 7f5c71082700 1 --2- 172.21.15.174:0/1973112525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c6c0ff790 0x7f5c6c0ffbb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009910 tx=0x7f5c60009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:52.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.197+0000 7f5c71082700 1 -- 172.21.15.174:0/1973112525 shutdown_connections 2024-05-06T13:55:52.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.197+0000 7f5c71082700 1 --2- 172.21.15.174:0/1973112525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c6c0ff790 0x7f5c6c0ffbb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:52.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.197+0000 7f5c71082700 1 -- 172.21.15.174:0/1973112525 >> 172.21.15.174:0/1973112525 conn(0x7f5c6c0fad10 msgr2=0x7f5c6c0fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:52.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.197+0000 7f5c71082700 1 -- 172.21.15.174:0/1973112525 shutdown_connections 2024-05-06T13:55:52.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.197+0000 7f5c71082700 1 -- 172.21.15.174:0/1973112525 wait complete. 2024-05-06T13:55:52.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.198+0000 7f5c71082700 1 Processor -- start 2024-05-06T13:55:52.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.198+0000 7f5c71082700 1 -- start start 2024-05-06T13:55:52.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.198+0000 7f5c71082700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c6c0ff790 0x7f5c6c1948a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:52.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.198+0000 7f5c71082700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c194de0 con 0x7f5c6c0ff790 2024-05-06T13:55:52.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.198+0000 7f5c6ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c6c0ff790 0x7f5c6c1948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:52.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.198+0000 7f5c6ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c6c0ff790 0x7f5c6c1948a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:46808/0 (socket says 172.21.15.174:46808) 2024-05-06T13:55:52.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.198+0000 7f5c6ad9d700 1 -- 172.21.15.174:0/2267938411 learned_addr learned my addr 172.21.15.174:0/2267938411 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:55:52.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.199+0000 7f5c6ad9d700 1 -- 172.21.15.174:0/2267938411 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c600095f0 con 0x7f5c6c0ff790 2024-05-06T13:55:52.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.199+0000 7f5c6ad9d700 1 --2- 172.21.15.174:0/2267938411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c6c0ff790 0x7f5c6c1948a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5c60005b40 tx=0x7f5c60004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:52.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.199+0000 7f5c53fff700 1 -- 172.21.15.174:0/2267938411 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c6001d070 con 0x7f5c6c0ff790 2024-05-06T13:55:52.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.199+0000 7f5c71082700 1 -- 172.21.15.174:0/2267938411 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6c194fe0 con 0x7f5c6c0ff790 2024-05-06T13:55:52.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.199+0000 7f5c53fff700 1 -- 172.21.15.174:0/2267938411 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5c6000be10 con 0x7f5c6c0ff790 2024-05-06T13:55:52.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.199+0000 7f5c53fff700 1 -- 172.21.15.174:0/2267938411 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c6000f460 con 0x7f5c6c0ff790 2024-05-06T13:55:52.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.199+0000 7f5c71082700 1 -- 172.21.15.174:0/2267938411 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6c195480 con 0x7f5c6c0ff790 2024-05-06T13:55:52.202 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.200+0000 7f5c53fff700 1 -- 172.21.15.174:0/2267938411 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f5c6000f6d0 con 0x7f5c6c0ff790 2024-05-06T13:55:52.202 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.200+0000 7f5c71082700 1 -- 172.21.15.174:0/2267938411 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c18e3b0 con 0x7f5c6c0ff790 2024-05-06T13:55:52.202 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.200+0000 7f5c53fff700 1 --2- 172.21.15.174:0/2267938411 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f5c54038410 0x7f5c5403a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:52.202 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.200+0000 7f5c53fff700 1 -- 172.21.15.174:0/2267938411 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5c6004c700 con 0x7f5c6c0ff790 2024-05-06T13:55:52.202 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.200+0000 7f5c6a59c700 1 --2- 172.21.15.174:0/2267938411 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f5c54038410 0x7f5c5403a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:52.202 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.201+0000 7f5c6a59c700 1 --2- 172.21.15.174:0/2267938411 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f5c54038410 0x7f5c5403a8d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c006fd0 tx=0x7f5c5c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:52.206 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.205+0000 7f5c53fff700 1 -- 172.21.15.174:0/2267938411 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5c6002a360 con 0x7f5c6c0ff790 2024-05-06T13:55:52.469 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.468+0000 7f5c71082700 1 -- 172.21.15.174:0/2267938411 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5c6c02cc70 con 0x7f5c6c0ff790 2024-05-06T13:55:52.470 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.469+0000 7f5c53fff700 1 -- 172.21.15.174:0/2267938411 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f5c60027030 con 0x7f5c6c0ff790 2024-05-06T13:55:52.470 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:55:52.470 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:55:52.472 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.471+0000 7f5c71082700 1 -- 172.21.15.174:0/2267938411 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f5c54038410 msgr2=0x7f5c5403a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:52.472 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.471+0000 7f5c71082700 1 --2- 172.21.15.174:0/2267938411 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f5c54038410 0x7f5c5403a8d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c006fd0 tx=0x7f5c5c006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:52.472 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.471+0000 7f5c71082700 1 -- 172.21.15.174:0/2267938411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c6c0ff790 msgr2=0x7f5c6c1948a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:52.472 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.471+0000 7f5c71082700 1 --2- 172.21.15.174:0/2267938411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c6c0ff790 0x7f5c6c1948a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5c60005b40 tx=0x7f5c60004740 comp rx=0 tx=0).stop 2024-05-06T13:55:52.472 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.471+0000 7f5c71082700 1 -- 172.21.15.174:0/2267938411 shutdown_connections 2024-05-06T13:55:52.472 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.471+0000 7f5c71082700 1 --2- 172.21.15.174:0/2267938411 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f5c54038410 0x7f5c5403a8d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:52.472 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.471+0000 7f5c71082700 1 --2- 172.21.15.174:0/2267938411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c6c0ff790 0x7f5c6c1948a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:52.472 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.471+0000 7f5c71082700 1 -- 172.21.15.174:0/2267938411 >> 172.21.15.174:0/2267938411 conn(0x7f5c6c0fad10 msgr2=0x7f5c6c0fba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:52.472 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.471+0000 7f5c71082700 1 -- 172.21.15.174:0/2267938411 shutdown_connections 2024-05-06T13:55:52.472 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:52.471+0000 7f5c71082700 1 -- 172.21.15.174:0/2267938411 wait complete. 2024-05-06T13:55:52.473 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:55:53.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:53 smithi123 ceph-mon[27254]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:53.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:53 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/2267938411' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:55:54.038 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:55:54.038 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:55:54.238 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:54.285 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:55.615 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.614+0000 7fcc20945700 1 -- 172.21.15.174:0/3350580175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c1008b0 msgr2=0x7fcc1c100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:55.615 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.614+0000 7fcc20945700 1 --2- 172.21.15.174:0/3350580175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c1008b0 0x7fcc1c100cd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009910 tx=0x7fcc0c009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:55.615 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.614+0000 7fcc20945700 1 -- 172.21.15.174:0/3350580175 shutdown_connections 2024-05-06T13:55:55.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.614+0000 7fcc20945700 1 --2- 172.21.15.174:0/3350580175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c1008b0 0x7fcc1c100cd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:55.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.614+0000 7fcc20945700 1 -- 172.21.15.174:0/3350580175 >> 172.21.15.174:0/3350580175 conn(0x7fcc1c0fbe30 msgr2=0x7fcc1c0fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:55.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.614+0000 7fcc20945700 1 -- 172.21.15.174:0/3350580175 shutdown_connections 2024-05-06T13:55:55.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.614+0000 7fcc20945700 1 -- 172.21.15.174:0/3350580175 wait complete. 2024-05-06T13:55:55.618 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.615+0000 7fcc20945700 1 Processor -- start 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.615+0000 7fcc20945700 1 -- start start 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.615+0000 7fcc20945700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c1008b0 0x7fcc1c1959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.615+0000 7fcc20945700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c195f00 con 0x7fcc1c1008b0 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.616+0000 7fcc1a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c1008b0 0x7fcc1c1959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.616+0000 7fcc1a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c1008b0 0x7fcc1c1959c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:46826/0 (socket says 172.21.15.174:46826) 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.616+0000 7fcc1a59c700 1 -- 172.21.15.174:0/3492502563 learned_addr learned my addr 172.21.15.174:0/3492502563 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.616+0000 7fcc1a59c700 1 -- 172.21.15.174:0/3492502563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c0095f0 con 0x7fcc1c1008b0 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.616+0000 7fcc1a59c700 1 --2- 172.21.15.174:0/3492502563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c1008b0 0x7fcc1c1959c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c005b40 tx=0x7fcc0c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.616+0000 7fcc0b7fe700 1 -- 172.21.15.174:0/3492502563 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc0c01d070 con 0x7fcc1c1008b0 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.616+0000 7fcc20945700 1 -- 172.21.15.174:0/3492502563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c196100 con 0x7fcc1c1008b0 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.616+0000 7fcc0b7fe700 1 -- 172.21.15.174:0/3492502563 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc0c00be10 con 0x7fcc1c1008b0 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.616+0000 7fcc0b7fe700 1 -- 172.21.15.174:0/3492502563 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc0c00f460 con 0x7fcc1c1008b0 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.616+0000 7fcc20945700 1 -- 172.21.15.174:0/3492502563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c1965a0 con 0x7fcc1c1008b0 2024-05-06T13:55:55.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.617+0000 7fcc0b7fe700 1 -- 172.21.15.174:0/3492502563 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7fcc0c0227e0 con 0x7fcc1c1008b0 2024-05-06T13:55:55.620 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.617+0000 7fcc20945700 1 -- 172.21.15.174:0/3492502563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c18f4d0 con 0x7fcc1c1008b0 2024-05-06T13:55:55.620 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.617+0000 7fcc0b7fe700 1 --2- 172.21.15.174:0/3492502563 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fcc04038410 0x7fcc0403a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:55.620 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.617+0000 7fcc0b7fe700 1 -- 172.21.15.174:0/3492502563 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcc0c04c420 con 0x7fcc1c1008b0 2024-05-06T13:55:55.620 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.618+0000 7fcc19d9b700 1 --2- 172.21.15.174:0/3492502563 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fcc04038410 0x7fcc0403a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:55.620 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.618+0000 7fcc19d9b700 1 --2- 172.21.15.174:0/3492502563 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fcc04038410 0x7fcc0403a8d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcc10006fd0 tx=0x7fcc10006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:55.623 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.623+0000 7fcc0b7fe700 1 -- 172.21.15.174:0/3492502563 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcc0c02ba00 con 0x7fcc1c1008b0 2024-05-06T13:55:55.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:55 smithi123 ceph-mon[27254]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:55.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.885+0000 7fcc20945700 1 -- 172.21.15.174:0/3492502563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcc1c02cc70 con 0x7fcc1c1008b0 2024-05-06T13:55:55.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.886+0000 7fcc0b7fe700 1 -- 172.21.15.174:0/3492502563 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fcc0c027020 con 0x7fcc1c1008b0 2024-05-06T13:55:55.887 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:55:55.887 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:55:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.888+0000 7fcc20945700 1 -- 172.21.15.174:0/3492502563 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fcc04038410 msgr2=0x7fcc0403a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.888+0000 7fcc20945700 1 --2- 172.21.15.174:0/3492502563 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fcc04038410 0x7fcc0403a8d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcc10006fd0 tx=0x7fcc10006e40 comp rx=0 tx=0).stop 2024-05-06T13:55:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.888+0000 7fcc20945700 1 -- 172.21.15.174:0/3492502563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c1008b0 msgr2=0x7fcc1c1959c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.888+0000 7fcc20945700 1 --2- 172.21.15.174:0/3492502563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c1008b0 0x7fcc1c1959c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c005b40 tx=0x7fcc0c004740 comp rx=0 tx=0).stop 2024-05-06T13:55:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.888+0000 7fcc20945700 1 -- 172.21.15.174:0/3492502563 shutdown_connections 2024-05-06T13:55:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.888+0000 7fcc20945700 1 --2- 172.21.15.174:0/3492502563 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7fcc04038410 0x7fcc0403a8d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.888+0000 7fcc20945700 1 --2- 172.21.15.174:0/3492502563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c1008b0 0x7fcc1c1959c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.888+0000 7fcc20945700 1 -- 172.21.15.174:0/3492502563 >> 172.21.15.174:0/3492502563 conn(0x7fcc1c0fbe30 msgr2=0x7fcc1c0fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.888+0000 7fcc20945700 1 -- 172.21.15.174:0/3492502563 shutdown_connections 2024-05-06T13:55:55.890 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:55.888+0000 7fcc20945700 1 -- 172.21.15.174:0/3492502563 wait complete. 2024-05-06T13:55:55.890 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:55:56.802 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:56 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/3492502563' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:55:57.484 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:55:57.485 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:55:57.684 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:57.732 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:55:57.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:57 smithi123 ceph-mon[27254]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:55:57.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:57 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:57.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:57 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:57.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:57 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' 2024-05-06T13:55:57.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:57 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-06T13:55:59.228 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.226+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3207213439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140fef30 msgr2=0x7f9f140ff350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:59.228 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.226+0000 7f9f1a36d700 1 --2- 172.21.15.174:0/3207213439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140fef30 0x7f9f140ff350 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009910 tx=0x7f9f04009c20 comp rx=0 tx=0).stop 2024-05-06T13:55:59.228 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.226+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3207213439 shutdown_connections 2024-05-06T13:55:59.228 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.226+0000 7f9f1a36d700 1 --2- 172.21.15.174:0/3207213439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140fef30 0x7f9f140ff350 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:59.229 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.226+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3207213439 >> 172.21.15.174:0/3207213439 conn(0x7f9f140fa4d0 msgr2=0x7f9f140fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:59.229 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.226+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3207213439 shutdown_connections 2024-05-06T13:55:59.229 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.226+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3207213439 wait complete. 2024-05-06T13:55:59.229 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.226+0000 7f9f1a36d700 1 Processor -- start 2024-05-06T13:55:59.229 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.226+0000 7f9f1a36d700 1 -- start start 2024-05-06T13:55:59.229 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.227+0000 7f9f1a36d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140fef30 0x7f9f141959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:59.229 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.227+0000 7f9f1a36d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f14195f00 con 0x7f9f140fef30 2024-05-06T13:55:59.229 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.227+0000 7f9f13fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140fef30 0x7f9f141959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:55:59.229 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.227+0000 7f9f13fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140fef30 0x7f9f141959c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:46850/0 (socket says 172.21.15.174:46850) 2024-05-06T13:55:59.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.227+0000 7f9f13fff700 1 -- 172.21.15.174:0/3938807973 learned_addr learned my addr 172.21.15.174:0/3938807973 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:55:59.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.227+0000 7f9f13fff700 1 -- 172.21.15.174:0/3938807973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f040095f0 con 0x7f9f140fef30 2024-05-06T13:55:59.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.227+0000 7f9f13fff700 1 --2- 172.21.15.174:0/3938807973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140fef30 0x7f9f141959c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f04005b40 tx=0x7f9f04004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:55:59.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.227+0000 7f9f117fa700 1 -- 172.21.15.174:0/3938807973 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f0401d070 con 0x7f9f140fef30 2024-05-06T13:55:59.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.227+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3938807973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f14196100 con 0x7f9f140fef30 2024-05-06T13:55:59.230 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.227+0000 7f9f117fa700 1 -- 172.21.15.174:0/3938807973 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9f0400be10 con 0x7f9f140fef30 2024-05-06T13:55:59.231 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.227+0000 7f9f117fa700 1 -- 172.21.15.174:0/3938807973 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f0400f460 con 0x7f9f140fef30 2024-05-06T13:55:59.231 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.227+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3938807973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f141965a0 con 0x7f9f140fef30 2024-05-06T13:55:59.232 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.228+0000 7f9f117fa700 1 -- 172.21.15.174:0/3938807973 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 14) v1 ==== 45354+0+0 (secure 0 0 0) 0x7f9f0400f6d0 con 0x7f9f140fef30 2024-05-06T13:55:59.232 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.228+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3938807973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1418fcd0 con 0x7f9f140fef30 2024-05-06T13:55:59.232 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.228+0000 7f9f117fa700 1 --2- 172.21.15.174:0/3938807973 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9efc038410 0x7f9efc03a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:55:59.232 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.228+0000 7f9f117fa700 1 -- 172.21.15.174:0/3938807973 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9f0404c6e0 con 0x7f9f140fef30 2024-05-06T13:55:59.232 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.228+0000 7f9f137fe700 1 -- 172.21.15.174:0/3938807973 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9efc038410 msgr2=0x7f9efc03a8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/388885730 2024-05-06T13:55:59.233 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.228+0000 7f9f137fe700 1 --2- 172.21.15.174:0/3938807973 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9efc038410 0x7f9efc03a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T13:55:59.233 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.233+0000 7f9f117fa700 1 -- 172.21.15.174:0/3938807973 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9f0402a360 con 0x7f9f140fef30 2024-05-06T13:55:59.429 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.429+0000 7f9f137fe700 1 -- 172.21.15.174:0/3938807973 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9efc038410 msgr2=0x7f9efc03a8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/388885730 2024-05-06T13:55:59.430 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.429+0000 7f9f137fe700 1 --2- 172.21.15.174:0/3938807973 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9efc038410 0x7f9efc03a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T13:55:59.494 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.493+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3938807973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9f1402cc70 con 0x7f9f140fef30 2024-05-06T13:55:59.494 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.494+0000 7f9f117fa700 1 -- 172.21.15.174:0/3938807973 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f9f04027070 con 0x7f9f140fef30 2024-05-06T13:55:59.494 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:55:59.495 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:55:59.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.496+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3938807973 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9efc038410 msgr2=0x7f9efc03a8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T13:55:59.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.496+0000 7f9f1a36d700 1 --2- 172.21.15.174:0/3938807973 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9efc038410 0x7f9efc03a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:59.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.496+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3938807973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140fef30 msgr2=0x7f9f141959c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:55:59.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.496+0000 7f9f1a36d700 1 --2- 172.21.15.174:0/3938807973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140fef30 0x7f9f141959c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f04005b40 tx=0x7f9f04004740 comp rx=0 tx=0).stop 2024-05-06T13:55:59.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.496+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3938807973 shutdown_connections 2024-05-06T13:55:59.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.496+0000 7f9f1a36d700 1 --2- 172.21.15.174:0/3938807973 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f9efc038410 0x7f9efc03a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:59.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.496+0000 7f9f1a36d700 1 --2- 172.21.15.174:0/3938807973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140fef30 0x7f9f141959c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:55:59.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.496+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3938807973 >> 172.21.15.174:0/3938807973 conn(0x7f9f140fa4d0 msgr2=0x7f9f140fb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:55:59.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.496+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3938807973 shutdown_connections 2024-05-06T13:55:59.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:55:59.496+0000 7f9f1a36d700 1 -- 172.21.15.174:0/3938807973 wait complete. 2024-05-06T13:55:59.497 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:55:59.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:59 smithi123 ceph-mon[27254]: from='mgr.14164 172.21.15.123:0/3890396604' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-06T13:55:59.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:55:59 smithi123 ceph-mon[27254]: mgrmap e14: smithi123.vjztrj(active, since 63s) 2024-05-06T13:56:00.490 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:00 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/3938807973' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:56:01.079 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:56:01.079 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:56:01.280 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:56:01.327 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:56:02.601 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.598+0000 7f2dd3baa700 1 -- 172.21.15.174:0/1235426451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc100890 msgr2=0x7f2dcc100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:02.601 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.598+0000 7f2dd3baa700 1 --2- 172.21.15.174:0/1235426451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc100890 0x7f2dcc100cb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400b0a0 tx=0x7f2dc400b3b0 comp rx=0 tx=0).stop 2024-05-06T13:56:02.601 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.598+0000 7f2dd3baa700 1 -- 172.21.15.174:0/1235426451 shutdown_connections 2024-05-06T13:56:02.601 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.598+0000 7f2dd3baa700 1 --2- 172.21.15.174:0/1235426451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc100890 0x7f2dcc100cb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:02.601 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.598+0000 7f2dd3baa700 1 -- 172.21.15.174:0/1235426451 >> 172.21.15.174:0/1235426451 conn(0x7f2dcc0fbe30 msgr2=0x7f2dcc0fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:02.601 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.598+0000 7f2dd3baa700 1 -- 172.21.15.174:0/1235426451 shutdown_connections 2024-05-06T13:56:02.601 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.599+0000 7f2dd3baa700 1 -- 172.21.15.174:0/1235426451 wait complete. 2024-05-06T13:56:02.601 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.599+0000 7f2dd3baa700 1 Processor -- start 2024-05-06T13:56:02.601 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.599+0000 7f2dd3baa700 1 -- start start 2024-05-06T13:56:02.601 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.599+0000 7f2dd3baa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc100890 0x7f2dcc1959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:02.601 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.599+0000 7f2dd3baa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc195ef0 con 0x7f2dcc100890 2024-05-06T13:56:02.602 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.599+0000 7f2dd1946700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc100890 0x7f2dcc1959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:02.602 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.599+0000 7f2dd1946700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc100890 0x7f2dcc1959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:43464/0 (socket says 172.21.15.174:43464) 2024-05-06T13:56:02.602 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.599+0000 7f2dd1946700 1 -- 172.21.15.174:0/3770280211 learned_addr learned my addr 172.21.15.174:0/3770280211 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:56:02.602 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.600+0000 7f2dd1946700 1 -- 172.21.15.174:0/3770280211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc4009d00 con 0x7f2dcc100890 2024-05-06T13:56:02.602 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.600+0000 7f2dd1946700 1 --2- 172.21.15.174:0/3770280211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc100890 0x7f2dcc1959b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400b830 tx=0x7f2dc400bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:02.602 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.600+0000 7f2dc2ffd700 1 -- 172.21.15.174:0/3770280211 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc400e040 con 0x7f2dcc100890 2024-05-06T13:56:02.602 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.600+0000 7f2dc2ffd700 1 -- 172.21.15.174:0/3770280211 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2dc4012af0 con 0x7f2dcc100890 2024-05-06T13:56:02.602 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.600+0000 7f2dd3baa700 1 -- 172.21.15.174:0/3770280211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dcc1960f0 con 0x7f2dcc100890 2024-05-06T13:56:02.602 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.600+0000 7f2dc2ffd700 1 -- 172.21.15.174:0/3770280211 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc401d9f0 con 0x7f2dcc100890 2024-05-06T13:56:02.602 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.600+0000 7f2dd3baa700 1 -- 172.21.15.174:0/3770280211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc196510 con 0x7f2dcc100890 2024-05-06T13:56:02.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.601+0000 7f2dc2ffd700 1 -- 172.21.15.174:0/3770280211 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 14) v1 ==== 45354+0+0 (secure 0 0 0) 0x7f2dc401dcb0 con 0x7f2dcc100890 2024-05-06T13:56:02.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.601+0000 7f2dd3baa700 1 -- 172.21.15.174:0/3770280211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc18f4b0 con 0x7f2dcc100890 2024-05-06T13:56:02.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.601+0000 7f2dc2ffd700 1 --2- 172.21.15.174:0/3770280211 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2db8038410 0x7f2db803a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:02.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.601+0000 7f2dc2ffd700 1 -- 172.21.15.174:0/3770280211 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2dc404ca00 con 0x7f2dcc100890 2024-05-06T13:56:02.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.601+0000 7f2dd1145700 1 -- 172.21.15.174:0/3770280211 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2db8038410 msgr2=0x7f2db803a8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/388885730 2024-05-06T13:56:02.603 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.601+0000 7f2dd1145700 1 --2- 172.21.15.174:0/3770280211 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2db8038410 0x7f2db803a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T13:56:02.606 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.606+0000 7f2dc2ffd700 1 -- 172.21.15.174:0/3770280211 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2dc401ac90 con 0x7f2dcc100890 2024-05-06T13:56:02.802 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.802+0000 7f2dd1145700 1 -- 172.21.15.174:0/3770280211 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2db8038410 msgr2=0x7f2db803a8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/388885730 2024-05-06T13:56:02.803 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.802+0000 7f2dd1145700 1 --2- 172.21.15.174:0/3770280211 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2db8038410 0x7f2db803a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T13:56:02.874 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.874+0000 7f2dd3baa700 1 -- 172.21.15.174:0/3770280211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2dcc0623c0 con 0x7f2dcc100890 2024-05-06T13:56:02.875 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.874+0000 7f2dc2ffd700 1 -- 172.21.15.174:0/3770280211 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f2dc401ac90 con 0x7f2dcc100890 2024-05-06T13:56:02.875 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:56:02.875 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:56:02.877 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.876+0000 7f2dd3baa700 1 -- 172.21.15.174:0/3770280211 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2db8038410 msgr2=0x7f2db803a8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T13:56:02.877 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.876+0000 7f2dd3baa700 1 --2- 172.21.15.174:0/3770280211 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2db8038410 0x7f2db803a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:02.877 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.876+0000 7f2dd3baa700 1 -- 172.21.15.174:0/3770280211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc100890 msgr2=0x7f2dcc1959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:02.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.876+0000 7f2dd3baa700 1 --2- 172.21.15.174:0/3770280211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc100890 0x7f2dcc1959b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400b830 tx=0x7f2dc400bd40 comp rx=0 tx=0).stop 2024-05-06T13:56:02.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.876+0000 7f2dd3baa700 1 -- 172.21.15.174:0/3770280211 shutdown_connections 2024-05-06T13:56:02.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.876+0000 7f2dd3baa700 1 --2- 172.21.15.174:0/3770280211 >> [v2:172.21.15.123:6800/388885730,v1:172.21.15.123:6801/388885730] conn(0x7f2db8038410 0x7f2db803a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:02.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.876+0000 7f2dd3baa700 1 --2- 172.21.15.174:0/3770280211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc100890 0x7f2dcc1959b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:02.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.876+0000 7f2dd3baa700 1 -- 172.21.15.174:0/3770280211 >> 172.21.15.174:0/3770280211 conn(0x7f2dcc0fbe30 msgr2=0x7f2dcc0fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:02.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.876+0000 7f2dd3baa700 1 -- 172.21.15.174:0/3770280211 shutdown_connections 2024-05-06T13:56:02.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:02.877+0000 7f2dd3baa700 1 -- 172.21.15.174:0/3770280211 wait complete. 2024-05-06T13:56:02.878 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:56:03.349 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:02 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/3770280211' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:56:04.541 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:56:04.542 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:56:04.744 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:56:04.791 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:56:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: Active manager daemon smithi123.vjztrj restarted 2024-05-06T13:56:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: Activating manager daemon smithi123.vjztrj 2024-05-06T13:56:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: osdmap e5: 0 total, 0 up, 0 in 2024-05-06T13:56:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: mgrmap e15: smithi123.vjztrj(active, starting, since 0.00306037s) 2024-05-06T13:56:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-05-06T13:56:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr metadata", "who": "smithi123.vjztrj", "id": "smithi123.vjztrj"}]: dispatch 2024-05-06T13:56:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:56:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:56:05.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:56:05.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: Manager daemon smithi123.vjztrj is now available 2024-05-06T13:56:05.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:56:05.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:56:05.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:05.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:56:06.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:05 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.vjztrj/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:56:06.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:05 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi123.vjztrj/trash_purge_schedule"}]: dispatch 2024-05-06T13:56:06.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:05 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:06.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:05 smithi123 ceph-mon[27254]: mgrmap e16: smithi123.vjztrj(active, since 1.00657s) 2024-05-06T13:56:06.391 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.389+0000 7fd1d7d44700 1 -- 172.21.15.174:0/1069982743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1d00ff7a0 msgr2=0x7fd1d00ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.389+0000 7fd1d7d44700 1 --2- 172.21.15.174:0/1069982743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1d00ff7a0 0x7fd1d00ffbc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009910 tx=0x7fd1c0009c20 comp rx=0 tx=0).stop 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.389+0000 7fd1d7d44700 1 -- 172.21.15.174:0/1069982743 shutdown_connections 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.389+0000 7fd1d7d44700 1 --2- 172.21.15.174:0/1069982743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1d00ff7a0 0x7fd1d00ffbc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.389+0000 7fd1d7d44700 1 -- 172.21.15.174:0/1069982743 >> 172.21.15.174:0/1069982743 conn(0x7fd1d00fad20 msgr2=0x7fd1d00fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.389+0000 7fd1d7d44700 1 -- 172.21.15.174:0/1069982743 shutdown_connections 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.389+0000 7fd1d7d44700 1 -- 172.21.15.174:0/1069982743 wait complete. 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.390+0000 7fd1d7d44700 1 Processor -- start 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.390+0000 7fd1d7d44700 1 -- start start 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.390+0000 7fd1d7d44700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1d00ff7a0 0x7fd1d0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.390+0000 7fd1d7d44700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d01986f0 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.390+0000 7fd1d5ae0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1d00ff7a0 0x7fd1d0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.390+0000 7fd1d5ae0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1d00ff7a0 0x7fd1d0068b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:43490/0 (socket says 172.21.15.174:43490) 2024-05-06T13:56:06.392 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.390+0000 7fd1d5ae0700 1 -- 172.21.15.174:0/3627456203 learned_addr learned my addr 172.21.15.174:0/3627456203 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:56:06.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.390+0000 7fd1d5ae0700 1 -- 172.21.15.174:0/3627456203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c00095f0 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.391+0000 7fd1d5ae0700 1 --2- 172.21.15.174:0/3627456203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1d00ff7a0 0x7fd1d0068b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0005950 tx=0x7fd1c0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:06.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.391+0000 7fd1c6ffd700 1 -- 172.21.15.174:0/3627456203 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1c001d070 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.391+0000 7fd1c6ffd700 1 -- 172.21.15.174:0/3627456203 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd1c000be10 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.391+0000 7fd1d7d44700 1 -- 172.21.15.174:0/3627456203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d0198830 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.391+0000 7fd1c6ffd700 1 -- 172.21.15.174:0/3627456203 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1c000f460 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.393 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.391+0000 7fd1d7d44700 1 -- 172.21.15.174:0/3627456203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d0198cd0 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.394 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.392+0000 7fd1c6ffd700 1 -- 172.21.15.174:0/3627456203 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 45204+0+0 (secure 0 0 0) 0x7fd1c000f690 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.394 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.392+0000 7fd1d7d44700 1 -- 172.21.15.174:0/3627456203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d018e3c0 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.394 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.392+0000 7fd1c6ffd700 1 --2- 172.21.15.174:0/3627456203 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fd1bc038250 0x7fd1bc03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:06.394 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.392+0000 7fd1c6ffd700 1 -- 172.21.15.174:0/3627456203 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd1c004c570 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.394 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.392+0000 7fd1d52df700 1 --2- 172.21.15.174:0/3627456203 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fd1bc038250 0x7fd1bc03a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:06.394 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.392+0000 7fd1d52df700 1 --2- 172.21.15.174:0/3627456203 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fd1bc038250 0x7fd1bc03a710 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc006fd0 tx=0x7fd1cc006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:06.397 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.397+0000 7fd1c6ffd700 1 -- 172.21.15.174:0/3627456203 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd1c0020d40 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.674+0000 7fd1d7d44700 1 -- 172.21.15.174:0/3627456203 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd1d002cc70 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.675+0000 7fd1c6ffd700 1 -- 172.21.15.174:0/3627456203 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fd1c0027030 con 0x7fd1d00ff7a0 2024-05-06T13:56:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:56:06.676 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:56:06.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.677+0000 7fd1d7d44700 1 -- 172.21.15.174:0/3627456203 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fd1bc038250 msgr2=0x7fd1bc03a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:06.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.677+0000 7fd1d7d44700 1 --2- 172.21.15.174:0/3627456203 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fd1bc038250 0x7fd1bc03a710 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc006fd0 tx=0x7fd1cc006e40 comp rx=0 tx=0).stop 2024-05-06T13:56:06.679 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.677+0000 7fd1d7d44700 1 -- 172.21.15.174:0/3627456203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1d00ff7a0 msgr2=0x7fd1d0068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:06.679 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.677+0000 7fd1d7d44700 1 --2- 172.21.15.174:0/3627456203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1d00ff7a0 0x7fd1d0068b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0005950 tx=0x7fd1c0009e60 comp rx=0 tx=0).stop 2024-05-06T13:56:06.679 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.677+0000 7fd1d7d44700 1 -- 172.21.15.174:0/3627456203 shutdown_connections 2024-05-06T13:56:06.679 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.677+0000 7fd1d7d44700 1 --2- 172.21.15.174:0/3627456203 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fd1bc038250 0x7fd1bc03a710 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:06.679 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.677+0000 7fd1d7d44700 1 --2- 172.21.15.174:0/3627456203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1d00ff7a0 0x7fd1d0068b00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:06.679 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.677+0000 7fd1d7d44700 1 -- 172.21.15.174:0/3627456203 >> 172.21.15.174:0/3627456203 conn(0x7fd1d00fad20 msgr2=0x7fd1d00fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:06.679 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.677+0000 7fd1d7d44700 1 -- 172.21.15.174:0/3627456203 shutdown_connections 2024-05-06T13:56:06.679 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:06.677+0000 7fd1d7d44700 1 -- 172.21.15.174:0/3627456203 wait complete. 2024-05-06T13:56:06.679 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:56:07.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:07.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:07 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/3627456203' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:56:07.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:08.259 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:56:08.259 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:56:08.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:08 smithi123 ceph-mon[27254]: [06/May/2024:13:56:06] ENGINE Bus STARTING 2024-05-06T13:56:08.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:08 smithi123 ceph-mon[27254]: [06/May/2024:13:56:06] ENGINE Serving on http://172.21.15.123:8765 2024-05-06T13:56:08.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:08 smithi123 ceph-mon[27254]: [06/May/2024:13:56:06] ENGINE Serving on https://172.21.15.123:7150 2024-05-06T13:56:08.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:08 smithi123 ceph-mon[27254]: [06/May/2024:13:56:06] ENGINE Bus STARTED 2024-05-06T13:56:08.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:08 smithi123 ceph-mon[27254]: mgrmap e17: smithi123.vjztrj(active, since 2s) 2024-05-06T13:56:08.779 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:56:08.836 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:56:10.882 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.881+0000 7fb42d10c700 1 -- 172.21.15.174:0/1013371239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4280ff7a0 msgr2=0x7fb4280ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:10.882 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.881+0000 7fb42d10c700 1 --2- 172.21.15.174:0/1013371239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4280ff7a0 0x7fb4280ffbc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb42000b0a0 tx=0x7fb42000b3b0 comp rx=0 tx=0).stop 2024-05-06T13:56:10.883 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.881+0000 7fb42d10c700 1 -- 172.21.15.174:0/1013371239 shutdown_connections 2024-05-06T13:56:10.883 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.881+0000 7fb42d10c700 1 --2- 172.21.15.174:0/1013371239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4280ff7a0 0x7fb4280ffbc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:10.883 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.881+0000 7fb42d10c700 1 -- 172.21.15.174:0/1013371239 >> 172.21.15.174:0/1013371239 conn(0x7fb4280fad20 msgr2=0x7fb4280fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:10.883 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.881+0000 7fb42d10c700 1 -- 172.21.15.174:0/1013371239 shutdown_connections 2024-05-06T13:56:10.883 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.881+0000 7fb42d10c700 1 -- 172.21.15.174:0/1013371239 wait complete. 2024-05-06T13:56:10.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.882+0000 7fb42d10c700 1 Processor -- start 2024-05-06T13:56:10.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.882+0000 7fb42d10c700 1 -- start start 2024-05-06T13:56:10.884 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.882+0000 7fb42d10c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4280ff7a0 0x7fb4281948c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:10.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.882+0000 7fb42d10c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb428194e00 con 0x7fb4280ff7a0 2024-05-06T13:56:10.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.883+0000 7fb426d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4280ff7a0 0x7fb4281948c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:10.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.883+0000 7fb426d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4280ff7a0 0x7fb4281948c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:53582/0 (socket says 172.21.15.174:53582) 2024-05-06T13:56:10.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.883+0000 7fb426d9d700 1 -- 172.21.15.174:0/2081557006 learned_addr learned my addr 172.21.15.174:0/2081557006 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:56:10.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.883+0000 7fb426d9d700 1 -- 172.21.15.174:0/2081557006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420009d00 con 0x7fb4280ff7a0 2024-05-06T13:56:10.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.883+0000 7fb426d9d700 1 --2- 172.21.15.174:0/2081557006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4280ff7a0 0x7fb4281948c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb42000b830 tx=0x7fb42000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:10.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.883+0000 7fb41ffff700 1 -- 172.21.15.174:0/2081557006 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb42000e040 con 0x7fb4280ff7a0 2024-05-06T13:56:10.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.883+0000 7fb41ffff700 1 -- 172.21.15.174:0/2081557006 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb420012af0 con 0x7fb4280ff7a0 2024-05-06T13:56:10.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.883+0000 7fb42d10c700 1 -- 172.21.15.174:0/2081557006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb428195000 con 0x7fb4280ff7a0 2024-05-06T13:56:10.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.883+0000 7fb41ffff700 1 -- 172.21.15.174:0/2081557006 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb42001d9f0 con 0x7fb4280ff7a0 2024-05-06T13:56:10.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.883+0000 7fb42d10c700 1 -- 172.21.15.174:0/2081557006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb428195420 con 0x7fb4280ff7a0 2024-05-06T13:56:10.886 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.884+0000 7fb42d10c700 1 -- 172.21.15.174:0/2081557006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42818e3c0 con 0x7fb4280ff7a0 2024-05-06T13:56:10.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.884+0000 7fb41ffff700 1 -- 172.21.15.174:0/2081557006 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7fb42001dcb0 con 0x7fb4280ff7a0 2024-05-06T13:56:10.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.884+0000 7fb41ffff700 1 --2- 172.21.15.174:0/2081557006 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb4140384b0 0x7fb41403a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:10.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.885+0000 7fb41ffff700 1 -- 172.21.15.174:0/2081557006 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb42004cb30 con 0x7fb4280ff7a0 2024-05-06T13:56:10.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.885+0000 7fb42659c700 1 --2- 172.21.15.174:0/2081557006 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb4140384b0 0x7fb41403a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:10.887 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.885+0000 7fb42659c700 1 --2- 172.21.15.174:0/2081557006 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb4140384b0 0x7fb41403a970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb410006fd0 tx=0x7fb410006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:10.890 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:10.890+0000 7fb41ffff700 1 -- 172.21.15.174:0/2081557006 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb42001c3e0 con 0x7fb4280ff7a0 2024-05-06T13:56:11.152 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:11.152+0000 7fb42d10c700 1 -- 172.21.15.174:0/2081557006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb4280623c0 con 0x7fb4280ff7a0 2024-05-06T13:56:11.153 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:11.153+0000 7fb41ffff700 1 -- 172.21.15.174:0/2081557006 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fb42001c3e0 con 0x7fb4280ff7a0 2024-05-06T13:56:11.153 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:56:11.153 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:56:11.155 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:11.155+0000 7fb42d10c700 1 -- 172.21.15.174:0/2081557006 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb4140384b0 msgr2=0x7fb41403a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:11.156 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:11.155+0000 7fb42d10c700 1 --2- 172.21.15.174:0/2081557006 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb4140384b0 0x7fb41403a970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb410006fd0 tx=0x7fb410006e40 comp rx=0 tx=0).stop 2024-05-06T13:56:11.156 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:11.155+0000 7fb42d10c700 1 -- 172.21.15.174:0/2081557006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4280ff7a0 msgr2=0x7fb4281948c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:11.156 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:11.155+0000 7fb42d10c700 1 --2- 172.21.15.174:0/2081557006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4280ff7a0 0x7fb4281948c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb42000b830 tx=0x7fb42000bd40 comp rx=0 tx=0).stop 2024-05-06T13:56:11.156 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:11.155+0000 7fb42d10c700 1 -- 172.21.15.174:0/2081557006 shutdown_connections 2024-05-06T13:56:11.156 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:11.155+0000 7fb42d10c700 1 --2- 172.21.15.174:0/2081557006 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb4140384b0 0x7fb41403a970 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:11.156 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:11.155+0000 7fb42d10c700 1 --2- 172.21.15.174:0/2081557006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4280ff7a0 0x7fb4281948c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:11.156 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:11.155+0000 7fb42d10c700 1 -- 172.21.15.174:0/2081557006 >> 172.21.15.174:0/2081557006 conn(0x7fb4280fad20 msgr2=0x7fb4280fba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:11.156 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:11.155+0000 7fb42d10c700 1 -- 172.21.15.174:0/2081557006 shutdown_connections 2024-05-06T13:56:11.157 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:11.155+0000 7fb42d10c700 1 -- 172.21.15.174:0/2081557006 wait complete. 2024-05-06T13:56:11.157 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:56:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:56:12.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:12 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/2081557006' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:56:12.718 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:56:12.718 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:56:12.922 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:56:12.969 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T13:56:14.348 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.346+0000 7f2d867cc700 1 -- 172.21.15.174:0/2077647963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d800fef20 msgr2=0x7f2d800ff340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:14.348 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.346+0000 7f2d867cc700 1 --2- 172.21.15.174:0/2077647963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d800fef20 0x7f2d800ff340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009910 tx=0x7f2d70009c20 comp rx=0 tx=0).stop 2024-05-06T13:56:14.348 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.346+0000 7f2d867cc700 1 -- 172.21.15.174:0/2077647963 shutdown_connections 2024-05-06T13:56:14.348 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.346+0000 7f2d867cc700 1 --2- 172.21.15.174:0/2077647963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d800fef20 0x7f2d800ff340 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.346+0000 7f2d867cc700 1 -- 172.21.15.174:0/2077647963 >> 172.21.15.174:0/2077647963 conn(0x7f2d800fa4a0 msgr2=0x7f2d800fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.346+0000 7f2d867cc700 1 -- 172.21.15.174:0/2077647963 shutdown_connections 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.346+0000 7f2d867cc700 1 -- 172.21.15.174:0/2077647963 wait complete. 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.346+0000 7f2d867cc700 1 Processor -- start 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.346+0000 7f2d867cc700 1 -- start start 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.347+0000 7f2d867cc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d800fef20 0x7f2d801959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.347+0000 7f2d867cc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d80195ee0 con 0x7f2d800fef20 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.347+0000 7f2d7ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d800fef20 0x7f2d801959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.347+0000 7f2d7ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d800fef20 0x7f2d801959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:53590/0 (socket says 172.21.15.174:53590) 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.347+0000 7f2d7ffff700 1 -- 172.21.15.174:0/2579626555 learned_addr learned my addr 172.21.15.174:0/2579626555 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.347+0000 7f2d7ffff700 1 -- 172.21.15.174:0/2579626555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d700095f0 con 0x7f2d800fef20 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.347+0000 7f2d7ffff700 1 --2- 172.21.15.174:0/2579626555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d800fef20 0x7f2d801959a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2d70005b40 tx=0x7f2d70004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.347+0000 7f2d7d7fa700 1 -- 172.21.15.174:0/2579626555 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d7001d070 con 0x7f2d800fef20 2024-05-06T13:56:14.349 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.347+0000 7f2d7d7fa700 1 -- 172.21.15.174:0/2579626555 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2d7000be10 con 0x7f2d800fef20 2024-05-06T13:56:14.350 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.347+0000 7f2d867cc700 1 -- 172.21.15.174:0/2579626555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d801960e0 con 0x7f2d800fef20 2024-05-06T13:56:14.350 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.348+0000 7f2d7d7fa700 1 -- 172.21.15.174:0/2579626555 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d7000f460 con 0x7f2d800fef20 2024-05-06T13:56:14.350 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.348+0000 7f2d867cc700 1 -- 172.21.15.174:0/2579626555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d80196580 con 0x7f2d800fef20 2024-05-06T13:56:14.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.348+0000 7f2d7d7fa700 1 -- 172.21.15.174:0/2579626555 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7f2d7000b960 con 0x7f2d800fef20 2024-05-06T13:56:14.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.348+0000 7f2d867cc700 1 -- 172.21.15.174:0/2579626555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8018f340 con 0x7f2d800fef20 2024-05-06T13:56:14.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.348+0000 7f2d7d7fa700 1 --2- 172.21.15.174:0/2579626555 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f2d68038500 0x7f2d6803a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:14.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.349+0000 7f2d7d7fa700 1 -- 172.21.15.174:0/2579626555 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f2d7004c5f0 con 0x7f2d800fef20 2024-05-06T13:56:14.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.349+0000 7f2d7f7fe700 1 --2- 172.21.15.174:0/2579626555 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f2d68038500 0x7f2d6803a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:14.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.349+0000 7f2d7f7fe700 1 --2- 172.21.15.174:0/2579626555 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f2d68038500 0x7f2d6803a9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2d74006fd0 tx=0x7f2d74006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:14.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.353+0000 7f2d7d7fa700 1 -- 172.21.15.174:0/2579626555 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2d7002bb60 con 0x7f2d800fef20 2024-05-06T13:56:14.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.621+0000 7f2d867cc700 1 -- 172.21.15.174:0/2579626555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2d8002cc70 con 0x7f2d800fef20 2024-05-06T13:56:14.622 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.622+0000 7f2d7d7fa700 1 -- 172.21.15.174:0/2579626555 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f2d70027030 con 0x7f2d800fef20 2024-05-06T13:56:14.623 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:56:14.623 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:56:14.625 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.624+0000 7f2d867cc700 1 -- 172.21.15.174:0/2579626555 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f2d68038500 msgr2=0x7f2d6803a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:14.625 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.624+0000 7f2d867cc700 1 --2- 172.21.15.174:0/2579626555 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f2d68038500 0x7f2d6803a9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2d74006fd0 tx=0x7f2d74006e40 comp rx=0 tx=0).stop 2024-05-06T13:56:14.625 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.624+0000 7f2d867cc700 1 -- 172.21.15.174:0/2579626555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d800fef20 msgr2=0x7f2d801959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:14.625 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.624+0000 7f2d867cc700 1 --2- 172.21.15.174:0/2579626555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d800fef20 0x7f2d801959a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2d70005b40 tx=0x7f2d70004740 comp rx=0 tx=0).stop 2024-05-06T13:56:14.625 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.624+0000 7f2d867cc700 1 -- 172.21.15.174:0/2579626555 shutdown_connections 2024-05-06T13:56:14.625 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.624+0000 7f2d867cc700 1 --2- 172.21.15.174:0/2579626555 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f2d68038500 0x7f2d6803a9c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:14.625 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.624+0000 7f2d867cc700 1 --2- 172.21.15.174:0/2579626555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d800fef20 0x7f2d801959a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:14.625 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.624+0000 7f2d867cc700 1 -- 172.21.15.174:0/2579626555 >> 172.21.15.174:0/2579626555 conn(0x7f2d800fa4a0 msgr2=0x7f2d80103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:14.625 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.624+0000 7f2d867cc700 1 -- 172.21.15.174:0/2579626555 shutdown_connections 2024-05-06T13:56:14.625 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:14.624+0000 7f2d867cc700 1 -- 172.21.15.174:0/2579626555 wait complete. 2024-05-06T13:56:14.626 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:56:15.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:15 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:15.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:15 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:15.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:15 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/2579626555' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:56:15.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:15 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:15.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:15 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:15.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:15 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi123", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:56:15.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:15 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:15.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:15 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:56:16.304 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:56:16.305 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:56:16.427 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:16 smithi123 ceph-mon[27254]: Updating smithi123:/etc/ceph/ceph.conf 2024-05-06T13:56:16.427 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:16 smithi123 ceph-mon[27254]: Updating smithi174:/etc/ceph/ceph.conf 2024-05-06T13:56:16.427 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:16 smithi123 ceph-mon[27254]: Updating smithi123:/var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:56:16.427 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:16 smithi123 ceph-mon[27254]: Updating smithi174:/var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:56:16.427 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:16 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:16.427 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:16 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:16.427 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:16 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:16.427 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:16 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:16.428 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:16 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:16.428 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:16 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi174", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T13:56:16.428 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:16 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi174", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-05-06T13:56:16.428 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:16 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:17.032 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:56:17.491 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:17 smithi123 ceph-mon[27254]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:56:17.492 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:17 smithi123 ceph-mon[27254]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:56:17.492 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:17 smithi123 ceph-mon[27254]: Updating smithi123:/var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:56:17.492 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:17 smithi123 ceph-mon[27254]: Updating smithi174:/var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:56:17.492 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:17 smithi123 ceph-mon[27254]: Deploying daemon ceph-exporter.smithi174 on smithi174 2024-05-06T13:56:19.136 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.952+0000 7fca8a223700 1 -- 172.21.15.174:0/2200357959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca84106830 msgr2=0x7fca84106c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:19.136 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.952+0000 7fca8a223700 1 --2- 172.21.15.174:0/2200357959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca84106830 0x7fca84106c10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fca74009910 tx=0x7fca74009c20 comp rx=0 tx=0).stop 2024-05-06T13:56:19.136 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.952+0000 7fca8a223700 1 -- 172.21.15.174:0/2200357959 shutdown_connections 2024-05-06T13:56:19.136 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.952+0000 7fca8a223700 1 --2- 172.21.15.174:0/2200357959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca84106830 0x7fca84106c10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:19.136 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.952+0000 7fca8a223700 1 -- 172.21.15.174:0/2200357959 >> 172.21.15.174:0/2200357959 conn(0x7fca840fc380 msgr2=0x7fca840fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:19.136 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.952+0000 7fca8a223700 1 -- 172.21.15.174:0/2200357959 shutdown_connections 2024-05-06T13:56:19.136 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.952+0000 7fca8a223700 1 -- 172.21.15.174:0/2200357959 wait complete. 2024-05-06T13:56:19.136 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.953+0000 7fca8a223700 1 Processor -- start 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.953+0000 7fca8a223700 1 -- start start 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.953+0000 7fca8a223700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca84106830 0x7fca84195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.953+0000 7fca8a223700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca841962c0 con 0x7fca84106830 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.954+0000 7fca837fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca84106830 0x7fca84195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.954+0000 7fca837fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca84106830 0x7fca84195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:53612/0 (socket says 172.21.15.174:53612) 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.954+0000 7fca837fe700 1 -- 172.21.15.174:0/569863685 learned_addr learned my addr 172.21.15.174:0/569863685 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.954+0000 7fca837fe700 1 -- 172.21.15.174:0/569863685 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740095f0 con 0x7fca84106830 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.954+0000 7fca837fe700 1 --2- 172.21.15.174:0/569863685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca84106830 0x7fca84195d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca740092e0 tx=0x7fca74004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.954+0000 7fca817fa700 1 -- 172.21.15.174:0/569863685 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca7401d070 con 0x7fca84106830 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.955+0000 7fca817fa700 1 -- 172.21.15.174:0/569863685 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fca7400be10 con 0x7fca84106830 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.955+0000 7fca8a223700 1 -- 172.21.15.174:0/569863685 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca84196520 con 0x7fca84106830 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.955+0000 7fca817fa700 1 -- 172.21.15.174:0/569863685 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca74022e10 con 0x7fca84106830 2024-05-06T13:56:19.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.955+0000 7fca8a223700 1 -- 172.21.15.174:0/569863685 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca841969a0 con 0x7fca84106830 2024-05-06T13:56:19.138 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.955+0000 7fca8a223700 1 -- 172.21.15.174:0/569863685 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca840623c0 con 0x7fca84106830 2024-05-06T13:56:19.138 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.956+0000 7fca817fa700 1 -- 172.21.15.174:0/569863685 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7fca7400f460 con 0x7fca84106830 2024-05-06T13:56:19.138 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.956+0000 7fca817fa700 1 --2- 172.21.15.174:0/569863685 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fca70038460 0x7fca7003a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:19.138 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.956+0000 7fca817fa700 1 -- 172.21.15.174:0/569863685 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fca7404c4c0 con 0x7fca84106830 2024-05-06T13:56:19.138 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.956+0000 7fca7affd700 1 --2- 172.21.15.174:0/569863685 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fca70038460 0x7fca7003a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:19.138 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.957+0000 7fca7affd700 1 --2- 172.21.15.174:0/569863685 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fca70038460 0x7fca7003a920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca6c006fd0 tx=0x7fca6c006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:19.138 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:18.961+0000 7fca817fa700 1 -- 172.21.15.174:0/569863685 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fca7402a950 con 0x7fca84106830 2024-05-06T13:56:19.243 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:19.242+0000 7fca8a223700 1 -- 172.21.15.174:0/569863685 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fca84104640 con 0x7fca84106830 2024-05-06T13:56:19.243 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:19.243+0000 7fca817fa700 1 -- 172.21.15.174:0/569863685 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fca74027030 con 0x7fca84106830 2024-05-06T13:56:19.244 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:56:19.244 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:56:19.246 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:19.245+0000 7fca8a223700 1 -- 172.21.15.174:0/569863685 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fca70038460 msgr2=0x7fca7003a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:19.246 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:19.245+0000 7fca8a223700 1 --2- 172.21.15.174:0/569863685 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fca70038460 0x7fca7003a920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca6c006fd0 tx=0x7fca6c006e40 comp rx=0 tx=0).stop 2024-05-06T13:56:19.246 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:19.245+0000 7fca8a223700 1 -- 172.21.15.174:0/569863685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca84106830 msgr2=0x7fca84195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:19.246 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:19.245+0000 7fca8a223700 1 --2- 172.21.15.174:0/569863685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca84106830 0x7fca84195d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca740092e0 tx=0x7fca74004c80 comp rx=0 tx=0).stop 2024-05-06T13:56:19.246 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:19.245+0000 7fca8a223700 1 -- 172.21.15.174:0/569863685 shutdown_connections 2024-05-06T13:56:19.247 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:19.245+0000 7fca8a223700 1 --2- 172.21.15.174:0/569863685 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fca70038460 0x7fca7003a920 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:19.247 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:19.245+0000 7fca8a223700 1 --2- 172.21.15.174:0/569863685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca84106830 0x7fca84195d80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:19.247 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:19.245+0000 7fca8a223700 1 -- 172.21.15.174:0/569863685 >> 172.21.15.174:0/569863685 conn(0x7fca840fc380 msgr2=0x7fca84108bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:19.247 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:19.246+0000 7fca8a223700 1 -- 172.21.15.174:0/569863685 shutdown_connections 2024-05-06T13:56:19.247 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:19.246+0000 7fca8a223700 1 -- 172.21.15.174:0/569863685 wait complete. 2024-05-06T13:56:19.250 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:56:20.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:20.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:20.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:20.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:20.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi174", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T13:56:20.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi174", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-05-06T13:56:20.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:20.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:20 smithi123 ceph-mon[27254]: Deploying daemon crash.smithi174 on smithi174 2024-05-06T13:56:20.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:20 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/569863685' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:56:20.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:20.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:56:20.837 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:56:20.838 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:56:21.052 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:56:22.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.580+0000 7f43f061d700 1 -- 172.21.15.174:0/2227880625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e8105710 msgr2=0x7f43e8105af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:22.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.580+0000 7f43f061d700 1 --2- 172.21.15.174:0/2227880625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e8105710 0x7f43e8105af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009910 tx=0x7f43e4009c20 comp rx=0 tx=0).stop 2024-05-06T13:56:22.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.580+0000 7f43f061d700 1 -- 172.21.15.174:0/2227880625 shutdown_connections 2024-05-06T13:56:22.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.580+0000 7f43f061d700 1 --2- 172.21.15.174:0/2227880625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e8105710 0x7f43e8105af0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:22.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.580+0000 7f43f061d700 1 -- 172.21.15.174:0/2227880625 >> 172.21.15.174:0/2227880625 conn(0x7f43e80fb220 msgr2=0x7f43e80fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:22.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.580+0000 7f43f061d700 1 -- 172.21.15.174:0/2227880625 shutdown_connections 2024-05-06T13:56:22.581 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.580+0000 7f43f061d700 1 -- 172.21.15.174:0/2227880625 wait complete. 2024-05-06T13:56:22.582 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.580+0000 7f43f061d700 1 Processor -- start 2024-05-06T13:56:22.582 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.580+0000 7f43f061d700 1 -- start start 2024-05-06T13:56:22.583 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.581+0000 7f43f061d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e8105710 0x7f43e819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:22.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.581+0000 7f43f061d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e819af30 con 0x7f43e8105710 2024-05-06T13:56:22.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.581+0000 7f43ee3b9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e8105710 0x7f43e819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:22.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.581+0000 7f43ee3b9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e8105710 0x7f43e819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:45148/0 (socket says 172.21.15.174:45148) 2024-05-06T13:56:22.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.581+0000 7f43ee3b9700 1 -- 172.21.15.174:0/281571981 learned_addr learned my addr 172.21.15.174:0/281571981 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:56:22.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.581+0000 7f43ee3b9700 1 -- 172.21.15.174:0/281571981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e40095f0 con 0x7f43e8105710 2024-05-06T13:56:22.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.581+0000 7f43ee3b9700 1 --2- 172.21.15.174:0/281571981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e8105710 0x7f43e819a9f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f43e4005b40 tx=0x7f43e4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:22.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.582+0000 7f43df7fe700 1 -- 172.21.15.174:0/281571981 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43e401d070 con 0x7f43e8105710 2024-05-06T13:56:22.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.582+0000 7f43df7fe700 1 -- 172.21.15.174:0/281571981 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f43e40044d0 con 0x7f43e8105710 2024-05-06T13:56:22.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.582+0000 7f43f061d700 1 -- 172.21.15.174:0/281571981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e819b130 con 0x7f43e8105710 2024-05-06T13:56:22.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.582+0000 7f43df7fe700 1 -- 172.21.15.174:0/281571981 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43e4003910 con 0x7f43e8105710 2024-05-06T13:56:22.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.582+0000 7f43f061d700 1 -- 172.21.15.174:0/281571981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e8194a70 con 0x7f43e8105710 2024-05-06T13:56:22.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.583+0000 7f43df7fe700 1 -- 172.21.15.174:0/281571981 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7f43e4003b90 con 0x7f43e8105710 2024-05-06T13:56:22.585 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.583+0000 7f43df7fe700 1 --2- 172.21.15.174:0/281571981 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f43d40384b0 0x7f43d403a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:22.585 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.583+0000 7f43f061d700 1 -- 172.21.15.174:0/281571981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e80623c0 con 0x7f43e8105710 2024-05-06T13:56:22.585 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.583+0000 7f43df7fe700 1 -- 172.21.15.174:0/281571981 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f43e404d470 con 0x7f43e8105710 2024-05-06T13:56:22.585 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.583+0000 7f43edbb8700 1 --2- 172.21.15.174:0/281571981 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f43d40384b0 0x7f43d403a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:22.585 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.584+0000 7f43edbb8700 1 --2- 172.21.15.174:0/281571981 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f43d40384b0 0x7f43d403a970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43d8006fd0 tx=0x7f43d8006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:22.589 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.588+0000 7f43df7fe700 1 -- 172.21.15.174:0/281571981 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f43e402a950 con 0x7f43e8105710 2024-05-06T13:56:22.862 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.861+0000 7f43f061d700 1 -- 172.21.15.174:0/281571981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f43e81954f0 con 0x7f43e8105710 2024-05-06T13:56:22.862 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.861+0000 7f43df7fe700 1 -- 172.21.15.174:0/281571981 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f43e402a360 con 0x7f43e8105710 2024-05-06T13:56:22.862 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:56:22.862 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:56:22.864 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.863+0000 7f43f061d700 1 -- 172.21.15.174:0/281571981 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f43d40384b0 msgr2=0x7f43d403a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:22.864 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.863+0000 7f43f061d700 1 --2- 172.21.15.174:0/281571981 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f43d40384b0 0x7f43d403a970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43d8006fd0 tx=0x7f43d8006e40 comp rx=0 tx=0).stop 2024-05-06T13:56:22.864 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.863+0000 7f43f061d700 1 -- 172.21.15.174:0/281571981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e8105710 msgr2=0x7f43e819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:22.864 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.863+0000 7f43f061d700 1 --2- 172.21.15.174:0/281571981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e8105710 0x7f43e819a9f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f43e4005b40 tx=0x7f43e4004c80 comp rx=0 tx=0).stop 2024-05-06T13:56:22.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.863+0000 7f43f061d700 1 -- 172.21.15.174:0/281571981 shutdown_connections 2024-05-06T13:56:22.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.863+0000 7f43f061d700 1 --2- 172.21.15.174:0/281571981 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f43d40384b0 0x7f43d403a970 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:22.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.863+0000 7f43f061d700 1 --2- 172.21.15.174:0/281571981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e8105710 0x7f43e819a9f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:22.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.863+0000 7f43f061d700 1 -- 172.21.15.174:0/281571981 >> 172.21.15.174:0/281571981 conn(0x7f43e80fb220 msgr2=0x7f43e8107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:22.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.863+0000 7f43f061d700 1 -- 172.21.15.174:0/281571981 shutdown_connections 2024-05-06T13:56:22.865 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:22.864+0000 7f43f061d700 1 -- 172.21.15.174:0/281571981 wait complete. 2024-05-06T13:56:22.865 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:56:23.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:22 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/281571981' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:56:24.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:24 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:24.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:24 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:24.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:24 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:24.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:24 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:24.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:24 smithi123 ceph-mon[27254]: Deploying daemon node-exporter.smithi174 on smithi174 2024-05-06T13:56:24.515 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:56:24.515 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:56:24.713 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:56:26.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:25 smithi123 ceph-mon[27254]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:26.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:25 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:26.542 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.483+0000 7fc8440ed700 1 -- 172.21.15.174:0/2133477657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc83c105780 msgr2=0x7fc83c105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:26.542 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.483+0000 7fc8440ed700 1 --2- 172.21.15.174:0/2133477657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc83c105780 0x7fc83c105b60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc838009910 tx=0x7fc838009c20 comp rx=0 tx=0).stop 2024-05-06T13:56:26.542 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.483+0000 7fc8440ed700 1 -- 172.21.15.174:0/2133477657 shutdown_connections 2024-05-06T13:56:26.542 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.483+0000 7fc8440ed700 1 --2- 172.21.15.174:0/2133477657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc83c105780 0x7fc83c105b60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:26.542 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.483+0000 7fc8440ed700 1 -- 172.21.15.174:0/2133477657 >> 172.21.15.174:0/2133477657 conn(0x7fc83c0752b0 msgr2=0x7fc83c0756c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:26.542 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.484+0000 7fc8440ed700 1 -- 172.21.15.174:0/2133477657 shutdown_connections 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.484+0000 7fc8440ed700 1 -- 172.21.15.174:0/2133477657 wait complete. 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.484+0000 7fc8440ed700 1 Processor -- start 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.484+0000 7fc8440ed700 1 -- start start 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.485+0000 7fc8440ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc83c105780 0x7fc83c0fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.485+0000 7fc8440ed700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0fe760 con 0x7fc83c105780 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.485+0000 7fc841e89700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc83c105780 0x7fc83c0fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.485+0000 7fc841e89700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc83c105780 0x7fc83c0fc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:45172/0 (socket says 172.21.15.174:45172) 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.485+0000 7fc841e89700 1 -- 172.21.15.174:0/266615102 learned_addr learned my addr 172.21.15.174:0/266615102 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.485+0000 7fc841e89700 1 -- 172.21.15.174:0/266615102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8380095f0 con 0x7fc83c105780 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.485+0000 7fc841e89700 1 --2- 172.21.15.174:0/266615102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc83c105780 0x7fc83c0fc7e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc838005b40 tx=0x7fc838004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.485+0000 7fc832ffd700 1 -- 172.21.15.174:0/266615102 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc83801d070 con 0x7fc83c105780 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.485+0000 7fc832ffd700 1 -- 172.21.15.174:0/266615102 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8380044d0 con 0x7fc83c105780 2024-05-06T13:56:26.543 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.485+0000 7fc8440ed700 1 -- 172.21.15.174:0/266615102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c0fcd20 con 0x7fc83c105780 2024-05-06T13:56:26.544 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.485+0000 7fc832ffd700 1 -- 172.21.15.174:0/266615102 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc838003930 con 0x7fc83c105780 2024-05-06T13:56:26.544 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.485+0000 7fc8440ed700 1 -- 172.21.15.174:0/266615102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c0fd1a0 con 0x7fc83c105780 2024-05-06T13:56:26.544 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.486+0000 7fc8440ed700 1 -- 172.21.15.174:0/266615102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c0623c0 con 0x7fc83c105780 2024-05-06T13:56:26.544 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.486+0000 7fc832ffd700 1 -- 172.21.15.174:0/266615102 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7fc83800b960 con 0x7fc83c105780 2024-05-06T13:56:26.544 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.487+0000 7fc832ffd700 1 --2- 172.21.15.174:0/266615102 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc8280384b0 0x7fc82803a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:26.544 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.487+0000 7fc832ffd700 1 -- 172.21.15.174:0/266615102 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fc83804c510 con 0x7fc83c105780 2024-05-06T13:56:26.544 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.487+0000 7fc841688700 1 --2- 172.21.15.174:0/266615102 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc8280384b0 0x7fc82803a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:26.544 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.487+0000 7fc841688700 1 --2- 172.21.15.174:0/266615102 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc8280384b0 0x7fc82803a970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc82c006fd0 tx=0x7fc82c006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:26.544 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.492+0000 7fc832ffd700 1 -- 172.21.15.174:0/266615102 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc83802a540 con 0x7fc83c105780 2024-05-06T13:56:26.814 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.813+0000 7fc8440ed700 1 -- 172.21.15.174:0/266615102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc83c0fd570 con 0x7fc83c105780 2024-05-06T13:56:26.815 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.814+0000 7fc832ffd700 1 -- 172.21.15.174:0/266615102 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fc83802a360 con 0x7fc83c105780 2024-05-06T13:56:26.815 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:56:26.815 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:56:26.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.816+0000 7fc8440ed700 1 -- 172.21.15.174:0/266615102 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc8280384b0 msgr2=0x7fc82803a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:26.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.816+0000 7fc8440ed700 1 --2- 172.21.15.174:0/266615102 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc8280384b0 0x7fc82803a970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc82c006fd0 tx=0x7fc82c006e40 comp rx=0 tx=0).stop 2024-05-06T13:56:26.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.816+0000 7fc8440ed700 1 -- 172.21.15.174:0/266615102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc83c105780 msgr2=0x7fc83c0fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:26.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.816+0000 7fc8440ed700 1 --2- 172.21.15.174:0/266615102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc83c105780 0x7fc83c0fc7e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc838005b40 tx=0x7fc838004c80 comp rx=0 tx=0).stop 2024-05-06T13:56:26.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.816+0000 7fc8440ed700 1 -- 172.21.15.174:0/266615102 shutdown_connections 2024-05-06T13:56:26.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.816+0000 7fc8440ed700 1 --2- 172.21.15.174:0/266615102 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc8280384b0 0x7fc82803a970 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:26.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.816+0000 7fc8440ed700 1 --2- 172.21.15.174:0/266615102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc83c105780 0x7fc83c0fc7e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:26.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.816+0000 7fc8440ed700 1 -- 172.21.15.174:0/266615102 >> 172.21.15.174:0/266615102 conn(0x7fc83c0752b0 msgr2=0x7fc83c067fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:26.817 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.816+0000 7fc8440ed700 1 -- 172.21.15.174:0/266615102 shutdown_connections 2024-05-06T13:56:26.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:26.816+0000 7fc8440ed700 1 -- 172.21.15.174:0/266615102 wait complete. 2024-05-06T13:56:26.818 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:56:27.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:26 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/266615102' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:56:28.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:27 smithi123 ceph-mon[27254]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:28.890 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:56:28.890 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:56:29.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:29 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:29.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:29 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:29.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:29 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:29.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:29 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:29.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:29 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi174.ybuavj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:56:29.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:29 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi174.ybuavj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-06T13:56:29.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:29 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:56:29.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:29 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:29.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:29 smithi123 ceph-mon[27254]: Deploying daemon mgr.smithi174.ybuavj on smithi174 2024-05-06T13:56:29.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:29 smithi123 ceph-mon[27254]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:29.798 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:56:31.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:30 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.415+0000 7fb75ac05700 1 -- 172.21.15.174:0/3439555918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb754106820 msgr2=0x7fb754106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.415+0000 7fb75ac05700 1 --2- 172.21.15.174:0/3439555918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb754106820 0x7fb754106c00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb748009910 tx=0x7fb748009c20 comp rx=0 tx=0).stop 2024-05-06T13:56:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.415+0000 7fb75ac05700 1 -- 172.21.15.174:0/3439555918 shutdown_connections 2024-05-06T13:56:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.415+0000 7fb75ac05700 1 --2- 172.21.15.174:0/3439555918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb754106820 0x7fb754106c00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.415+0000 7fb75ac05700 1 -- 172.21.15.174:0/3439555918 >> 172.21.15.174:0/3439555918 conn(0x7fb7540fc350 msgr2=0x7fb7540fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:31.417 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.415+0000 7fb75ac05700 1 -- 172.21.15.174:0/3439555918 shutdown_connections 2024-05-06T13:56:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.415+0000 7fb75ac05700 1 -- 172.21.15.174:0/3439555918 wait complete. 2024-05-06T13:56:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.415+0000 7fb75ac05700 1 Processor -- start 2024-05-06T13:56:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.415+0000 7fb75ac05700 1 -- start start 2024-05-06T13:56:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.416+0000 7fb75ac05700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb754106820 0x7fb75419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.416+0000 7fb75ac05700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75419c010 con 0x7fb754106820 2024-05-06T13:56:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.416+0000 7fb7589a1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb754106820 0x7fb75419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.416+0000 7fb7589a1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb754106820 0x7fb75419bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:46690/0 (socket says 172.21.15.174:46690) 2024-05-06T13:56:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.416+0000 7fb7589a1700 1 -- 172.21.15.174:0/2254318342 learned_addr learned my addr 172.21.15.174:0/2254318342 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:56:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.416+0000 7fb7589a1700 1 -- 172.21.15.174:0/2254318342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7480095f0 con 0x7fb754106820 2024-05-06T13:56:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.416+0000 7fb7589a1700 1 --2- 172.21.15.174:0/2254318342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb754106820 0x7fb75419bad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb748005b40 tx=0x7fb748004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:31.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.416+0000 7fb751ffb700 1 -- 172.21.15.174:0/2254318342 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb74801d070 con 0x7fb754106820 2024-05-06T13:56:31.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.416+0000 7fb75ac05700 1 -- 172.21.15.174:0/2254318342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75419c210 con 0x7fb754106820 2024-05-06T13:56:31.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.416+0000 7fb751ffb700 1 -- 172.21.15.174:0/2254318342 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb7480044d0 con 0x7fb754106820 2024-05-06T13:56:31.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.416+0000 7fb751ffb700 1 -- 172.21.15.174:0/2254318342 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb748003910 con 0x7fb754106820 2024-05-06T13:56:31.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.417+0000 7fb75ac05700 1 -- 172.21.15.174:0/2254318342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb754195b50 con 0x7fb754106820 2024-05-06T13:56:31.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.418+0000 7fb751ffb700 1 -- 172.21.15.174:0/2254318342 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7fb74800b960 con 0x7fb754106820 2024-05-06T13:56:31.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.417+0000 7fb75ac05700 1 -- 172.21.15.174:0/2254318342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7540623c0 con 0x7fb754106820 2024-05-06T13:56:31.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.418+0000 7fb751ffb700 1 --2- 172.21.15.174:0/2254318342 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb7440384b0 0x7fb74403a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:31.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.418+0000 7fb751ffb700 1 -- 172.21.15.174:0/2254318342 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb74804c540 con 0x7fb754106820 2024-05-06T13:56:31.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.418+0000 7fb753fff700 1 --2- 172.21.15.174:0/2254318342 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb7440384b0 0x7fb74403a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:31.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.418+0000 7fb753fff700 1 --2- 172.21.15.174:0/2254318342 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb7440384b0 0x7fb74403a970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb740006fd0 tx=0x7fb740006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:31.423 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.423+0000 7fb751ffb700 1 -- 172.21.15.174:0/2254318342 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb74802a540 con 0x7fb754106820 2024-05-06T13:56:31.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.693+0000 7fb75ac05700 1 -- 172.21.15.174:0/2254318342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb754196510 con 0x7fb754106820 2024-05-06T13:56:31.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.693+0000 7fb751ffb700 1 -- 172.21.15.174:0/2254318342 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fb74802a360 con 0x7fb754106820 2024-05-06T13:56:31.694 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:56:31.694 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:56:31.696 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.695+0000 7fb75ac05700 1 -- 172.21.15.174:0/2254318342 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb7440384b0 msgr2=0x7fb74403a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:31.696 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.695+0000 7fb75ac05700 1 --2- 172.21.15.174:0/2254318342 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb7440384b0 0x7fb74403a970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb740006fd0 tx=0x7fb740006e40 comp rx=0 tx=0).stop 2024-05-06T13:56:31.696 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.695+0000 7fb75ac05700 1 -- 172.21.15.174:0/2254318342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb754106820 msgr2=0x7fb75419bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:31.696 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.695+0000 7fb75ac05700 1 --2- 172.21.15.174:0/2254318342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb754106820 0x7fb75419bad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb748005b40 tx=0x7fb748004c80 comp rx=0 tx=0).stop 2024-05-06T13:56:31.696 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.696+0000 7fb75ac05700 1 -- 172.21.15.174:0/2254318342 shutdown_connections 2024-05-06T13:56:31.697 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.696+0000 7fb75ac05700 1 --2- 172.21.15.174:0/2254318342 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb7440384b0 0x7fb74403a970 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:31.697 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.696+0000 7fb75ac05700 1 --2- 172.21.15.174:0/2254318342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb754106820 0x7fb75419bad0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:31.697 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.696+0000 7fb75ac05700 1 -- 172.21.15.174:0/2254318342 >> 172.21.15.174:0/2254318342 conn(0x7fb7540fc350 msgr2=0x7fb754108b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:31.697 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.696+0000 7fb75ac05700 1 -- 172.21.15.174:0/2254318342 shutdown_connections 2024-05-06T13:56:31.697 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:31.696+0000 7fb75ac05700 1 -- 172.21.15.174:0/2254318342 wait complete. 2024-05-06T13:56:31.697 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:56:32.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:31 smithi123 ceph-mon[27254]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:32.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:31 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/2254318342' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:56:33.505 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:56:33.506 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:56:33.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:33 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:33.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:33 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:33.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:33 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:33.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:33 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:33.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:33 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:56:33.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:33 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:33.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:33 smithi123 ceph-mon[27254]: Deploying daemon mon.smithi174 on smithi174 2024-05-06T13:56:34.417 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:56:34.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:34 smithi123 ceph-mon[27254]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:35.505 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:56:35.505 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:35 smithi174 systemd[1]: Starting Ceph mon.smithi174 for f22edd3c-0baf-11ef-bc97-c7b262605968... 2024-05-06T13:56:36.275 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 podman[35095]: 2024-05-06 13:56:36.094483211 +0000 UTC m=+0.020993603 image pull 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3 2024-05-06T13:56:36.311 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.308+0000 7f6606ab6700 1 -- 172.21.15.174:0/1336226284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6600106820 msgr2=0x7f6600106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:36.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.308+0000 7f6606ab6700 1 --2- 172.21.15.174:0/1336226284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6600106820 0x7f6600106c00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009910 tx=0x7f65f4009c20 comp rx=0 tx=0).stop 2024-05-06T13:56:36.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.308+0000 7f6606ab6700 1 -- 172.21.15.174:0/1336226284 shutdown_connections 2024-05-06T13:56:36.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.308+0000 7f6606ab6700 1 --2- 172.21.15.174:0/1336226284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6600106820 0x7f6600106c00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:36.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.308+0000 7f6606ab6700 1 -- 172.21.15.174:0/1336226284 >> 172.21.15.174:0/1336226284 conn(0x7f66000752b0 msgr2=0x7f66000756c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:36.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.308+0000 7f6606ab6700 1 -- 172.21.15.174:0/1336226284 shutdown_connections 2024-05-06T13:56:36.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.308+0000 7f6606ab6700 1 -- 172.21.15.174:0/1336226284 wait complete. 2024-05-06T13:56:36.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.308+0000 7f6606ab6700 1 Processor -- start 2024-05-06T13:56:36.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.308+0000 7f6606ab6700 1 -- start start 2024-05-06T13:56:36.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.309+0000 7f6606ab6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6600106820 0x7f6600195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:36.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.309+0000 7f6606ab6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6600196210 con 0x7f6600106820 2024-05-06T13:56:36.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.309+0000 7f6604852700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6600106820 0x7f6600195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:36.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.309+0000 7f6604852700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6600106820 0x7f6600195cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.174:46720/0 (socket says 172.21.15.174:46720) 2024-05-06T13:56:36.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.309+0000 7f6604852700 1 -- 172.21.15.174:0/3905573063 learned_addr learned my addr 172.21.15.174:0/3905573063 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:56:36.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.309+0000 7f6604852700 1 -- 172.21.15.174:0/3905573063 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f40095f0 con 0x7f6600106820 2024-05-06T13:56:36.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.309+0000 7f6604852700 1 --2- 172.21.15.174:0/3905573063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6600106820 0x7f6600195cd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f65f4005b40 tx=0x7f65f4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:36.314 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.309+0000 7f65fdffb700 1 -- 172.21.15.174:0/3905573063 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65f401d070 con 0x7f6600106820 2024-05-06T13:56:36.314 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.309+0000 7f65fdffb700 1 -- 172.21.15.174:0/3905573063 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f65f40044d0 con 0x7f6600106820 2024-05-06T13:56:36.314 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.309+0000 7f6606ab6700 1 -- 172.21.15.174:0/3905573063 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6600196410 con 0x7f6600106820 2024-05-06T13:56:36.314 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.310+0000 7f65fdffb700 1 -- 172.21.15.174:0/3905573063 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65f4003910 con 0x7f6600106820 2024-05-06T13:56:36.314 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.310+0000 7f6606ab6700 1 -- 172.21.15.174:0/3905573063 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6600196890 con 0x7f6600106820 2024-05-06T13:56:36.314 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.310+0000 7f65fdffb700 1 -- 172.21.15.174:0/3905573063 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7f65f4003b90 con 0x7f6600106820 2024-05-06T13:56:36.315 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.311+0000 7f65fdffb700 1 --2- 172.21.15.174:0/3905573063 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f65f00384f0 0x7f65f003a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:36.315 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.311+0000 7f65fdffb700 1 -- 172.21.15.174:0/3905573063 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f65f404c4d0 con 0x7f6600106820 2024-05-06T13:56:36.315 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.311+0000 7f65fffff700 1 --2- 172.21.15.174:0/3905573063 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f65f00384f0 0x7f65f003a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:36.316 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.311+0000 7f6606ab6700 1 -- 172.21.15.174:0/3905573063 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66000623c0 con 0x7f6600106820 2024-05-06T13:56:36.316 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.311+0000 7f65fffff700 1 --2- 172.21.15.174:0/3905573063 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f65f00384f0 0x7f65f003a9b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65ec006fd0 tx=0x7f65ec006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:36.320 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.320+0000 7f65fdffb700 1 -- 172.21.15.174:0/3905573063 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f65f402a950 con 0x7f6600106820 2024-05-06T13:56:36.589 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 podman[35095]: 2024-05-06 13:56:36.395839917 +0000 UTC m=+0.322350280 container create 24bb2b963f5a800c47a502e88695d40bb7119f55d33c581c4221a057f3eabdaa (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi174, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-06T13:56:36.601 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.600+0000 7f6606ab6700 1 -- 172.21.15.174:0/3905573063 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6600105510 con 0x7f6600106820 2024-05-06T13:56:36.602 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.600+0000 7f65fdffb700 1 -- 172.21.15.174:0/3905573063 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f65f402a360 con 0x7f6600106820 2024-05-06T13:56:36.602 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:56:36.602 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:53:47.753354Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T13:56:36.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:36 smithi123 ceph-mon[27254]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:36.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.604+0000 7f6606ab6700 1 -- 172.21.15.174:0/3905573063 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f65f00384f0 msgr2=0x7f65f003a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:36.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.604+0000 7f6606ab6700 1 --2- 172.21.15.174:0/3905573063 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f65f00384f0 0x7f65f003a9b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65ec006fd0 tx=0x7f65ec006e40 comp rx=0 tx=0).stop 2024-05-06T13:56:36.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.604+0000 7f6606ab6700 1 -- 172.21.15.174:0/3905573063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6600106820 msgr2=0x7f6600195cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:36.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.604+0000 7f6606ab6700 1 --2- 172.21.15.174:0/3905573063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6600106820 0x7f6600195cd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f65f4005b40 tx=0x7f65f4004c80 comp rx=0 tx=0).stop 2024-05-06T13:56:36.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.604+0000 7f6606ab6700 1 -- 172.21.15.174:0/3905573063 shutdown_connections 2024-05-06T13:56:36.605 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.604+0000 7f6606ab6700 1 --2- 172.21.15.174:0/3905573063 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f65f00384f0 0x7f65f003a9b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:36.606 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.604+0000 7f6606ab6700 1 --2- 172.21.15.174:0/3905573063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6600106820 0x7f6600195cd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:36.606 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.604+0000 7f6606ab6700 1 -- 172.21.15.174:0/3905573063 >> 172.21.15.174:0/3905573063 conn(0x7f66000752b0 msgr2=0x7f66000fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:36.606 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.604+0000 7f6606ab6700 1 -- 172.21.15.174:0/3905573063 shutdown_connections 2024-05-06T13:56:36.606 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:36.604+0000 7f6606ab6700 1 -- 172.21.15.174:0/3905573063 wait complete. 2024-05-06T13:56:36.606 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-05-06T13:56:36.916 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 podman[35095]: 2024-05-06 13:56:36.623839005 +0000 UTC m=+0.550349371 container init 24bb2b963f5a800c47a502e88695d40bb7119f55d33c581c4221a057f3eabdaa (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi174, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD) 2024-05-06T13:56:36.917 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 podman[35095]: 2024-05-06 13:56:36.629445761 +0000 UTC m=+0.555956126 container start 24bb2b963f5a800c47a502e88695d40bb7119f55d33c581c4221a057f3eabdaa (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi174, GIT_CLEAN=True, io.buildah.version=1.29.1, ceph=True, org.label-schema.build-date=20240222, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-06T13:56:36.917 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: set uid:gid to 167:167 (ceph:ceph) 2024-05-06T13:56:36.917 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process ceph-mon, pid 2 2024-05-06T13:56:36.917 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: pidfile_write: ignore empty --pid-file 2024-05-06T13:56:36.917 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: load: jerasure load: lrc 2024-05-06T13:56:36.917 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: RocksDB version: 7.9.2 2024-05-06T13:56:36.918 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Git sha 0 2024-05-06T13:56:36.918 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Compile date 2023-12-11 22:07:34 2024-05-06T13:56:36.918 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: DB SUMMARY 2024-05-06T13:56:36.918 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: DB Session ID: N2PEO6UFSDHIX02WPWIN 2024-05-06T13:56:36.918 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: CURRENT file: CURRENT 2024-05-06T13:56:36.918 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: IDENTITY file: IDENTITY 2024-05-06T13:56:36.918 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-06T13:56:36.918 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi174/store.db dir, Total Num: 0, files: 2024-05-06T13:56:36.919 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi174/store.db: 000004.log size: 511 ; 2024-05-06T13:56:36.919 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.error_if_exists: 0 2024-05-06T13:56:36.919 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.create_if_missing: 0 2024-05-06T13:56:36.919 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.paranoid_checks: 1 2024-05-06T13:56:36.919 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-06T13:56:36.919 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-06T13:56:36.919 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-06T13:56:36.919 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.env: 0x55999fa19720 2024-05-06T13:56:36.919 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.fs: PosixFileSystem 2024-05-06T13:56:36.920 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.info_log: 0x5599a20832e0 2024-05-06T13:56:36.920 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_file_opening_threads: 16 2024-05-06T13:56:36.920 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.statistics: (nil) 2024-05-06T13:56:36.923 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.use_fsync: 0 2024-05-06T13:56:36.923 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_log_file_size: 0 2024-05-06T13:56:36.923 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-06T13:56:36.923 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-06T13:56:36.923 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.keep_log_file_num: 1000 2024-05-06T13:56:36.923 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.recycle_log_file_num: 0 2024-05-06T13:56:36.924 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.allow_fallocate: 1 2024-05-06T13:56:36.924 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.allow_mmap_reads: 0 2024-05-06T13:56:36.924 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.allow_mmap_writes: 0 2024-05-06T13:56:36.924 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.use_direct_reads: 0 2024-05-06T13:56:36.924 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-06T13:56:36.924 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.create_missing_column_families: 0 2024-05-06T13:56:36.924 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.db_log_dir: 2024-05-06T13:56:36.924 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.wal_dir: 2024-05-06T13:56:36.924 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-06T13:56:36.924 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-06T13:56:36.924 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-06T13:56:36.924 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.advise_random_on_open: 1 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.db_write_buffer_size: 0 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.write_buffer_manager: 0x5599a12f4140 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.rate_limiter: (nil) 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.wal_recovery_mode: 2 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.enable_thread_tracking: 0 2024-05-06T13:56:36.925 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.enable_pipelined_write: 0 2024-05-06T13:56:36.926 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.unordered_write: 0 2024-05-06T13:56:36.926 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-06T13:56:36.926 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-06T13:56:36.926 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-06T13:56:36.926 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-06T13:56:36.926 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.row_cache: None 2024-05-06T13:56:36.926 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.wal_filter: None 2024-05-06T13:56:36.926 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-06T13:56:36.926 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.allow_ingest_behind: 0 2024-05-06T13:56:36.926 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.two_write_queues: 0 2024-05-06T13:56:36.926 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.manual_wal_flush: 0 2024-05-06T13:56:36.926 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.wal_compression: 0 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.atomic_flush: 0 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.log_readahead_size: 0 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.best_efforts_recovery: 0 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.allow_data_in_errors: 0 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.db_host_id: __hostname__ 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_background_jobs: 2 2024-05-06T13:56:36.927 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_background_compactions: -1 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_subcompactions: 1 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_total_wal_size: 0 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_open_files: -1 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bytes_per_sync: 0 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-06T13:56:36.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_readahead_size: 0 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_background_flushes: -1 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Compression algorithms supported: 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: kZSTD supported: 0 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: kXpressCompression supported: 0 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: kLZ4HCCompression supported: 1 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: kZlibCompression supported: 1 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: kSnappyCompression supported: 1 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: kLZ4Compression supported: 1 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: kBZip2Compression supported: 0 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-06T13:56:36.929 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi174/store.db/MANIFEST-000005 2024-05-06T13:56:36.930 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-06T13:56:36.930 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-06T13:56:36.930 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.merge_operator: 2024-05-06T13:56:36.930 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_filter: None 2024-05-06T13:56:36.930 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_filter_factory: None 2024-05-06T13:56:36.930 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.sst_partitioner_factory: None 2024-05-06T13:56:36.930 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-06T13:56:36.930 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-06T13:56:36.930 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5599a20833e0) 2024-05-06T13:56:36.930 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: cache_index_and_filter_blocks: 1 2024-05-06T13:56:36.930 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-06T13:56:36.930 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-06T13:56:36.931 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: pin_top_level_index_and_filter: 1 2024-05-06T13:56:36.931 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: index_type: 0 2024-05-06T13:56:36.931 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: data_block_index_type: 0 2024-05-06T13:56:36.931 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: index_shortening: 1 2024-05-06T13:56:36.931 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-06T13:56:36.931 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: checksum: 4 2024-05-06T13:56:36.931 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: no_block_cache: 0 2024-05-06T13:56:36.931 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: block_cache: 0x5599a1395350 2024-05-06T13:56:36.931 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: block_cache_name: BinnedLRUCache 2024-05-06T13:56:36.931 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: block_cache_options: 2024-05-06T13:56:36.931 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: capacity : 536870912 2024-05-06T13:56:36.931 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: num_shard_bits : 4 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: strict_capacity_limit : 0 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: high_pri_pool_ratio: 0.000 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: block_cache_compressed: (nil) 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: persistent_cache: (nil) 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: block_size: 4096 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: block_size_deviation: 10 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: block_restart_interval: 16 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: index_block_restart_interval: 1 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: metadata_block_size: 4096 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: partition_filters: 0 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: use_delta_encoding: 1 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: filter_policy: bloomfilter 2024-05-06T13:56:36.932 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: whole_key_filtering: 1 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: verify_compression: 0 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: read_amp_bytes_per_bit: 0 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: format_version: 5 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: enable_index_compression: 1 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: block_align: 0 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: max_auto_readahead_size: 262144 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: prepopulate_block_cache: 0 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: initial_auto_readahead_size: 8192 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: num_file_reads_for_auto_readahead: 2 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.write_buffer_size: 33554432 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_write_buffer_number: 2 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compression: NoCompression 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bottommost_compression: Disabled 2024-05-06T13:56:36.933 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.prefix_extractor: nullptr 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.num_levels: 7 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-06T13:56:36.934 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-06T13:56:36.935 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-06T13:56:36.935 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compression_opts.level: 32767 2024-05-06T13:56:36.935 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compression_opts.strategy: 0 2024-05-06T13:56:36.935 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-06T13:56:36.935 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-06T13:56:36.935 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-06T13:56:36.935 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-06T13:56:36.935 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compression_opts.enabled: false 2024-05-06T13:56:36.935 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-06T13:56:36.935 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-06T13:56:36.935 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-06T13:56:36.935 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-06T13:56:36.936 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.target_file_size_base: 67108864 2024-05-06T13:56:36.936 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-06T13:56:36.936 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-06T13:56:36.936 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-06T13:56:36.936 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-06T13:56:36.936 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-06T13:56:36.936 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-06T13:56:36.936 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-06T13:56:36.937 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-06T13:56:36.937 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-06T13:56:36.937 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-06T13:56:36.937 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-06T13:56:36.937 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-06T13:56:36.937 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-06T13:56:36.937 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-06T13:56:36.937 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.arena_block_size: 1048576 2024-05-06T13:56:36.938 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-06T13:56:36.938 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-06T13:56:36.938 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.disable_auto_compactions: 0 2024-05-06T13:56:36.938 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-06T13:56:36.938 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-06T13:56:36.938 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-06T13:56:36.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-06T13:56:36.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-06T13:56:36.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-06T13:56:36.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-06T13:56:36.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-06T13:56:36.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-06T13:56:36.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-06T13:56:36.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.table_properties_collectors: 2024-05-06T13:56:36.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.inplace_update_support: 0 2024-05-06T13:56:36.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-06T13:56:36.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-06T13:56:36.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-06T13:56:36.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-06T13:56:36.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.bloom_locality: 0 2024-05-06T13:56:36.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.max_successive_merges: 0 2024-05-06T13:56:36.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-06T13:56:36.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.paranoid_file_checks: 0 2024-05-06T13:56:36.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.force_consistency_checks: 1 2024-05-06T13:56:36.941 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.report_bg_io_stats: 0 2024-05-06T13:56:36.941 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.ttl: 2592000 2024-05-06T13:56:36.941 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-06T13:56:36.941 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-06T13:56:36.941 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-06T13:56:36.941 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.enable_blob_files: false 2024-05-06T13:56:36.941 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.min_blob_size: 0 2024-05-06T13:56:36.941 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.blob_file_size: 268435456 2024-05-06T13:56:36.941 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-06T13:56:36.942 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-06T13:56:36.942 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-06T13:56:36.942 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-06T13:56:36.942 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-06T13:56:36.942 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.blob_file_starting_level: 0 2024-05-06T13:56:36.942 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-06T13:56:36.942 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi174/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-06T13:56:36.942 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-06T13:56:36.942 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 87a97ca9-217a-4c5d-aece-16af4c312a6e 2024-05-06T13:56:36.942 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715003796660410, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-06T13:56:36.942 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-06T13:56:36.943 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715003796661023, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715003796, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "87a97ca9-217a-4c5d-aece-16af4c312a6e", "db_session_id": "N2PEO6UFSDHIX02WPWIN", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-06T13:56:36.943 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715003796661133, "job": 1, "event": "recovery_finished"} 2024-05-06T13:56:36.943 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-06T13:56:36.943 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi174/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-06T13:56:36.943 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5599a1432000 2024-05-06T13:56:36.943 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: DB pointer 0x5599a141e000 2024-05-06T13:56:36.943 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-06T13:56:36.943 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-06T13:56:36.943 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: ** DB Stats ** 2024-05-06T13:56:36.943 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T13:56:36.943 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-06T13:56:36.943 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T13:56:36.944 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T13:56:36.944 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-06T13:56:36.944 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T13:56:36.944 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T13:56:36.944 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: 2024-05-06T13:56:36.944 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: ** Compaction Stats [default] ** 2024-05-06T13:56:36.944 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T13:56:36.944 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-06T13:56:36.944 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-06T13:56:36.944 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-06T13:56:36.945 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-06T13:56:36.945 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: 2024-05-06T13:56:36.945 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: ** Compaction Stats [default] ** 2024-05-06T13:56:36.945 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T13:56:36.945 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T13:56:36.945 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-06T13:56:36.945 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: 2024-05-06T13:56:36.945 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-06T13:56:36.945 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: 2024-05-06T13:56:36.945 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T13:56:36.946 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-06T13:56:36.946 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-06T13:56:36.946 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-06T13:56:36.946 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-06T13:56:36.946 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-06T13:56:36.946 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Cumulative compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T13:56:36.946 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Interval compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T13:56:36.946 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-06T13:56:36.947 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Block cache BinnedLRUCache@0x5599a1395350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-06T13:56:36.947 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-06T13:56:36.947 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: 2024-05-06T13:56:36.947 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-06T13:56:36.947 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174 does not exist in monmap, will attempt to join an existing cluster 2024-05-06T13:56:36.947 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: using public_addr v2:172.21.15.174:0/0 -> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] 2024-05-06T13:56:36.947 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: starting mon.smithi174 rank -1 at public addrs [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] at bind addrs [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi174 fsid f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:56:36.947 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(???) e0 preinit fsid f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:56:36.947 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).mds e1 new map 2024-05-06T13:56:36.947 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).mds e1 print_map 2024-05-06T13:56:36.948 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: e1 2024-05-06T13:56:36.948 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T13:56:36.948 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T13:56:36.948 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: legacy client fscid: -1 2024-05-06T13:56:36.948 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: 2024-05-06T13:56:36.948 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout: No filesystems configured 2024-05-06T13:56:36.948 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-06T13:56:36.948 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-06T13:56:36.948 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-06T13:56:36.949 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-06T13:56:36.949 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-06T13:56:36.949 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-06T13:56:36.949 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-05-06T13:56:36.949 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-06T13:56:36.949 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T13:56:36.949 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T13:56:36.949 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T13:56:36.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:36.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:36.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:36.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:36.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi174.ybuavj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:56:36.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi174.ybuavj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-06T13:56:36.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:56:36.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:36.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: Deploying daemon mgr.smithi174.ybuavj on smithi174 2024-05-06T13:56:36.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:36.951 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:36.951 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:36.951 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='client.? 172.21.15.174:0/2254318342' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:56:36.951 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:36.951 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:36.951 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:36.951 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:36.951 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:56:36.951 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:36.952 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: Deploying daemon mon.smithi174 on smithi174 2024-05-06T13:56:36.952 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:36.952 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:56:36.952 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:36.952 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:36.952 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-05-06T13:56:36.952 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: mon.smithi174@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-05-06T13:56:36.952 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: expand_channel_meta expand map: {default=false} 2024-05-06T13:56:36.953 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: expand_channel_meta from 'false' to 'false' 2024-05-06T13:56:36.953 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: expand_channel_meta expanded map: {default=false} 2024-05-06T13:56:36.953 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: expand_channel_meta expand map: {default=info} 2024-05-06T13:56:36.953 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: expand_channel_meta from 'info' to 'info' 2024-05-06T13:56:36.953 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: expand_channel_meta expanded map: {default=info} 2024-05-06T13:56:36.953 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: expand_channel_meta expand map: {default=daemon} 2024-05-06T13:56:36.953 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: expand_channel_meta from 'daemon' to 'daemon' 2024-05-06T13:56:36.953 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: expand_channel_meta expanded map: {default=daemon} 2024-05-06T13:56:36.953 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: expand_channel_meta expand map: {default=debug} 2024-05-06T13:56:36.953 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: expand_channel_meta from 'debug' to 'debug' 2024-05-06T13:56:36.954 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 ceph-mon[35160]: expand_channel_meta expanded map: {default=debug} 2024-05-06T13:56:36.954 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 bash[35095]: 24bb2b963f5a800c47a502e88695d40bb7119f55d33c581c4221a057f3eabdaa 2024-05-06T13:56:36.954 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:36 smithi174 systemd[1]: Started Ceph mon.smithi174 for f22edd3c-0baf-11ef-bc97-c7b262605968. 2024-05-06T13:56:38.358 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T13:56:38.358 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T13:56:38.582 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi174/config 2024-05-06T13:56:42.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-05-06T13:56:42.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: mon.smithi123 calling monitor election 2024-05-06T13:56:42.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.024 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:42.024 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.024 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.024 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: mon.smithi174 calling monitor election 2024-05-06T13:56:42.024 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:42.024 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.? 172.21.15.174:0/676053402' entity='mgr.smithi174.ybuavj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi174.ybuavj/crt"}]: dispatch 2024-05-06T13:56:42.024 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.024 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.024 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:42.024 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.024 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: mon.smithi123 is new leader, mons smithi123,smithi174 in quorum (ranks 0,1) 2024-05-06T13:56:42.025 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: monmap e2: 2 mons at {smithi123=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],smithi174=[v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-06T13:56:42.025 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: fsmap 2024-05-06T13:56:42.025 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: osdmap e5: 0 total, 0 up, 0 in 2024-05-06T13:56:42.025 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: mgrmap e17: smithi123.vjztrj(active, since 36s) 2024-05-06T13:56:42.025 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: Standby manager daemon smithi174.ybuavj started 2024-05-06T13:56:42.025 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.? 172.21.15.174:0/676053402' entity='mgr.smithi174.ybuavj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:56:42.025 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: overall HEALTH_OK 2024-05-06T13:56:42.025 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.? 172.21.15.174:0/676053402' entity='mgr.smithi174.ybuavj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi174.ybuavj/key"}]: dispatch 2024-05-06T13:56:42.025 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.? 172.21.15.174:0/676053402' entity='mgr.smithi174.ybuavj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:56:42.025 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:42.025 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:42.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-05-06T13:56:42.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: mon.smithi123 calling monitor election 2024-05-06T13:56:42.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:42.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: mon.smithi174 calling monitor election 2024-05-06T13:56:42.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:42.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.? 172.21.15.174:0/676053402' entity='mgr.smithi174.ybuavj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi174.ybuavj/crt"}]: dispatch 2024-05-06T13:56:42.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:42.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.106 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: mon.smithi123 is new leader, mons smithi123,smithi174 in quorum (ranks 0,1) 2024-05-06T13:56:42.106 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: monmap e2: 2 mons at {smithi123=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],smithi174=[v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-06T13:56:42.106 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: fsmap 2024-05-06T13:56:42.106 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: osdmap e5: 0 total, 0 up, 0 in 2024-05-06T13:56:42.106 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: mgrmap e17: smithi123.vjztrj(active, since 36s) 2024-05-06T13:56:42.106 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: Standby manager daemon smithi174.ybuavj started 2024-05-06T13:56:42.106 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.? 172.21.15.174:0/676053402' entity='mgr.smithi174.ybuavj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:56:42.106 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: overall HEALTH_OK 2024-05-06T13:56:42.106 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.? 172.21.15.174:0/676053402' entity='mgr.smithi174.ybuavj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi174.ybuavj/key"}]: dispatch 2024-05-06T13:56:42.107 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.? 172.21.15.174:0/676053402' entity='mgr.smithi174.ybuavj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:56:42.107 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:42.107 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:42.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:42 smithi123 ceph-mon[27254]: mgrmap e18: smithi123.vjztrj(active, since 36s), standbys: smithi174.ybuavj 2024-05-06T13:56:42.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr metadata", "who": "smithi174.ybuavj", "id": "smithi174.ybuavj"}]: dispatch 2024-05-06T13:56:42.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:42.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:42.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:42.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:56:42.855 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.987 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.986+0000 7f34b437a700 1 -- 172.21.15.174:0/85660734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980035c0 msgr2=0x7f3498005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:42.987 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.986+0000 7f34b437a700 1 --2- 172.21.15.174:0/85660734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980035c0 0x7f3498005a50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f34ac075e90 tx=0x7f34a400feb0 comp rx=0 tx=0).stop 2024-05-06T13:56:42.987 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.986+0000 7f34b437a700 1 -- 172.21.15.174:0/85660734 shutdown_connections 2024-05-06T13:56:42.987 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.986+0000 7f34b437a700 1 --2- 172.21.15.174:0/85660734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980035c0 0x7f3498005a50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:42.987 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.986+0000 7f34b437a700 1 -- 172.21.15.174:0/85660734 >> 172.21.15.174:0/85660734 conn(0x7f34ac074ae0 msgr2=0x7f34ac074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:42.987 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.986+0000 7f34b437a700 1 -- 172.21.15.174:0/85660734 shutdown_connections 2024-05-06T13:56:42.987 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.986+0000 7f34b437a700 1 -- 172.21.15.174:0/85660734 wait complete. 2024-05-06T13:56:42.988 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:42 smithi174 ceph-mon[35160]: mgrmap e18: smithi123.vjztrj(active, since 36s), standbys: smithi174.ybuavj 2024-05-06T13:56:42.988 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr metadata", "who": "smithi174.ybuavj", "id": "smithi174.ybuavj"}]: dispatch 2024-05-06T13:56:42.988 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:42.988 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:42.988 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:42.988 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:56:42.988 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:56:42.990 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.986+0000 7f34b437a700 1 Processor -- start 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b437a700 1 -- start start 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b437a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34980035c0 0x7f34ac194c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b437a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34ac1951c0 0x7f34ac195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b437a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0fff80 con 0x7f34ac1951c0 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b437a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac1a22f0 con 0x7f34980035c0 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b2116700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34980035c0 0x7f34ac194c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b2116700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34980035c0 0x7f34ac194c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:44092/0 (socket says 172.21.15.174:44092) 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b2116700 1 -- 172.21.15.174:0/2152470958 learned_addr learned my addr 172.21.15.174:0/2152470958 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b1915700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34ac1951c0 0x7f34ac195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b2116700 1 -- 172.21.15.174:0/2152470958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34980035c0 msgr2=0x7f34ac194c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b2116700 1 -- 172.21.15.174:0/2152470958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34980035c0 msgr2=0x7f34ac194c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b2116700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34980035c0 0x7f34ac194c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-06T13:56:42.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b2116700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34980035c0 0x7f34ac194c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T13:56:42.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b1915700 1 -- 172.21.15.174:0/2152470958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34980035c0 msgr2=0x7f34ac194c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T13:56:42.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b1915700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34980035c0 0x7f34ac194c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:42.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b1915700 1 -- 172.21.15.174:0/2152470958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a400f900 con 0x7f34ac1951c0 2024-05-06T13:56:42.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.987+0000 7f34b1915700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34ac1951c0 0x7f34ac195640 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f349c00b4d0 tx=0x7f349c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:42.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.988+0000 7f34a37fe700 1 -- 172.21.15.174:0/2152470958 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f349c011800 con 0x7f34ac1951c0 2024-05-06T13:56:42.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.988+0000 7f34a37fe700 1 -- 172.21.15.174:0/2152470958 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f349c011e10 con 0x7f34ac1951c0 2024-05-06T13:56:42.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.988+0000 7f34b437a700 1 -- 172.21.15.174:0/2152470958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac1a2430 con 0x7f34ac1951c0 2024-05-06T13:56:42.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.988+0000 7f34a37fe700 1 -- 172.21.15.174:0/2152470958 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f349c00f2e0 con 0x7f34ac1951c0 2024-05-06T13:56:42.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.988+0000 7f34b437a700 1 -- 172.21.15.174:0/2152470958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac1a2980 con 0x7f34ac1951c0 2024-05-06T13:56:42.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.989+0000 7f34b437a700 1 -- 172.21.15.174:0/2152470958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac0623c0 con 0x7f34ac1951c0 2024-05-06T13:56:42.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.989+0000 7f34a37fe700 1 -- 172.21.15.174:0/2152470958 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 90258+0+0 (secure 0 0 0) 0x7f349c011960 con 0x7f34ac1951c0 2024-05-06T13:56:42.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.990+0000 7f34a37fe700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f349006c5b0 0x7f349006ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:42.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.990+0000 7f34a37fe700 1 -- 172.21.15.174:0/2152470958 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f349c08a2b0 con 0x7f34ac1951c0 2024-05-06T13:56:42.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.990+0000 7f34b2116700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f349006c5b0 0x7f349006ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:42.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.990+0000 7f34b2116700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f349006c5b0 0x7f349006ea70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f34a4005ed0 tx=0x7f34a4005e60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:42.995 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:42.995+0000 7f34a37fe700 1 -- 172.21.15.174:0/2152470958 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f349c059680 con 0x7f34ac1951c0 2024-05-06T13:56:43.275 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.275+0000 7f34b437a700 1 -- 172.21.15.174:0/2152470958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f34ac0ff5e0 con 0x7f34ac1951c0 2024-05-06T13:56:43.276 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.275+0000 7f34a37fe700 1 -- 172.21.15.174:0/2152470958 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1026 (secure 0 0 0) 0x7f349c015020 con 0x7f34ac1951c0 2024-05-06T13:56:43.276 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-06T13:56:43.276 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":2,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","modified":"2024-05-06T13:56:36.689569Z","created":"2024-05-06T13:53:47.753354Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi123","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi174","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-06T13:56:43.278 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.277+0000 7f34b437a700 1 -- 172.21.15.174:0/2152470958 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f349006c5b0 msgr2=0x7f349006ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:43.278 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.277+0000 7f34b437a700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f349006c5b0 0x7f349006ea70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f34a4005ed0 tx=0x7f34a4005e60 comp rx=0 tx=0).stop 2024-05-06T13:56:43.278 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.277+0000 7f34b437a700 1 -- 172.21.15.174:0/2152470958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34ac1951c0 msgr2=0x7f34ac195640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:43.279 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.277+0000 7f34b437a700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34ac1951c0 0x7f34ac195640 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f349c00b4d0 tx=0x7f349c00b890 comp rx=0 tx=0).stop 2024-05-06T13:56:43.279 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.278+0000 7f34b437a700 1 -- 172.21.15.174:0/2152470958 shutdown_connections 2024-05-06T13:56:43.279 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.278+0000 7f34b437a700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f349006c5b0 0x7f349006ea70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:43.279 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.278+0000 7f34b437a700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34980035c0 0x7f34ac194c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:43.279 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.278+0000 7f34b437a700 1 --2- 172.21.15.174:0/2152470958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34ac1951c0 0x7f34ac195640 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:43.279 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.278+0000 7f34b437a700 1 -- 172.21.15.174:0/2152470958 >> 172.21.15.174:0/2152470958 conn(0x7f34ac074ae0 msgr2=0x7f34ac0fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:43.279 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.278+0000 7f34b437a700 1 -- 172.21.15.174:0/2152470958 shutdown_connections 2024-05-06T13:56:43.279 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:56:43.278+0000 7f34b437a700 1 -- 172.21.15.174:0/2152470958 wait complete. 2024-05-06T13:56:43.280 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 2 2024-05-06T13:56:43.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:43 smithi174 ceph-mon[35160]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:43.928 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:43 smithi174 ceph-mon[35160]: from='client.? 172.21.15.174:0/2152470958' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:56:43.951 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-06T13:56:43.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-06T13:56:44.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:43 smithi123 ceph-mon[27254]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:44.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:43 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/2152470958' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T13:56:44.164 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:56:45.534 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.534 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: Updating smithi123:/etc/ceph/ceph.conf 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: Updating smithi174:/etc/ceph/ceph.conf 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: Updating smithi123:/var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: Updating smithi174:/var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.535 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.536 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: Reconfiguring mon.smithi123 (unknown last config time)... 2024-05-06T13:56:45.536 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:56:45.536 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:56:45.536 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:45.536 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:45 smithi123 ceph-mon[27254]: Reconfiguring daemon mon.smithi123 on smithi123 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: Updating smithi123:/etc/ceph/ceph.conf 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: Updating smithi174:/etc/ceph/ceph.conf 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: Updating smithi123:/var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: Updating smithi174:/var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.774 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.774 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:45.774 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: Reconfiguring mon.smithi123 (unknown last config time)... 2024-05-06T13:56:45.774 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:56:45.774 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:56:45.774 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:45.774 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:45 smithi174 ceph-mon[35160]: Reconfiguring daemon mon.smithi123 on smithi123 2024-05-06T13:56:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.384+0000 7eff0f4e3700 1 -- 172.21.15.123:0/493251836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff08105780 msgr2=0x7eff08105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.384+0000 7eff0f4e3700 1 --2- 172.21.15.123:0/493251836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff08105780 0x7eff08105b60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff0400b0a0 tx=0x7eff0400b3b0 comp rx=0 tx=0).stop 2024-05-06T13:56:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.384+0000 7eff0f4e3700 1 -- 172.21.15.123:0/493251836 shutdown_connections 2024-05-06T13:56:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.384+0000 7eff0f4e3700 1 --2- 172.21.15.123:0/493251836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff08105780 0x7eff08105b60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.384+0000 7eff0f4e3700 1 -- 172.21.15.123:0/493251836 >> 172.21.15.123:0/493251836 conn(0x7eff080752b0 msgr2=0x7eff080756c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.384+0000 7eff0f4e3700 1 -- 172.21.15.123:0/493251836 shutdown_connections 2024-05-06T13:56:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.384+0000 7eff0f4e3700 1 -- 172.21.15.123:0/493251836 wait complete. 2024-05-06T13:56:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0f4e3700 1 Processor -- start 2024-05-06T13:56:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0f4e3700 1 -- start start 2024-05-06T13:56:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0f4e3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff08105780 0x7eff08194dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0f4e3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff08195300 0x7eff08199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0f4e3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff08195920 con 0x7eff08195300 2024-05-06T13:56:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0f4e3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff08195a90 con 0x7eff08105780 2024-05-06T13:56:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0ca7e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff08195300 0x7eff08199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0ca7e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff08195300 0x7eff08199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55642/0 (socket says 172.21.15.123:55642) 2024-05-06T13:56:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0ca7e700 1 -- 172.21.15.123:0/3524455536 learned_addr learned my addr 172.21.15.123:0/3524455536 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:56:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0d27f700 1 --2- 172.21.15.123:0/3524455536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff08105780 0x7eff08194dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0ca7e700 1 -- 172.21.15.123:0/3524455536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff08105780 msgr2=0x7eff08194dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0ca7e700 1 --2- 172.21.15.123:0/3524455536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff08105780 0x7eff08194dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.385+0000 7eff0ca7e700 1 -- 172.21.15.123:0/3524455536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04009d00 con 0x7eff08195300 2024-05-06T13:56:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.386+0000 7eff0ca7e700 1 --2- 172.21.15.123:0/3524455536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff08195300 0x7eff08199770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efef800da50 tx=0x7efef800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.386+0000 7efefe7fc700 1 -- 172.21.15.123:0/3524455536 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efef800eca0 con 0x7eff08195300 2024-05-06T13:56:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.386+0000 7eff0f4e3700 1 -- 172.21.15.123:0/3524455536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff08199d70 con 0x7eff08195300 2024-05-06T13:56:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.386+0000 7efefe7fc700 1 -- 172.21.15.123:0/3524455536 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efef800ee00 con 0x7eff08195300 2024-05-06T13:56:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.386+0000 7efefe7fc700 1 -- 172.21.15.123:0/3524455536 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efef80148b0 con 0x7eff08195300 2024-05-06T13:56:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.386+0000 7eff0f4e3700 1 -- 172.21.15.123:0/3524455536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0819a2c0 con 0x7eff08195300 2024-05-06T13:56:46.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.387+0000 7eff0f4e3700 1 -- 172.21.15.123:0/3524455536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0819a5f0 con 0x7eff08195300 2024-05-06T13:56:46.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.387+0000 7efefe7fc700 1 -- 172.21.15.123:0/3524455536 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 90258+0+0 (secure 0 0 0) 0x7efef8014a10 con 0x7eff08195300 2024-05-06T13:56:46.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.388+0000 7efefe7fc700 1 --2- 172.21.15.123:0/3524455536 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7efef406c5c0 0x7efef406ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:46.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.388+0000 7efefe7fc700 1 -- 172.21.15.123:0/3524455536 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7efef808beb0 con 0x7eff08195300 2024-05-06T13:56:46.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.388+0000 7eff0d27f700 1 --2- 172.21.15.123:0/3524455536 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7efef406c5c0 0x7efef406ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:46.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.388+0000 7eff0d27f700 1 --2- 172.21.15.123:0/3524455536 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7efef406c5c0 0x7efef406ea80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7eff04009480 tx=0x7eff0400b7b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:46.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.393+0000 7efefe7fc700 1 -- 172.21.15.123:0/3524455536 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7efef8057770 con 0x7eff08195300 2024-05-06T13:56:46.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.586+0000 7eff0f4e3700 1 -- 172.21.15.123:0/3524455536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7eff080623c0 con 0x7eff08195300 2024-05-06T13:56:46.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.586+0000 7efefe7fc700 1 -- 172.21.15.123:0/3524455536 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7efef808b670 con 0x7eff08195300 2024-05-06T13:56:46.587 INFO:teuthology.orchestra.run.smithi123.stdout:# minimal ceph.conf for f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:56:46.587 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-05-06T13:56:46.587 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T13:56:46.587 INFO:teuthology.orchestra.run.smithi123.stdout: mon_host = [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] 2024-05-06T13:56:46.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.588+0000 7eff0f4e3700 1 -- 172.21.15.123:0/3524455536 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7efef406c5c0 msgr2=0x7efef406ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:46.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.588+0000 7eff0f4e3700 1 --2- 172.21.15.123:0/3524455536 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7efef406c5c0 0x7efef406ea80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7eff04009480 tx=0x7eff0400b7b0 comp rx=0 tx=0).stop 2024-05-06T13:56:46.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.588+0000 7eff0f4e3700 1 -- 172.21.15.123:0/3524455536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff08195300 msgr2=0x7eff08199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:46.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.588+0000 7eff0f4e3700 1 --2- 172.21.15.123:0/3524455536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff08195300 0x7eff08199770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efef800da50 tx=0x7efef800de10 comp rx=0 tx=0).stop 2024-05-06T13:56:46.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.588+0000 7eff0f4e3700 1 -- 172.21.15.123:0/3524455536 shutdown_connections 2024-05-06T13:56:46.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.588+0000 7eff0f4e3700 1 --2- 172.21.15.123:0/3524455536 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7efef406c5c0 0x7efef406ea80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:46.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.588+0000 7eff0f4e3700 1 --2- 172.21.15.123:0/3524455536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff08105780 0x7eff08194dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:46.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.588+0000 7eff0f4e3700 1 --2- 172.21.15.123:0/3524455536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff08195300 0x7eff08199770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:46.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.588+0000 7eff0f4e3700 1 -- 172.21.15.123:0/3524455536 >> 172.21.15.123:0/3524455536 conn(0x7eff080752b0 msgr2=0x7eff08101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:46.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.588+0000 7eff0f4e3700 1 -- 172.21.15.123:0/3524455536 shutdown_connections 2024-05-06T13:56:46.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:46.588+0000 7eff0f4e3700 1 -- 172.21.15.123:0/3524455536 wait complete. 2024-05-06T13:56:47.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:46 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/3524455536' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:47.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:46 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3524455536' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:47.410 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-06T13:56:47.410 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:56:47.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.conf 2024-05-06T13:56:47.435 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:56:47.436 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:56:47.501 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T13:56:47.501 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.conf 2024-05-06T13:56:47.529 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T13:56:47.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:56:47.594 INFO:tasks.cephadm:Deploying OSDs... 2024-05-06T13:56:47.594 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:56:47.594 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-05-06T13:56:47.610 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-06T13:56:47.610 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-05-06T13:56:47.664 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-06T13:56:47.664 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T13:56:47.664 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-06T13:56:47.664 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T13:56:47.665 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T13:56:47.665 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-05-06 13:55:56.547638209 +0000 2024-05-06T13:56:47.665 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-05-06 13:50:35.265812200 +0000 2024-05-06T13:56:47.665 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-05-06 13:50:35.265812200 +0000 2024-05-06T13:56:47.665 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-05-06 13:50:35.265812200 +0000 2024-05-06T13:56:47.665 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-06T13:56:47.726 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-05-06T13:56:47.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-05-06T13:56:47.727 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000251116 s, 2.0 MB/s 2024-05-06T13:56:47.728 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-06T13:56:47.784 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-05-06T13:56:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-06T13:56:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T13:56:47.839 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-06T13:56:47.839 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T13:56:47.839 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T13:56:47.839 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-05-06 13:55:56.548638186 +0000 2024-05-06T13:56:47.839 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-05-06 13:50:35.613804034 +0000 2024-05-06T13:56:47.839 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-05-06 13:50:35.613804034 +0000 2024-05-06T13:56:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-05-06 13:50:35.613804034 +0000 2024-05-06T13:56:47.840 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-06T13:56:47.902 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:47 smithi123 ceph-mon[27254]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:47.902 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:47 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:47.902 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:47 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:47.902 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:47 smithi123 ceph-mon[27254]: Reconfiguring mgr.smithi123.vjztrj (unknown last config time)... 2024-05-06T13:56:47.902 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:47 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi123.vjztrj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:56:47.902 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:47 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:56:47.902 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:47 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:47.902 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:47 smithi123 ceph-mon[27254]: Reconfiguring daemon mgr.smithi123.vjztrj on smithi123 2024-05-06T13:56:47.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-05-06T13:56:47.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-05-06T13:56:47.905 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000195603 s, 2.6 MB/s 2024-05-06T13:56:47.906 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-06T13:56:47.963 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-05-06T13:56:48.017 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-06T13:56:48.017 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T13:56:48.017 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-06T13:56:48.017 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T13:56:48.017 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T13:56:48.017 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-05-06 13:55:56.548638186 +0000 2024-05-06T13:56:48.017 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-05-06 13:50:35.958795938 +0000 2024-05-06T13:56:48.017 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-05-06 13:50:35.958795938 +0000 2024-05-06T13:56:48.017 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-05-06 13:50:35.958795938 +0000 2024-05-06T13:56:48.018 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-06T13:56:48.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-05-06T13:56:48.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-05-06T13:56:48.080 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000170654 s, 3.0 MB/s 2024-05-06T13:56:48.082 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-06T13:56:48.138 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-05-06T13:56:48.192 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-06T13:56:48.192 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T13:56:48.193 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-06T13:56:48.193 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T13:56:48.193 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T13:56:48.193 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-05-06 13:55:56.548638186 +0000 2024-05-06T13:56:48.193 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-05-06 13:50:36.324787348 +0000 2024-05-06T13:56:48.193 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-05-06 13:50:36.324787348 +0000 2024-05-06T13:56:48.193 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-05-06 13:50:36.324787348 +0000 2024-05-06T13:56:48.193 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-06T13:56:48.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-05-06T13:56:48.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-05-06T13:56:48.255 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000205905 s, 2.5 MB/s 2024-05-06T13:56:48.256 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-06T13:56:48.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:47 smithi174 ceph-mon[35160]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:48.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:47 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:48.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:47 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:48.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:47 smithi174 ceph-mon[35160]: Reconfiguring mgr.smithi123.vjztrj (unknown last config time)... 2024-05-06T13:56:48.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:47 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi123.vjztrj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:56:48.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:47 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:56:48.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:47 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:48.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:47 smithi174 ceph-mon[35160]: Reconfiguring daemon mgr.smithi123.vjztrj on smithi123 2024-05-06T13:56:48.312 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T13:56:48.312 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-05-06T13:56:48.332 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-06T13:56:48.332 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-05-06T13:56:48.391 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-06T13:56:48.391 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T13:56:48.391 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-06T13:56:48.391 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T13:56:48.391 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T13:56:48.391 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-05-06 13:56:35.272194005 +0000 2024-05-06T13:56:48.391 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-06 13:50:34.945994276 +0000 2024-05-06T13:56:48.391 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-06 13:50:34.945994276 +0000 2024-05-06T13:56:48.392 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-06 13:50:34.945994276 +0000 2024-05-06T13:56:48.392 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-06T13:56:48.457 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-05-06T13:56:48.458 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-05-06T13:56:48.458 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000283166 s, 1.8 MB/s 2024-05-06T13:56:48.459 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-06T13:56:48.517 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-05-06T13:56:48.574 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-06T13:56:48.574 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T13:56:48.574 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-06T13:56:48.574 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T13:56:48.574 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T13:56:48.574 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-05-06 13:56:35.273193992 +0000 2024-05-06T13:56:48.574 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-06 13:50:35.294989656 +0000 2024-05-06T13:56:48.575 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-06 13:50:35.294989656 +0000 2024-05-06T13:56:48.575 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-06 13:50:35.294989656 +0000 2024-05-06T13:56:48.575 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-06T13:56:48.639 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-05-06T13:56:48.639 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-05-06T13:56:48.639 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000233259 s, 2.2 MB/s 2024-05-06T13:56:48.640 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-06T13:56:48.697 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-05-06T13:56:48.753 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-06T13:56:48.753 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T13:56:48.753 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-06T13:56:48.754 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T13:56:48.754 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T13:56:48.754 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-05-06 13:56:35.273193992 +0000 2024-05-06T13:56:48.754 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-06 13:50:35.631985194 +0000 2024-05-06T13:56:48.754 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-06 13:50:35.631985194 +0000 2024-05-06T13:56:48.754 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-06 13:50:35.631985194 +0000 2024-05-06T13:56:48.754 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-06T13:56:48.817 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-05-06T13:56:48.817 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-05-06T13:56:48.817 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000200181 s, 2.6 MB/s 2024-05-06T13:56:48.819 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-06T13:56:48.878 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-05-06T13:56:48.933 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-06T13:56:48.933 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T13:56:48.934 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-06T13:56:48.934 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T13:56:48.934 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T13:56:48.934 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-05-06 13:56:35.274193979 +0000 2024-05-06T13:56:48.934 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-06 13:50:35.982980548 +0000 2024-05-06T13:56:48.934 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-06 13:50:35.982980548 +0000 2024-05-06T13:56:48.934 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-06 13:50:35.982980548 +0000 2024-05-06T13:56:48.935 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-06T13:56:48.997 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-05-06T13:56:48.997 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-05-06T13:56:48.998 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000180775 s, 2.8 MB/s 2024-05-06T13:56:48.999 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-06T13:56:49.055 INFO:tasks.cephadm:Deploying osd.0 on smithi123 with /dev/vg_nvme/lv_4... 2024-05-06T13:56:49.056 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-06T13:56:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:56:49.946 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:49.946 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:49.946 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:49 smithi123 ceph-mon[27254]: Reconfiguring ceph-exporter.smithi123 (monmap changed)... 2024-05-06T13:56:49.947 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi123", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T13:56:49.947 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:49.947 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:49 smithi123 ceph-mon[27254]: Reconfiguring daemon ceph-exporter.smithi123 on smithi123 2024-05-06T13:56:49.947 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:49 smithi123 ceph-mon[27254]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:49 smithi174 ceph-mon[35160]: Reconfiguring ceph-exporter.smithi123 (monmap changed)... 2024-05-06T13:56:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi123", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T13:56:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:49 smithi174 ceph-mon[35160]: Reconfiguring daemon ceph-exporter.smithi123 on smithi123 2024-05-06T13:56:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:49 smithi174 ceph-mon[35160]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:51.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:50 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:56:51.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:50 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:56:51.944 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:51 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:51.944 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:51 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:51.944 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:51 smithi123 ceph-mon[27254]: Reconfiguring crash.smithi123 (monmap changed)... 2024-05-06T13:56:51.944 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:51 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi123", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T13:56:51.944 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:51 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:51.944 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:51 smithi123 ceph-mon[27254]: Reconfiguring daemon crash.smithi123 on smithi123 2024-05-06T13:56:51.944 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:51 smithi123 ceph-mon[27254]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:52.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:51 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:52.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:51 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:52.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:51 smithi174 ceph-mon[35160]: Reconfiguring crash.smithi123 (monmap changed)... 2024-05-06T13:56:52.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:51 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi123", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T13:56:52.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:51 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:52.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:51 smithi174 ceph-mon[35160]: Reconfiguring daemon crash.smithi123 on smithi123 2024-05-06T13:56:52.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:51 smithi174 ceph-mon[35160]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:52.449 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-06T13:56:52.449 INFO:teuthology.orchestra.run.smithi123.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-06T13:56:52.449 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10+0 records in 2024-05-06T13:56:52.449 INFO:teuthology.orchestra.run.smithi123.stderr:10+0 records out 2024-05-06T13:56:52.449 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115187 s, 910 MB/s 2024-05-06T13:56:52.449 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping successful for: 2024-05-06T13:56:53.206 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_4 2024-05-06T13:56:53.755 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:53 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:53.755 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:53 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:53.755 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:53 smithi123 ceph-mon[27254]: Reconfiguring alertmanager.smithi123 (dependencies changed)... 2024-05-06T13:56:53.755 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:53 smithi123 ceph-mon[27254]: Reconfiguring daemon alertmanager.smithi123 on smithi123 2024-05-06T13:56:53.755 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:53 smithi123 ceph-mon[27254]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:54.001 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:53 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:54.001 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:53 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:56:54.001 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:53 smithi174 ceph-mon[35160]: Reconfiguring alertmanager.smithi123 (dependencies changed)... 2024-05-06T13:56:54.001 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:53 smithi174 ceph-mon[35160]: Reconfiguring daemon alertmanager.smithi123 on smithi123 2024-05-06T13:56:54.001 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:53 smithi174 ceph-mon[35160]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:55.509 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:56:56.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:55 smithi174 ceph-mon[35160]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:56.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:55 smithi123 ceph-mon[27254]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.504+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/788509600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd0101de0 msgr2=0x7f9cd0102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.504+0000 7f9cd7b1d700 1 --2- 172.21.15.123:0/788509600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd0101de0 0x7f9cd0102240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009910 tx=0x7f9cc4009c20 comp rx=0 tx=0).stop 2024-05-06T13:56:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.504+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/788509600 shutdown_connections 2024-05-06T13:56:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.504+0000 7f9cd7b1d700 1 --2- 172.21.15.123:0/788509600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd0101de0 0x7f9cd0102240 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.504+0000 7f9cd7b1d700 1 --2- 172.21.15.123:0/788509600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd0100be0 0x7f9cd0101000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.504+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/788509600 >> 172.21.15.123:0/788509600 conn(0x7f9cd00fc140 msgr2=0x7f9cd00fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:56:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.504+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/788509600 shutdown_connections 2024-05-06T13:56:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.504+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/788509600 wait complete. 2024-05-06T13:56:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd7b1d700 1 Processor -- start 2024-05-06T13:56:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd7b1d700 1 -- start start 2024-05-06T13:56:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd7b1d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd0100be0 0x7f9cd01985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd7b1d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd0101de0 0x7f9cd0198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd7b1d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd0199140 con 0x7f9cd0100be0 2024-05-06T13:56:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd7b1d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd0199280 con 0x7f9cd0101de0 2024-05-06T13:56:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd58b9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd0100be0 0x7f9cd01985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd58b9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd0100be0 0x7f9cd01985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58820/0 (socket says 172.21.15.123:58820) 2024-05-06T13:56:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd58b9700 1 -- 172.21.15.123:0/59693482 learned_addr learned my addr 172.21.15.123:0/59693482 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:56:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd50b8700 1 --2- 172.21.15.123:0/59693482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd0101de0 0x7f9cd0198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd58b9700 1 -- 172.21.15.123:0/59693482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd0101de0 msgr2=0x7f9cd0198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:56:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd58b9700 1 --2- 172.21.15.123:0/59693482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd0101de0 0x7f9cd0198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:56:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd58b9700 1 -- 172.21.15.123:0/59693482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc40095f0 con 0x7f9cd0100be0 2024-05-06T13:56:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.505+0000 7f9cd50b8700 1 --2- 172.21.15.123:0/59693482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd0101de0 0x7f9cd0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T13:56:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.506+0000 7f9cd58b9700 1 --2- 172.21.15.123:0/59693482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd0100be0 0x7f9cd01985e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00b480 tx=0x7f9ccc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.506+0000 7f9cc2ffd700 1 -- 172.21.15.123:0/59693482 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ccc0118c0 con 0x7f9cd0100be0 2024-05-06T13:56:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.506+0000 7f9cc2ffd700 1 -- 172.21.15.123:0/59693482 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9ccc010380 con 0x7f9cd0100be0 2024-05-06T13:56:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.506+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/59693482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd019dd30 con 0x7f9cd0100be0 2024-05-06T13:56:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.506+0000 7f9cc2ffd700 1 -- 172.21.15.123:0/59693482 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ccc00f4f0 con 0x7f9cd0100be0 2024-05-06T13:56:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.506+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/59693482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd019e2a0 con 0x7f9cd0100be0 2024-05-06T13:56:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.507+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/59693482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd0105ec0 con 0x7f9cd0100be0 2024-05-06T13:56:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.507+0000 7f9cc2ffd700 1 -- 172.21.15.123:0/59693482 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 90258+0+0 (secure 0 0 0) 0x7f9ccc0104f0 con 0x7f9cd0100be0 2024-05-06T13:56:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.508+0000 7f9cc2ffd700 1 --2- 172.21.15.123:0/59693482 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9cbc06c470 0x7f9cbc06e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:56:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.508+0000 7f9cc2ffd700 1 -- 172.21.15.123:0/59693482 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f9ccc08a390 con 0x7f9cd0100be0 2024-05-06T13:56:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.508+0000 7f9cd50b8700 1 --2- 172.21.15.123:0/59693482 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9cbc06c470 0x7f9cbc06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:56:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.508+0000 7f9cd50b8700 1 --2- 172.21.15.123:0/59693482 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9cbc06c470 0x7f9cbc06e930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4006010 tx=0x7f9cc400b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:56:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.513+0000 7f9cc2ffd700 1 -- 172.21.15.123:0/59693482 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9ccc0596e0 con 0x7f9cd0100be0 2024-05-06T13:56:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:56:57.728+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/59693482 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cd00611d0 con 0x7f9cbc06c470 2024-05-06T13:56:58.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:57 smithi174 ceph-mon[35160]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:58.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:57 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T13:56:58.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:57 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T13:56:58.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:57 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:58.338 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:57 smithi123 ceph-mon[27254]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:56:58.339 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:57 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T13:56:58.339 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:57 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T13:56:58.339 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:57 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:56:59.229 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:58 smithi123 ceph-mon[27254]: from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:56:59.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:58 smithi174 ceph-mon[35160]: from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:57:00.266 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:59 smithi123 ceph-mon[27254]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:00.266 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:00.266 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:56:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:00.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:59 smithi174 ceph-mon[35160]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:00.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:00.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:56:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:01.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:00 smithi174 ceph-mon[35160]: Reconfiguring grafana.smithi123 (dependencies changed)... 2024-05-06T13:57:01.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:00 smithi174 ceph-mon[35160]: Reconfiguring daemon grafana.smithi123 on smithi123 2024-05-06T13:57:01.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:00 smithi123 ceph-mon[27254]: Reconfiguring grafana.smithi123 (dependencies changed)... 2024-05-06T13:57:01.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:00 smithi123 ceph-mon[27254]: Reconfiguring daemon grafana.smithi123 on smithi123 2024-05-06T13:57:02.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:01 smithi174 ceph-mon[35160]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:02.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:01 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/471434443' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4803adcc-ea08-4773-99f0-65485b08489f"}]: dispatch 2024-05-06T13:57:02.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:01 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/471434443' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4803adcc-ea08-4773-99f0-65485b08489f"}]': finished 2024-05-06T13:57:02.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:01 smithi174 ceph-mon[35160]: osdmap e6: 1 total, 0 up, 1 in 2024-05-06T13:57:02.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:01 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:57:02.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:01 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/2293323686' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T13:57:02.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:01 smithi123 ceph-mon[27254]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:02.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:01 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/471434443' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4803adcc-ea08-4773-99f0-65485b08489f"}]: dispatch 2024-05-06T13:57:02.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:01 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/471434443' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4803adcc-ea08-4773-99f0-65485b08489f"}]': finished 2024-05-06T13:57:02.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:01 smithi123 ceph-mon[27254]: osdmap e6: 1 total, 0 up, 1 in 2024-05-06T13:57:02.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:01 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:57:02.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:01 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2293323686' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T13:57:04.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:03 smithi174 ceph-mon[35160]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:04.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:03 smithi123 ceph-mon[27254]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:05.222 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:57:05.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:04 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:57:06.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:05 smithi174 ceph-mon[35160]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:06.291 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:05 smithi123 ceph-mon[27254]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:08.050 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:07 smithi123 ceph-mon[27254]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:08.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:07 smithi174 ceph-mon[35160]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:10.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:09 smithi174 ceph-mon[35160]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:10.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:09 smithi123 ceph-mon[27254]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:11.718 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:11.718 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:11.718 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:11 smithi123 ceph-mon[27254]: Reconfiguring prometheus.smithi123 (dependencies changed)... 2024-05-06T13:57:11.718 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:11 smithi123 ceph-mon[27254]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:11.719 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:11 smithi123 ceph-mon[27254]: Reconfiguring daemon prometheus.smithi123 on smithi123 2024-05-06T13:57:12.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:11 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:12.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:11 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:12.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:11 smithi174 ceph-mon[35160]: Reconfiguring prometheus.smithi123 (dependencies changed)... 2024-05-06T13:57:12.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:11 smithi174 ceph-mon[35160]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:12.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:11 smithi174 ceph-mon[35160]: Reconfiguring daemon prometheus.smithi123 on smithi123 2024-05-06T13:57:12.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:12 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T13:57:12.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:12 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:12.854 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:12 smithi123 ceph-mon[27254]: Deploying daemon osd.0 on smithi123 2024-05-06T13:57:13.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:12 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T13:57:13.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:12 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:13.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:12 smithi174 ceph-mon[35160]: Deploying daemon osd.0 on smithi123 2024-05-06T13:57:13.911 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:13 smithi123 ceph-mon[27254]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:14.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:13 smithi174 ceph-mon[35160]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:16.123 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:15 smithi123 ceph-mon[27254]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:16.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:15 smithi174 ceph-mon[35160]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:17.345 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:17 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:17.345 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:17 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:17.345 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:17 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi174", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T13:57:17.346 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:17 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:17.509 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:17 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:17.509 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:17 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:17.509 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:17 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi174", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T13:57:17.509 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:17 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:18.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:18 smithi174 ceph-mon[35160]: Reconfiguring ceph-exporter.smithi174 (monmap changed)... 2024-05-06T13:57:18.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:18 smithi174 ceph-mon[35160]: Reconfiguring daemon ceph-exporter.smithi174 on smithi174 2024-05-06T13:57:18.274 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:18 smithi174 ceph-mon[35160]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:18.274 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:18.274 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:18.274 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi174", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T13:57:18.275 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:18.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:18 smithi123 ceph-mon[27254]: Reconfiguring ceph-exporter.smithi174 (monmap changed)... 2024-05-06T13:57:18.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:18 smithi123 ceph-mon[27254]: Reconfiguring daemon ceph-exporter.smithi174 on smithi174 2024-05-06T13:57:18.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:18 smithi123 ceph-mon[27254]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:18.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:18.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:18.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi174", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T13:57:18.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:19.324 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:19 smithi174 ceph-mon[35160]: Reconfiguring crash.smithi174 (monmap changed)... 2024-05-06T13:57:19.324 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:19 smithi174 ceph-mon[35160]: Reconfiguring daemon crash.smithi174 on smithi174 2024-05-06T13:57:19.324 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:19 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:19.324 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:19 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:19.324 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:19 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi174.ybuavj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:57:19.324 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:19 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:57:19.324 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:19 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:19.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:19 smithi123 ceph-mon[27254]: Reconfiguring crash.smithi174 (monmap changed)... 2024-05-06T13:57:19.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:19 smithi123 ceph-mon[27254]: Reconfiguring daemon crash.smithi174 on smithi174 2024-05-06T13:57:19.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:19 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:19.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:19 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:19.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:19 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi174.ybuavj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:57:19.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:19 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:57:19.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:19 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:20.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:20 smithi123 ceph-mon[27254]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:20.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:20 smithi123 ceph-mon[27254]: Reconfiguring mgr.smithi174.ybuavj (monmap changed)... 2024-05-06T13:57:20.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:20 smithi123 ceph-mon[27254]: Reconfiguring daemon mgr.smithi174.ybuavj on smithi174 2024-05-06T13:57:20.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:57:20.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:20 smithi174 ceph-mon[35160]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:20.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:20 smithi174 ceph-mon[35160]: Reconfiguring mgr.smithi174.ybuavj (monmap changed)... 2024-05-06T13:57:20.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:20 smithi174 ceph-mon[35160]: Reconfiguring daemon mgr.smithi174.ybuavj on smithi174 2024-05-06T13:57:20.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:20 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:57:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:21 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:21 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:21 smithi123 ceph-mon[27254]: Reconfiguring mon.smithi174 (monmap changed)... 2024-05-06T13:57:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:21 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:57:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:21 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:57:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:21 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:21 smithi123 ceph-mon[27254]: Reconfiguring daemon mon.smithi174 on smithi174 2024-05-06T13:57:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:21 smithi123 ceph-mon[27254]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:21.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:21 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:21.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:21 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:21.609 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:21 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:21.609 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:21 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:21.610 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:21 smithi174 ceph-mon[35160]: Reconfiguring mon.smithi174 (monmap changed)... 2024-05-06T13:57:21.610 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:21 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:57:21.610 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:21 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:57:21.610 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:21 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:21.610 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:21 smithi174 ceph-mon[35160]: Reconfiguring daemon mon.smithi174 on smithi174 2024-05-06T13:57:21.610 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:21 smithi174 ceph-mon[35160]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:21.610 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:21 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:21.610 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:21 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:22.797 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:22.797 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:22.797 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi123:9093"}]: dispatch 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi123:9093"}]: dispatch 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi123:3000"}]: dispatch 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi123:3000"}]: dispatch 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi123:9095"}]: dispatch 2024-05-06T13:57:22.798 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi123:9095"}]: dispatch 2024-05-06T13:57:22.799 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:22.799 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:57:22.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:22.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:22.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:57:22.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:57:22.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi123:9093"}]: dispatch 2024-05-06T13:57:22.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi123:9093"}]: dispatch 2024-05-06T13:57:22.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:22.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:57:22.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:57:22.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi123:3000"}]: dispatch 2024-05-06T13:57:22.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi123:3000"}]: dispatch 2024-05-06T13:57:22.939 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:22.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:57:22.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:57:22.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi123:9095"}]: dispatch 2024-05-06T13:57:22.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi123:9095"}]: dispatch 2024-05-06T13:57:22.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:22.940 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:57:23.979 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:23 smithi123 ceph-mon[27254]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:23.979 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:23 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:23.979 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:23 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:24.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:23 smithi174 ceph-mon[35160]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:24.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:23 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:24.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:23 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:24.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:24.050+0000 7f9cc2ffd700 1 -- 172.21.15.123:0/59693482 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9cd00611d0 con 0x7f9cbc06c470 2024-05-06T13:57:24.051 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 0 on host 'smithi123' 2024-05-06T13:57:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:24.052+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/59693482 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9cbc06c470 msgr2=0x7f9cbc06e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:57:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:24.052+0000 7f9cd7b1d700 1 --2- 172.21.15.123:0/59693482 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9cbc06c470 0x7f9cbc06e930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4006010 tx=0x7f9cc400b540 comp rx=0 tx=0).stop 2024-05-06T13:57:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:24.052+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/59693482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd0100be0 msgr2=0x7f9cd01985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:57:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:24.052+0000 7f9cd7b1d700 1 --2- 172.21.15.123:0/59693482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd0100be0 0x7f9cd01985e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00b480 tx=0x7f9ccc00b840 comp rx=0 tx=0).stop 2024-05-06T13:57:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:24.052+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/59693482 shutdown_connections 2024-05-06T13:57:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:24.052+0000 7f9cd7b1d700 1 --2- 172.21.15.123:0/59693482 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9cbc06c470 0x7f9cbc06e930 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:57:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:24.052+0000 7f9cd7b1d700 1 --2- 172.21.15.123:0/59693482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd0100be0 0x7f9cd01985e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:57:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:24.052+0000 7f9cd7b1d700 1 --2- 172.21.15.123:0/59693482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd0101de0 0x7f9cd0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:57:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:24.052+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/59693482 >> 172.21.15.123:0/59693482 conn(0x7f9cd00fc140 msgr2=0x7f9cd0103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:57:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:24.052+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/59693482 shutdown_connections 2024-05-06T13:57:24.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:24.052+0000 7f9cd7b1d700 1 -- 172.21.15.123:0/59693482 wait complete. 2024-05-06T13:57:25.043 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:25 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:25.043 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:25 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:25.064 DEBUG:teuthology.orchestra.run.smithi123:osd.0> sudo journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.0.service 2024-05-06T13:57:25.066 INFO:tasks.cephadm:Deploying osd.1 on smithi123 with /dev/vg_nvme/lv_3... 2024-05-06T13:57:25.066 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-06T13:57:25.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:25 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:25.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:25 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:25.354 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 13:57:25 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0[46501]: 2024-05-06T13:57:25.115+0000 7f3abf83d640 -1 osd.0 0 log_to_monitors true 2024-05-06T13:57:25.884 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:57:26.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:26 smithi174 ceph-mon[35160]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:26.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:26 smithi174 ceph-mon[35160]: from='osd.0 [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T13:57:26.332 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:26 smithi123 ceph-mon[27254]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:26.332 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:26 smithi123 ceph-mon[27254]: from='osd.0 [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T13:57:27.214 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:27 smithi123 ceph-mon[27254]: from='osd.0 [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T13:57:27.214 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:27 smithi123 ceph-mon[27254]: osdmap e7: 1 total, 0 up, 1 in 2024-05-06T13:57:27.214 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:27 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:57:27.214 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:27 smithi123 ceph-mon[27254]: from='osd.0 [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-05-06T13:57:27.214 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 13:57:27 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0[46501]: 2024-05-06T13:57:27.028+0000 7f3ab5ea3700 -1 osd.0 0 waiting for initial osdmap 2024-05-06T13:57:27.214 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 13:57:27 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0[46501]: 2024-05-06T13:57:27.031+0000 7f3aacc8e700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:57:27.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:27 smithi174 ceph-mon[35160]: from='osd.0 [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T13:57:27.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:27 smithi174 ceph-mon[35160]: osdmap e7: 1 total, 0 up, 1 in 2024-05-06T13:57:27.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:27 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:57:27.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:27 smithi174 ceph-mon[35160]: from='osd.0 [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-05-06T13:57:28.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:28 smithi123 ceph-mon[27254]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:28.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:28 smithi123 ceph-mon[27254]: from='osd.0 [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-05-06T13:57:28.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:28 smithi123 ceph-mon[27254]: osdmap e8: 1 total, 0 up, 1 in 2024-05-06T13:57:28.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:57:28.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:57:28.228 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-06T13:57:28.228 INFO:teuthology.orchestra.run.smithi123.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-06T13:57:28.228 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10+0 records in 2024-05-06T13:57:28.228 INFO:teuthology.orchestra.run.smithi123.stderr:10+0 records out 2024-05-06T13:57:28.228 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0131301 s, 799 MB/s 2024-05-06T13:57:28.228 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping successful for: 2024-05-06T13:57:28.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:28 smithi174 ceph-mon[35160]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T13:57:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:28 smithi174 ceph-mon[35160]: from='osd.0 [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-05-06T13:57:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:28 smithi174 ceph-mon[35160]: osdmap e8: 1 total, 0 up, 1 in 2024-05-06T13:57:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:57:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:57:29.215 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:29 smithi123 ceph-mon[27254]: purged_snaps scrub starts 2024-05-06T13:57:29.215 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:29 smithi123 ceph-mon[27254]: purged_snaps scrub ok 2024-05-06T13:57:29.216 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:29 smithi123 ceph-mon[27254]: osd.0 [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393] boot 2024-05-06T13:57:29.216 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:29 smithi123 ceph-mon[27254]: osdmap e9: 1 total, 1 up, 1 in 2024-05-06T13:57:29.216 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:29 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:57:29.238 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_3 2024-05-06T13:57:29.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:29 smithi174 ceph-mon[35160]: purged_snaps scrub starts 2024-05-06T13:57:29.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:29 smithi174 ceph-mon[35160]: purged_snaps scrub ok 2024-05-06T13:57:29.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:29 smithi174 ceph-mon[35160]: osd.0 [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393] boot 2024-05-06T13:57:29.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:29 smithi174 ceph-mon[35160]: osdmap e9: 1 total, 1 up, 1 in 2024-05-06T13:57:29.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:29 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:57:29.983 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:57:30.348 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:30 smithi123 ceph-mon[27254]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:30.348 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:30 smithi123 ceph-mon[27254]: osdmap e10: 1 total, 1 up, 1 in 2024-05-06T13:57:30.348 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:30 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:30.348 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:30 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:30.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:30 smithi174 ceph-mon[35160]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:30.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:30 smithi174 ceph-mon[35160]: osdmap e10: 1 total, 1 up, 1 in 2024-05-06T13:57:30.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:30 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:30.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:30 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:31.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.697+0000 7f35ff369700 1 -- 172.21.15.123:0/68164966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f8100cb0 msgr2=0x7f35f8101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:57:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.697+0000 7f35ff369700 1 --2- 172.21.15.123:0/68164966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f8100cb0 0x7f35f8101110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009910 tx=0x7f35e8009c20 comp rx=0 tx=0).stop 2024-05-06T13:57:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.697+0000 7f35ff369700 1 -- 172.21.15.123:0/68164966 shutdown_connections 2024-05-06T13:57:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.697+0000 7f35ff369700 1 --2- 172.21.15.123:0/68164966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f8100cb0 0x7f35f8101110 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:57:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.697+0000 7f35ff369700 1 --2- 172.21.15.123:0/68164966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35f80ffab0 0x7f35f80ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:57:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.697+0000 7f35ff369700 1 -- 172.21.15.123:0/68164966 >> 172.21.15.123:0/68164966 conn(0x7f35f80fb030 msgr2=0x7f35f80fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:57:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.697+0000 7f35ff369700 1 -- 172.21.15.123:0/68164966 shutdown_connections 2024-05-06T13:57:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.697+0000 7f35ff369700 1 -- 172.21.15.123:0/68164966 wait complete. 2024-05-06T13:57:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35ff369700 1 Processor -- start 2024-05-06T13:57:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35ff369700 1 -- start start 2024-05-06T13:57:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35ff369700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35f80ffab0 0x7f35f8196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:57:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35ff369700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f8100cb0 0x7f35f8196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:57:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35ff369700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f8196ea0 con 0x7f35f8100cb0 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35ff369700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f8196fe0 con 0x7f35f80ffab0 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35fc904700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f8100cb0 0x7f35f8196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35fc904700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f8100cb0 0x7f35f8196880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56264/0 (socket says 172.21.15.123:56264) 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35fc904700 1 -- 172.21.15.123:0/196166639 learned_addr learned my addr 172.21.15.123:0/196166639 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35fd105700 1 --2- 172.21.15.123:0/196166639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35f80ffab0 0x7f35f8196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35fc904700 1 -- 172.21.15.123:0/196166639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35f80ffab0 msgr2=0x7f35f8196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35fc904700 1 --2- 172.21.15.123:0/196166639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35f80ffab0 0x7f35f8196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35fc904700 1 -- 172.21.15.123:0/196166639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e80095f0 con 0x7f35f8100cb0 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35fc904700 1 --2- 172.21.15.123:0/196166639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f8100cb0 0x7f35f8196880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f35e8006010 tx=0x7f35e800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.698+0000 7f35ee7fc700 1 -- 172.21.15.123:0/196166639 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35e801d070 con 0x7f35f8100cb0 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.699+0000 7f35ee7fc700 1 -- 172.21.15.123:0/196166639 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35e800f460 con 0x7f35f8100cb0 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.699+0000 7f35ff369700 1 -- 172.21.15.123:0/196166639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f819ba30 con 0x7f35f8100cb0 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.699+0000 7f35ee7fc700 1 -- 172.21.15.123:0/196166639 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35e8021640 con 0x7f35f8100cb0 2024-05-06T13:57:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.699+0000 7f35ff369700 1 -- 172.21.15.123:0/196166639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f819bf20 con 0x7f35f8100cb0 2024-05-06T13:57:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.700+0000 7f35ff369700 1 -- 172.21.15.123:0/196166639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f8108610 con 0x7f35f8100cb0 2024-05-06T13:57:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.700+0000 7f35ee7fc700 1 -- 172.21.15.123:0/196166639 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 90258+0+0 (secure 0 0 0) 0x7f35e800fab0 con 0x7f35f8100cb0 2024-05-06T13:57:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.700+0000 7f35ee7fc700 1 --2- 172.21.15.123:0/196166639 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f35e406c460 0x7f35e406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:57:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.700+0000 7f35fd105700 1 --2- 172.21.15.123:0/196166639 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f35e406c460 0x7f35e406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:57:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.700+0000 7f35ee7fc700 1 -- 172.21.15.123:0/196166639 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f35e808bc10 con 0x7f35f8100cb0 2024-05-06T13:57:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.701+0000 7f35fd105700 1 --2- 172.21.15.123:0/196166639 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f35e406c460 0x7f35e406e920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f35f8100b10 tx=0x7f35f400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:57:31.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.705+0000 7f35ee7fc700 1 -- 172.21.15.123:0/196166639 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f35e805ad00 con 0x7f35f8100cb0 2024-05-06T13:57:31.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:31.906+0000 7f35ff369700 1 -- 172.21.15.123:0/196166639 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f35f8068b20 con 0x7f35e406c460 2024-05-06T13:57:32.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:32 smithi123 ceph-mon[27254]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:32.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:32 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T13:57:32.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:32 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T13:57:32.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:32 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:32.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:32 smithi174 ceph-mon[35160]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:32.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:32 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T13:57:32.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:32 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T13:57:32.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:32 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:33.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:33 smithi123 ceph-mon[27254]: from='client.14276 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:57:33.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:33 smithi174 ceph-mon[35160]: from='client.14276 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:57:34.312 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:34 smithi123 ceph-mon[27254]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:34.423 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:34 smithi174 ceph-mon[35160]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:35 smithi174 ceph-mon[35160]: Detected new or changed devices on smithi123 2024-05-06T13:57:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:57:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:35 smithi174 ceph-mon[35160]: Adjusting osd_memory_target on smithi123 to 11840M 2024-05-06T13:57:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:57:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:57:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:35 smithi174 ceph-mon[35160]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:35.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:57:35.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:35 smithi123 ceph-mon[27254]: Detected new or changed devices on smithi123 2024-05-06T13:57:35.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:35.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:35.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:57:35.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:35 smithi123 ceph-mon[27254]: Adjusting osd_memory_target on smithi123 to 11840M 2024-05-06T13:57:35.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:35.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:35.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:57:35.606 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:35.606 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:57:35.606 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:35 smithi123 ceph-mon[27254]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:35.606 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:57:36.517 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:36 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1871494195' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a34740b3-d6c1-4d4e-8a4d-efe3b3dc26ba"}]: dispatch 2024-05-06T13:57:36.518 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:36 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1871494195' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a34740b3-d6c1-4d4e-8a4d-efe3b3dc26ba"}]': finished 2024-05-06T13:57:36.518 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:36 smithi123 ceph-mon[27254]: osdmap e11: 2 total, 1 up, 2 in 2024-05-06T13:57:36.518 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:36 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:57:36.518 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:36 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:36.518 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:36 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:36.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:36 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/1871494195' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a34740b3-d6c1-4d4e-8a4d-efe3b3dc26ba"}]: dispatch 2024-05-06T13:57:36.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:36 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/1871494195' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a34740b3-d6c1-4d4e-8a4d-efe3b3dc26ba"}]': finished 2024-05-06T13:57:36.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:36 smithi174 ceph-mon[35160]: osdmap e11: 2 total, 1 up, 2 in 2024-05-06T13:57:36.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:57:36.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:36.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:36 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:37.748 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:37 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/4043805007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T13:57:37.749 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:37 smithi123 ceph-mon[27254]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:37.772 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:37 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/4043805007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T13:57:37.772 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:37 smithi174 ceph-mon[35160]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:40.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:39 smithi123 ceph-mon[27254]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:40.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:39 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:40.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:39 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:40.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:39 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:40.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:39 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:57:40.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:39 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:40.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:39 smithi174 ceph-mon[35160]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:40.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:39 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:40.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:39 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:40.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:39 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:40.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:39 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:57:40.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:39 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:42.167 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:41 smithi123 ceph-mon[27254]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:42.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:41 smithi174 ceph-mon[35160]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:44.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:43 smithi174 ceph-mon[35160]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:44.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:43 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T13:57:44.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:43 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:44.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:43 smithi174 ceph-mon[35160]: Deploying daemon osd.1 on smithi123 2024-05-06T13:57:44.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:43 smithi123 ceph-mon[27254]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:44.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:43 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T13:57:44.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:43 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:57:44.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:43 smithi123 ceph-mon[27254]: Deploying daemon osd.1 on smithi123 2024-05-06T13:57:46.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:45 smithi174 ceph-mon[35160]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:46.287 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:45 smithi123 ceph-mon[27254]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:48.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:47 smithi123 ceph-mon[27254]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:48.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:47 smithi174 ceph-mon[35160]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:50.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:57:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:49 smithi174 ceph-mon[35160]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:50.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:50.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:50.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:57:50.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:49 smithi123 ceph-mon[27254]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:51.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:50 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:57:51.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:50 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:51.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:50 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:51.026 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:50 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:57:51.026 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:50 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:51.026 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:50 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:51.831 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:51 smithi123 ceph-mon[27254]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:51.910 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 1 on host 'smithi123' 2024-05-06T13:57:51.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:51.908+0000 7f35ee7fc700 1 -- 172.21.15.123:0/196166639 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f35f8068b20 con 0x7f35e406c460 2024-05-06T13:57:51.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:51.910+0000 7f35ff369700 1 -- 172.21.15.123:0/196166639 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f35e406c460 msgr2=0x7f35e406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:57:51.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:51.911+0000 7f35ff369700 1 --2- 172.21.15.123:0/196166639 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f35e406c460 0x7f35e406e920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f35f8100b10 tx=0x7f35f400b410 comp rx=0 tx=0).stop 2024-05-06T13:57:51.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:51.911+0000 7f35ff369700 1 -- 172.21.15.123:0/196166639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f8100cb0 msgr2=0x7f35f8196880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:57:51.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:51.911+0000 7f35ff369700 1 --2- 172.21.15.123:0/196166639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f8100cb0 0x7f35f8196880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f35e8006010 tx=0x7f35e800bd70 comp rx=0 tx=0).stop 2024-05-06T13:57:51.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:51.911+0000 7f35ff369700 1 -- 172.21.15.123:0/196166639 shutdown_connections 2024-05-06T13:57:51.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:51.911+0000 7f35ff369700 1 --2- 172.21.15.123:0/196166639 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f35e406c460 0x7f35e406e920 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:57:51.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:51.911+0000 7f35ff369700 1 --2- 172.21.15.123:0/196166639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35f80ffab0 0x7f35f8196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:57:51.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:51.911+0000 7f35ff369700 1 --2- 172.21.15.123:0/196166639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35f8100cb0 0x7f35f8196880 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:57:51.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:51.911+0000 7f35ff369700 1 -- 172.21.15.123:0/196166639 >> 172.21.15.123:0/196166639 conn(0x7f35f80fb030 msgr2=0x7f35f8068410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:57:51.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:51.911+0000 7f35ff369700 1 -- 172.21.15.123:0/196166639 shutdown_connections 2024-05-06T13:57:51.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:51.911+0000 7f35ff369700 1 -- 172.21.15.123:0/196166639 wait complete. 2024-05-06T13:57:52.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:51 smithi174 ceph-mon[35160]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:52.495 DEBUG:teuthology.orchestra.run.smithi123:osd.1> sudo journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.1.service 2024-05-06T13:57:52.497 INFO:tasks.cephadm:Deploying osd.2 on smithi123 with /dev/vg_nvme/lv_2... 2024-05-06T13:57:52.498 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-06T13:57:52.854 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 13:57:52 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1[54161]: 2024-05-06T13:57:52.590+0000 7f1068f3c640 -1 osd.1 0 log_to_monitors true 2024-05-06T13:57:53.134 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:52 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:53.135 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:52 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:53.135 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:52 smithi123 ceph-mon[27254]: from='osd.1 [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T13:57:53.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:52 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:53.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:52 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:53.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:52 smithi174 ceph-mon[35160]: from='osd.1 [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T13:57:53.376 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:57:54.112 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:53 smithi123 ceph-mon[27254]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:54.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:53 smithi123 ceph-mon[27254]: from='osd.1 [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T13:57:54.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:53 smithi123 ceph-mon[27254]: osdmap e12: 2 total, 1 up, 2 in 2024-05-06T13:57:54.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:53 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:57:54.113 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:53 smithi123 ceph-mon[27254]: from='osd.1 [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-05-06T13:57:54.113 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 13:57:53 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1[54161]: 2024-05-06T13:57:53.873+0000 7f105dd9f700 -1 osd.1 0 waiting for initial osdmap 2024-05-06T13:57:54.113 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 13:57:53 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1[54161]: 2024-05-06T13:57:53.878+0000 7f1059393700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:57:54.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:53 smithi174 ceph-mon[35160]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:54.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:53 smithi174 ceph-mon[35160]: from='osd.1 [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T13:57:54.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:53 smithi174 ceph-mon[35160]: osdmap e12: 2 total, 1 up, 2 in 2024-05-06T13:57:54.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:53 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:57:54.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:53 smithi174 ceph-mon[35160]: from='osd.1 [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-05-06T13:57:55.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:54 smithi123 ceph-mon[27254]: from='osd.1 [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-05-06T13:57:55.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:54 smithi123 ceph-mon[27254]: osdmap e13: 2 total, 1 up, 2 in 2024-05-06T13:57:55.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:54 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:57:55.008 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:54 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:57:55.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:54 smithi174 ceph-mon[35160]: from='osd.1 [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-05-06T13:57:55.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:54 smithi174 ceph-mon[35160]: osdmap e13: 2 total, 1 up, 2 in 2024-05-06T13:57:55.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:54 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:57:55.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:54 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:57:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-06T13:57:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-06T13:57:55.502 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10+0 records in 2024-05-06T13:57:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:10+0 records out 2024-05-06T13:57:55.502 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0122905 s, 853 MB/s 2024-05-06T13:57:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping successful for: 2024-05-06T13:57:56.089 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:55 smithi123 ceph-mon[27254]: purged_snaps scrub starts 2024-05-06T13:57:56.089 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:55 smithi123 ceph-mon[27254]: purged_snaps scrub ok 2024-05-06T13:57:56.089 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:55 smithi123 ceph-mon[27254]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:56.089 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:55 smithi123 ceph-mon[27254]: osd.1 [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034] boot 2024-05-06T13:57:56.089 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:55 smithi123 ceph-mon[27254]: osdmap e14: 2 total, 2 up, 2 in 2024-05-06T13:57:56.089 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:55 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:57:56.090 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_2 2024-05-06T13:57:56.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:55 smithi174 ceph-mon[35160]: purged_snaps scrub starts 2024-05-06T13:57:56.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:55 smithi174 ceph-mon[35160]: purged_snaps scrub ok 2024-05-06T13:57:56.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:55 smithi174 ceph-mon[35160]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T13:57:56.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:55 smithi174 ceph-mon[35160]: osd.1 [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034] boot 2024-05-06T13:57:56.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:55 smithi174 ceph-mon[35160]: osdmap e14: 2 total, 2 up, 2 in 2024-05-06T13:57:56.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:55 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:57:56.458 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:57:57.058 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:56 smithi123 ceph-mon[27254]: osdmap e15: 2 total, 2 up, 2 in 2024-05-06T13:57:57.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:56 smithi174 ceph-mon[35160]: osdmap e15: 2 total, 2 up, 2 in 2024-05-06T13:57:58.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:57 smithi174 ceph-mon[35160]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:57:58.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:57 smithi123 ceph-mon[27254]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:57:58.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.792+0000 7f9aaefeb700 1 -- 172.21.15.123:0/204219829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8100c00 msgr2=0x7f9aa8101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:57:58.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.792+0000 7f9aaefeb700 1 --2- 172.21.15.123:0/204219829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8100c00 0x7f9aa8101020 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009910 tx=0x7f9a9c009c20 comp rx=0 tx=0).stop 2024-05-06T13:57:58.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.792+0000 7f9aaefeb700 1 -- 172.21.15.123:0/204219829 shutdown_connections 2024-05-06T13:57:58.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.792+0000 7f9aaefeb700 1 --2- 172.21.15.123:0/204219829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aa8101e00 0x7f9aa8102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:57:58.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.792+0000 7f9aaefeb700 1 --2- 172.21.15.123:0/204219829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8100c00 0x7f9aa8101020 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:57:58.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.792+0000 7f9aaefeb700 1 -- 172.21.15.123:0/204219829 >> 172.21.15.123:0/204219829 conn(0x7f9aa80fc180 msgr2=0x7f9aa80fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:57:58.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.792+0000 7f9aaefeb700 1 -- 172.21.15.123:0/204219829 shutdown_connections 2024-05-06T13:57:58.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.792+0000 7f9aaefeb700 1 -- 172.21.15.123:0/204219829 wait complete. 2024-05-06T13:57:58.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.793+0000 7f9aaefeb700 1 Processor -- start 2024-05-06T13:57:58.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.793+0000 7f9aaefeb700 1 -- start start 2024-05-06T13:57:58.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.793+0000 7f9aaefeb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aa8100c00 0x7f9aa8074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:57:58.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.793+0000 7f9aaefeb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8101e00 0x7f9aa8073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:57:58.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.793+0000 7f9aaefeb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80736c0 con 0x7f9aa8101e00 2024-05-06T13:57:58.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.793+0000 7f9aaefeb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8073800 con 0x7f9aa8100c00 2024-05-06T13:57:58.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.793+0000 7f9aa7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8101e00 0x7f9aa8073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.793+0000 7f9aa7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8101e00 0x7f9aa8073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45448/0 (socket says 172.21.15.123:45448) 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.793+0000 7f9aa7fff700 1 -- 172.21.15.123:0/3129483720 learned_addr learned my addr 172.21.15.123:0/3129483720 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.794+0000 7f9aacd87700 1 --2- 172.21.15.123:0/3129483720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aa8100c00 0x7f9aa8074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.794+0000 7f9aa7fff700 1 -- 172.21.15.123:0/3129483720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aa8100c00 msgr2=0x7f9aa8074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.794+0000 7f9aa7fff700 1 --2- 172.21.15.123:0/3129483720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aa8100c00 0x7f9aa8074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.794+0000 7f9aa7fff700 1 -- 172.21.15.123:0/3129483720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c0095f0 con 0x7f9aa8101e00 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.794+0000 7f9aacd87700 1 --2- 172.21.15.123:0/3129483720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aa8100c00 0x7f9aa8074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.794+0000 7f9aa7fff700 1 --2- 172.21.15.123:0/3129483720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8101e00 0x7f9aa8073180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400b4b0 tx=0x7f9a9400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.794+0000 7f9aa5ffb700 1 -- 172.21.15.123:0/3129483720 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a94011800 con 0x7f9aa8101e00 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.794+0000 7f9aa5ffb700 1 -- 172.21.15.123:0/3129483720 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9a94011e10 con 0x7f9aa8101e00 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.794+0000 7f9aaefeb700 1 -- 172.21.15.123:0/3129483720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa8073ae0 con 0x7f9aa8101e00 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.794+0000 7f9aa5ffb700 1 -- 172.21.15.123:0/3129483720 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a9400f2e0 con 0x7f9aa8101e00 2024-05-06T13:57:58.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.794+0000 7f9aaefeb700 1 -- 172.21.15.123:0/3129483720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa819e440 con 0x7f9aa8101e00 2024-05-06T13:57:58.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.795+0000 7f9aaefeb700 1 -- 172.21.15.123:0/3129483720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa81097e0 con 0x7f9aa8101e00 2024-05-06T13:57:58.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.796+0000 7f9aa5ffb700 1 -- 172.21.15.123:0/3129483720 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 90258+0+0 (secure 0 0 0) 0x7f9a94010380 con 0x7f9aa8101e00 2024-05-06T13:57:58.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.796+0000 7f9aa5ffb700 1 --2- 172.21.15.123:0/3129483720 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9a9806c470 0x7f9a9806e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:57:58.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.796+0000 7f9aa5ffb700 1 -- 172.21.15.123:0/3129483720 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f9a9408a770 con 0x7f9aa8101e00 2024-05-06T13:57:58.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.796+0000 7f9aacd87700 1 --2- 172.21.15.123:0/3129483720 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9a9806c470 0x7f9a9806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:57:58.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.797+0000 7f9aacd87700 1 --2- 172.21.15.123:0/3129483720 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9a9806c470 0x7f9a9806e930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c006010 tx=0x7f9a9c00b580 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:57:58.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:58.804+0000 7f9aa5ffb700 1 -- 172.21.15.123:0/3129483720 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9a940596b0 con 0x7f9aa8101e00 2024-05-06T13:57:59.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:57:59.037+0000 7f9aaefeb700 1 -- 172.21.15.123:0/3129483720 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9aa8106750 con 0x7f9a9806c470 2024-05-06T13:57:59.796 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:59.796 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:57:59.796 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:59 smithi123 ceph-mon[27254]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:57:59.796 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:59 smithi123 ceph-mon[27254]: from='client.14294 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:57:59.796 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T13:57:59.796 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T13:57:59.796 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:57:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:00.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:00.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:00.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:59 smithi174 ceph-mon[35160]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:00.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:59 smithi174 ceph-mon[35160]: from='client.14294 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:58:00.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T13:58:00.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T13:58:00.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:57:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:02.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:01 smithi123 ceph-mon[27254]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:02.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:01 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:02.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:01 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:02.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:01 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:58:02.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:01 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:58:02.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:01 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:02.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:01 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:02.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:01 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:58:02.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:01 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:02.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:01 smithi174 ceph-mon[35160]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:02.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:01 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:02.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:01 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:02.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:01 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:58:02.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:01 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:58:02.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:01 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:02.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:01 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:02.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:01 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:58:02.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:01 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:02.972 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:02 smithi174 ceph-mon[35160]: Detected new or changed devices on smithi123 2024-05-06T13:58:02.972 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:02 smithi174 ceph-mon[35160]: Adjusting osd_memory_target on smithi123 to 5920M 2024-05-06T13:58:02.972 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:02 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:58:03.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:02 smithi123 ceph-mon[27254]: Detected new or changed devices on smithi123 2024-05-06T13:58:03.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:02 smithi123 ceph-mon[27254]: Adjusting osd_memory_target on smithi123 to 5920M 2024-05-06T13:58:03.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:02 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:58:04.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:03 smithi123 ceph-mon[27254]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:04.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:03 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2505952465' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "075dfad3-ac71-4c06-b9eb-0f3813c7e309"}]: dispatch 2024-05-06T13:58:04.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:03 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2505952465' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "075dfad3-ac71-4c06-b9eb-0f3813c7e309"}]': finished 2024-05-06T13:58:04.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:03 smithi123 ceph-mon[27254]: osdmap e16: 3 total, 2 up, 3 in 2024-05-06T13:58:04.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:03 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:58:04.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:03 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:04.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:03 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:04.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:03 smithi174 ceph-mon[35160]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:04.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:03 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/2505952465' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "075dfad3-ac71-4c06-b9eb-0f3813c7e309"}]: dispatch 2024-05-06T13:58:04.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:03 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/2505952465' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "075dfad3-ac71-4c06-b9eb-0f3813c7e309"}]': finished 2024-05-06T13:58:04.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:03 smithi174 ceph-mon[35160]: osdmap e16: 3 total, 2 up, 3 in 2024-05-06T13:58:04.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:03 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:58:04.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:03 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:04.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:03 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:05.101 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:04 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1978468308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T13:58:05.101 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:58:05.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:04 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/1978468308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T13:58:05.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:04 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:58:06.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:05 smithi174 ceph-mon[35160]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:06.324 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:05 smithi123 ceph-mon[27254]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:08.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:07 smithi174 ceph-mon[35160]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:08.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:08.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:08.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:08.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:58:08.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:08.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:07 smithi123 ceph-mon[27254]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:08.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:08.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:08.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:08.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:58:08.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:10.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:09 smithi174 ceph-mon[35160]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:10.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:09 smithi123 ceph-mon[27254]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:11.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:10 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T13:58:11.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:10 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:11.284 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:10 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T13:58:11.284 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:10 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:12.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:11 smithi174 ceph-mon[35160]: Deploying daemon osd.2 on smithi123 2024-05-06T13:58:12.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:11 smithi174 ceph-mon[35160]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:12.325 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:11 smithi123 ceph-mon[27254]: Deploying daemon osd.2 on smithi123 2024-05-06T13:58:12.325 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:11 smithi123 ceph-mon[27254]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:14.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:13 smithi174 ceph-mon[35160]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:14.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:13 smithi123 ceph-mon[27254]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:16.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:15 smithi123 ceph-mon[27254]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:16.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:15 smithi174 ceph-mon[35160]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:17.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:17 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:17.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:17 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:17.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:17 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:58:17.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:17 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:17.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:17 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:17.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:17 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:58:18.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:18 smithi174 ceph-mon[35160]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:18.349 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:18 smithi123 ceph-mon[27254]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:20.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:20 smithi123 ceph-mon[27254]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:20.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:58:20.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:20 smithi123 ceph-mon[27254]: from='osd.2 [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T13:58:20.193 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 2 on host 'smithi123' 2024-05-06T13:58:20.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:58:20.191+0000 7f9aa5ffb700 1 -- 172.21.15.123:0/3129483720 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9aa8106750 con 0x7f9a9806c470 2024-05-06T13:58:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:58:20.194+0000 7f9aaefeb700 1 -- 172.21.15.123:0/3129483720 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9a9806c470 msgr2=0x7f9a9806e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:58:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:58:20.194+0000 7f9aaefeb700 1 --2- 172.21.15.123:0/3129483720 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9a9806c470 0x7f9a9806e930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c006010 tx=0x7f9a9c00b580 comp rx=0 tx=0).stop 2024-05-06T13:58:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:58:20.194+0000 7f9aaefeb700 1 -- 172.21.15.123:0/3129483720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8101e00 msgr2=0x7f9aa8073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:58:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:58:20.194+0000 7f9aaefeb700 1 --2- 172.21.15.123:0/3129483720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8101e00 0x7f9aa8073180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400b4b0 tx=0x7f9a9400b870 comp rx=0 tx=0).stop 2024-05-06T13:58:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:58:20.194+0000 7f9aaefeb700 1 -- 172.21.15.123:0/3129483720 shutdown_connections 2024-05-06T13:58:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:58:20.194+0000 7f9aaefeb700 1 --2- 172.21.15.123:0/3129483720 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9a9806c470 0x7f9a9806e930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:58:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:58:20.194+0000 7f9aaefeb700 1 --2- 172.21.15.123:0/3129483720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aa8100c00 0x7f9aa8074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:58:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:58:20.194+0000 7f9aaefeb700 1 --2- 172.21.15.123:0/3129483720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8101e00 0x7f9aa8073180 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:58:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:58:20.194+0000 7f9aaefeb700 1 -- 172.21.15.123:0/3129483720 >> 172.21.15.123:0/3129483720 conn(0x7f9aa80fc180 msgr2=0x7f9aa8105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:58:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:58:20.194+0000 7f9aaefeb700 1 -- 172.21.15.123:0/3129483720 shutdown_connections 2024-05-06T13:58:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:58:20.194+0000 7f9aaefeb700 1 -- 172.21.15.123:0/3129483720 wait complete. 2024-05-06T13:58:20.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:20 smithi174 ceph-mon[35160]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:20.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:20 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:58:20.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:20 smithi174 ceph-mon[35160]: from='osd.2 [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T13:58:20.754 DEBUG:teuthology.orchestra.run.smithi123:osd.2> sudo journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.2.service 2024-05-06T13:58:20.756 INFO:tasks.cephadm:Deploying osd.3 on smithi174 with /dev/vg_nvme/lv_4... 2024-05-06T13:58:20.756 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-06T13:58:20.967 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi174/config 2024-05-06T13:58:21.122 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:21 smithi174 ceph-mon[35160]: from='osd.2 [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-06T13:58:21.122 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:21 smithi174 ceph-mon[35160]: osdmap e17: 3 total, 2 up, 3 in 2024-05-06T13:58:21.122 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:21 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:58:21.122 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:21 smithi174 ceph-mon[35160]: from='osd.2 [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-05-06T13:58:21.122 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:21 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:21.122 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:21 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:21 smithi123 ceph-mon[27254]: from='osd.2 [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-06T13:58:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:21 smithi123 ceph-mon[27254]: osdmap e17: 3 total, 2 up, 3 in 2024-05-06T13:58:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:21 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:58:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:21 smithi123 ceph-mon[27254]: from='osd.2 [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-05-06T13:58:21.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:21 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:21.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:21 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:21.355 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 13:58:21 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2[61572]: 2024-05-06T13:58:21.023+0000 7f192b048700 -1 osd.2 0 waiting for initial osdmap 2024-05-06T13:58:21.355 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 13:58:21 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2[61572]: 2024-05-06T13:58:21.033+0000 7f192563a700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:58:22.260 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:22 smithi174 ceph-mon[35160]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:22.260 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:22 smithi174 ceph-mon[35160]: from='osd.2 [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-05-06T13:58:22.261 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:22 smithi174 ceph-mon[35160]: osdmap e18: 3 total, 2 up, 3 in 2024-05-06T13:58:22.261 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:58:22.261 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:58:22.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:22 smithi123 ceph-mon[27254]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:22.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:22 smithi123 ceph-mon[27254]: from='osd.2 [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-05-06T13:58:22.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:22 smithi123 ceph-mon[27254]: osdmap e18: 3 total, 2 up, 3 in 2024-05-06T13:58:22.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:58:22.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:58:22.822 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-06T13:58:22.822 INFO:teuthology.orchestra.run.smithi174.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-06T13:58:22.823 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10+0 records in 2024-05-06T13:58:22.823 INFO:teuthology.orchestra.run.smithi174.stderr:10+0 records out 2024-05-06T13:58:22.823 INFO:teuthology.orchestra.run.smithi174.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112758 s, 930 MB/s 2024-05-06T13:58:22.823 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 2024-05-06T13:58:22.823 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping successful for: 2024-05-06T13:58:23.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:23 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:58:23.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:23 smithi123 ceph-mon[27254]: osd.2 [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076] boot 2024-05-06T13:58:23.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:23 smithi123 ceph-mon[27254]: osdmap e19: 3 total, 3 up, 3 in 2024-05-06T13:58:23.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:23 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:58:23.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:23 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-06T13:58:23.386 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:23 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:58:23.386 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:23 smithi174 ceph-mon[35160]: osd.2 [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076] boot 2024-05-06T13:58:23.387 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:23 smithi174 ceph-mon[35160]: osdmap e19: 3 total, 3 up, 3 in 2024-05-06T13:58:23.387 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:23 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:58:23.387 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:23 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-06T13:58:23.388 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi174:vg_nvme/lv_4 2024-05-06T13:58:23.602 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi174/config 2024-05-06T13:58:24.274 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:24 smithi174 ceph-mon[35160]: purged_snaps scrub starts 2024-05-06T13:58:24.275 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:24 smithi174 ceph-mon[35160]: purged_snaps scrub ok 2024-05-06T13:58:24.275 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:24 smithi174 ceph-mon[35160]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:24.275 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:24 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:24.275 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:24 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:24.275 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:24 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-06T13:58:24.275 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:24 smithi174 ceph-mon[35160]: osdmap e20: 3 total, 3 up, 3 in 2024-05-06T13:58:24.275 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:24 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-06T13:58:24.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:24 smithi123 ceph-mon[27254]: purged_snaps scrub starts 2024-05-06T13:58:24.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:24 smithi123 ceph-mon[27254]: purged_snaps scrub ok 2024-05-06T13:58:24.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:24 smithi123 ceph-mon[27254]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T13:58:24.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:24 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:24.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:24 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:24.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:24 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-06T13:58:24.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:24 smithi123 ceph-mon[27254]: osdmap e20: 3 total, 3 up, 3 in 2024-05-06T13:58:24.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:24 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-06T13:58:25.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.185+0000 7ff1053d3700 1 -- 172.21.15.174:0/2306742691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff100100cb0 msgr2=0x7ff100101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:58:25.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.185+0000 7ff1053d3700 1 --2- 172.21.15.174:0/2306742691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff100100cb0 0x7ff100101110 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009910 tx=0x7ff0e8009c20 comp rx=0 tx=0).stop 2024-05-06T13:58:25.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.185+0000 7ff1053d3700 1 -- 172.21.15.174:0/2306742691 shutdown_connections 2024-05-06T13:58:25.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.185+0000 7ff1053d3700 1 --2- 172.21.15.174:0/2306742691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff100100cb0 0x7ff100101110 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:58:25.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.185+0000 7ff1053d3700 1 --2- 172.21.15.174:0/2306742691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1000ffab0 0x7ff1000ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:58:25.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.185+0000 7ff1053d3700 1 -- 172.21.15.174:0/2306742691 >> 172.21.15.174:0/2306742691 conn(0x7ff1000fb030 msgr2=0x7ff1000fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:58:25.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.185+0000 7ff1053d3700 1 -- 172.21.15.174:0/2306742691 shutdown_connections 2024-05-06T13:58:25.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.185+0000 7ff1053d3700 1 -- 172.21.15.174:0/2306742691 wait complete. 2024-05-06T13:58:25.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.186+0000 7ff1053d3700 1 Processor -- start 2024-05-06T13:58:25.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.186+0000 7ff1053d3700 1 -- start start 2024-05-06T13:58:25.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.186+0000 7ff1053d3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1000ffab0 0x7ff100068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:58:25.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.186+0000 7ff1053d3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff100100cb0 0x7ff10019b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:58:25.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.186+0000 7ff1053d3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10019b650 con 0x7ff1000ffab0 2024-05-06T13:58:25.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.186+0000 7ff1053d3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10019b7c0 con 0x7ff100100cb0 2024-05-06T13:58:25.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.186+0000 7ff0fe7fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff100100cb0 0x7ff10019b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:58:25.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.186+0000 7ff0fe7fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff100100cb0 0x7ff10019b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:50030/0 (socket says 172.21.15.174:50030) 2024-05-06T13:58:25.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.186+0000 7ff0fe7fc700 1 -- 172.21.15.174:0/4123196833 learned_addr learned my addr 172.21.15.174:0/4123196833 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:58:25.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.186+0000 7ff0feffd700 1 --2- 172.21.15.174:0/4123196833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1000ffab0 0x7ff100068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:58:25.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.186+0000 7ff0fe7fc700 1 -- 172.21.15.174:0/4123196833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1000ffab0 msgr2=0x7ff100068f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:58:25.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.186+0000 7ff0fe7fc700 1 --2- 172.21.15.174:0/4123196833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1000ffab0 0x7ff100068f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:58:25.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.187+0000 7ff0fe7fc700 1 -- 172.21.15.174:0/4123196833 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e80095f0 con 0x7ff100100cb0 2024-05-06T13:58:25.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.187+0000 7ff0fe7fc700 1 --2- 172.21.15.174:0/4123196833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff100100cb0 0x7ff10019b080 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8000c00 tx=0x7ff0e800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:58:25.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.187+0000 7ff0f7fff700 1 -- 172.21.15.174:0/4123196833 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0e801d070 con 0x7ff100100cb0 2024-05-06T13:58:25.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.187+0000 7ff1053d3700 1 -- 172.21.15.174:0/4123196833 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10019ba40 con 0x7ff100100cb0 2024-05-06T13:58:25.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.187+0000 7ff0f7fff700 1 -- 172.21.15.174:0/4123196833 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff0e8005dc0 con 0x7ff100100cb0 2024-05-06T13:58:25.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.187+0000 7ff0f7fff700 1 -- 172.21.15.174:0/4123196833 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0e80226a0 con 0x7ff100100cb0 2024-05-06T13:58:25.192 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.187+0000 7ff1053d3700 1 -- 172.21.15.174:0/4123196833 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10019bf30 con 0x7ff100100cb0 2024-05-06T13:58:25.193 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.188+0000 7ff1053d3700 1 -- 172.21.15.174:0/4123196833 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff100108610 con 0x7ff100100cb0 2024-05-06T13:58:25.193 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.189+0000 7ff0f7fff700 1 -- 172.21.15.174:0/4123196833 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7ff0e80038f0 con 0x7ff100100cb0 2024-05-06T13:58:25.193 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.189+0000 7ff0f7fff700 1 --2- 172.21.15.174:0/4123196833 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff0ec06c4e0 0x7ff0ec06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:58:25.193 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.189+0000 7ff0f7fff700 1 -- 172.21.15.174:0/4123196833 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3232+0+0 (secure 0 0 0) 0x7ff0e808c4a0 con 0x7ff100100cb0 2024-05-06T13:58:25.193 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.189+0000 7ff0feffd700 1 --2- 172.21.15.174:0/4123196833 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff0ec06c4e0 0x7ff0ec06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:58:25.193 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.189+0000 7ff0feffd700 1 --2- 172.21.15.174:0/4123196833 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff0ec06c4e0 0x7ff0ec06e9a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff100100b10 tx=0x7ff0f0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:58:25.194 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.194+0000 7ff0f7fff700 1 -- 172.21.15.174:0/4123196833 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff0e805afd0 con 0x7ff100100cb0 2024-05-06T13:58:25.246 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:25 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-06T13:58:25.246 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:25 smithi123 ceph-mon[27254]: osdmap e21: 3 total, 3 up, 3 in 2024-05-06T13:58:25.246 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 13:58:24 smithi123 sudo[63446]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T13:58:25.247 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 13:58:24 smithi123 sudo[63446]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T13:58:25.247 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 13:58:24 smithi123 sudo[63446]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-06T13:58:25.247 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 13:58:24 smithi123 sudo[63446]: pam_unix(sudo:session): session closed for user root 2024-05-06T13:58:25.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:25 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-06T13:58:25.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:25 smithi174 ceph-mon[35160]: osdmap e21: 3 total, 3 up, 3 in 2024-05-06T13:58:25.391 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:25.389+0000 7ff1053d3700 1 -- 172.21.15.174:0/4123196833 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff100105600 con 0x7ff0ec06c4e0 2024-05-06T13:58:25.525 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 13:58:25 smithi123 sudo[63457]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T13:58:25.525 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 13:58:25 smithi123 sudo[63457]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T13:58:25.525 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 13:58:25 smithi123 sudo[63457]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-06T13:58:25.525 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 13:58:25 smithi123 sudo[63457]: pam_unix(sudo:session): session closed for user root 2024-05-06T13:58:25.783 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 13:58:25 smithi123 sudo[63483]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T13:58:25.783 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 13:58:25 smithi123 sudo[63483]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T13:58:25.784 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 13:58:25 smithi123 sudo[63483]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-06T13:58:25.784 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 13:58:25 smithi123 sudo[63483]: pam_unix(sudo:session): session closed for user root 2024-05-06T13:58:26.039 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 13:58:25 smithi123 sudo[66048]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T13:58:26.039 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 13:58:25 smithi123 sudo[66048]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T13:58:26.039 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 13:58:25 smithi123 sudo[66048]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-06T13:58:26.039 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 13:58:25 smithi123 sudo[66048]: pam_unix(sudo:session): session closed for user root 2024-05-06T13:58:26.296 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66061]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T13:58:26.296 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66061]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T13:58:26.296 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66061]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-06T13:58:26.296 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66061]: pam_unix(sudo:session): session closed for user root 2024-05-06T13:58:26.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 ceph-mon[27254]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-05-06T13:58:26.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 ceph-mon[27254]: osdmap e22: 3 total, 3 up, 3 in 2024-05-06T13:58:26.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 ceph-mon[27254]: mgrmap e19: smithi123.vjztrj(active, since 2m), standbys: smithi174.ybuavj 2024-05-06T13:58:26.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:26.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T13:58:26.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T13:58:26.297 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:26.506 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:26 smithi174 ceph-mon[35160]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-05-06T13:58:26.506 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:26 smithi174 ceph-mon[35160]: osdmap e22: 3 total, 3 up, 3 in 2024-05-06T13:58:26.506 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:26 smithi174 ceph-mon[35160]: mgrmap e19: smithi123.vjztrj(active, since 2m), standbys: smithi174.ybuavj 2024-05-06T13:58:26.506 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:26 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:26.506 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:26 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T13:58:26.507 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:26 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T13:58:26.507 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:26 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:26.546 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66068]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T13:58:26.546 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66068]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T13:58:26.547 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66068]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-06T13:58:26.547 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66068]: pam_unix(sudo:session): session closed for user root 2024-05-06T13:58:26.803 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66071]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T13:58:26.803 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66071]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T13:58:26.804 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66071]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-06T13:58:26.804 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66071]: pam_unix(sudo:session): session closed for user root 2024-05-06T13:58:27.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66074]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T13:58:27.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66074]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T13:58:27.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66074]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-06T13:58:27.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:26 smithi123 sudo[66074]: pam_unix(sudo:session): session closed for user root 2024-05-06T13:58:27.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 sudo[38954]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T13:58:27.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 sudo[38954]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T13:58:27.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 sudo[38954]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-06T13:58:27.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 sudo[38954]: pam_unix(sudo:session): session closed for user root 2024-05-06T13:58:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:27 smithi123 ceph-mon[27254]: from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:58:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:27 smithi123 ceph-mon[27254]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T13:58:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:27 smithi123 ceph-mon[27254]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T13:58:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:27 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-05-06T13:58:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:27 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:58:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:27 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:27 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-05-06T13:58:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:27 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:58:27.772 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 sudo[38962]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T13:58:27.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 sudo[38962]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T13:58:27.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 sudo[38962]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-06T13:58:27.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 sudo[38962]: pam_unix(sudo:session): session closed for user root 2024-05-06T13:58:27.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 ceph-mon[35160]: from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:58:27.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 ceph-mon[35160]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T13:58:27.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 ceph-mon[35160]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T13:58:27.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-05-06T13:58:27.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:58:27.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:27.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi123"}]: dispatch 2024-05-06T13:58:27.773 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:27 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mon metadata", "id": "smithi174"}]: dispatch 2024-05-06T13:58:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: Detected new or changed devices on smithi123 2024-05-06T13:58:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T13:58:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-06T13:58:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T13:58:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:58:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:58:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:58:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: Adjusting osd_memory_target on smithi123 to 3946M 2024-05-06T13:58:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:28.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:58:28.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:28.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:28.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:58:28.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='client.? 172.21.15.174:0/993427363' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ee0a686-0cf2-48df-838f-9d10a55c6a1c"}]: dispatch 2024-05-06T13:58:28.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ee0a686-0cf2-48df-838f-9d10a55c6a1c"}]: dispatch 2024-05-06T13:58:28.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ee0a686-0cf2-48df-838f-9d10a55c6a1c"}]': finished 2024-05-06T13:58:28.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: osdmap e23: 4 total, 3 up, 4 in 2024-05-06T13:58:28.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:58:28.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: Detected new or changed devices on smithi123 2024-05-06T13:58:28.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T13:58:28.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-06T13:58:28.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T13:58:28.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: Adjusting osd_memory_target on smithi123 to 3946M 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/993427363' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ee0a686-0cf2-48df-838f-9d10a55c6a1c"}]: dispatch 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ee0a686-0cf2-48df-838f-9d10a55c6a1c"}]: dispatch 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ee0a686-0cf2-48df-838f-9d10a55c6a1c"}]': finished 2024-05-06T13:58:28.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: osdmap e23: 4 total, 3 up, 4 in 2024-05-06T13:58:28.606 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:58:29.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:29 smithi174 ceph-mon[35160]: from='client.? 172.21.15.174:0/3764488360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T13:58:29.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:29 smithi174 ceph-mon[35160]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-06T13:58:29.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:29 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/3764488360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T13:58:29.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:29 smithi123 ceph-mon[27254]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-06T13:58:32.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:31 smithi174 ceph-mon[35160]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-06T13:58:32.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:31 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:32.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:31 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:32.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:31 smithi123 ceph-mon[27254]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-06T13:58:32.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:31 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:32.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:31 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:33.102 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:32 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:33.102 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:32 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:58:33.102 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:32 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:33.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:32 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:33.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:32 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:58:33.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:32 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:34.414 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:34 smithi174 ceph-mon[35160]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-06T13:58:34.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:34 smithi123 ceph-mon[27254]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-06T13:58:35.389 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:58:35.389 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T13:58:35.389 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:35.506 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:58:35.506 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T13:58:35.506 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:36.501 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:36 smithi174 ceph-mon[35160]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-05-06T13:58:36.501 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:36 smithi174 ceph-mon[35160]: Deploying daemon osd.3 on smithi174 2024-05-06T13:58:36.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:36 smithi123 ceph-mon[27254]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-05-06T13:58:36.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:36 smithi123 ceph-mon[27254]: Deploying daemon osd.3 on smithi174 2024-05-06T13:58:38.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:38 smithi123 ceph-mon[27254]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-06T13:58:38.494 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:38 smithi174 ceph-mon[35160]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-06T13:58:40.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:40 smithi174 ceph-mon[35160]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 71 KiB/s wr, 5 op/s 2024-05-06T13:58:40.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:40 smithi123 ceph-mon[27254]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 71 KiB/s wr, 5 op/s 2024-05-06T13:58:41.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:41.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:41.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:58:41.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:41.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:41.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:58:42.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:42 smithi174 ceph-mon[35160]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T13:58:42.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:42 smithi123 ceph-mon[27254]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T13:58:44.085 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:43 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:44.085 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:43 smithi174 ceph-mon[35160]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T13:58:44.085 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:43 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:44.085 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:43 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:44.085 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:43 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:58:44.085 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:43 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:44.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:43 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:44.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:43 smithi123 ceph-mon[27254]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T13:58:44.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:43 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:44.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:43 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:44.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:43 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:58:44.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:43 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:44.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:44.552+0000 7ff0f7fff700 1 -- 172.21.15.174:0/4123196833 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff100105600 con 0x7ff0ec06c4e0 2024-05-06T13:58:44.553 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 3 on host 'smithi174' 2024-05-06T13:58:44.555 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:44.555+0000 7ff1053d3700 1 -- 172.21.15.174:0/4123196833 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff0ec06c4e0 msgr2=0x7ff0ec06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:58:44.555 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:44.555+0000 7ff1053d3700 1 --2- 172.21.15.174:0/4123196833 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff0ec06c4e0 0x7ff0ec06e9a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff100100b10 tx=0x7ff0f0009260 comp rx=0 tx=0).stop 2024-05-06T13:58:44.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:44.555+0000 7ff1053d3700 1 -- 172.21.15.174:0/4123196833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff100100cb0 msgr2=0x7ff10019b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:58:44.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:44.555+0000 7ff1053d3700 1 --2- 172.21.15.174:0/4123196833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff100100cb0 0x7ff10019b080 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8000c00 tx=0x7ff0e800f690 comp rx=0 tx=0).stop 2024-05-06T13:58:44.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:44.555+0000 7ff1053d3700 1 -- 172.21.15.174:0/4123196833 shutdown_connections 2024-05-06T13:58:44.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:44.555+0000 7ff1053d3700 1 --2- 172.21.15.174:0/4123196833 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff0ec06c4e0 0x7ff0ec06e9a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:58:44.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:44.555+0000 7ff1053d3700 1 --2- 172.21.15.174:0/4123196833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1000ffab0 0x7ff100068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:58:44.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:44.555+0000 7ff1053d3700 1 --2- 172.21.15.174:0/4123196833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff100100cb0 0x7ff10019b080 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:58:44.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:44.555+0000 7ff1053d3700 1 -- 172.21.15.174:0/4123196833 >> 172.21.15.174:0/4123196833 conn(0x7ff1000fb030 msgr2=0x7ff100103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:58:44.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:44.555+0000 7ff1053d3700 1 -- 172.21.15.174:0/4123196833 shutdown_connections 2024-05-06T13:58:44.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:44.555+0000 7ff1053d3700 1 -- 172.21.15.174:0/4123196833 wait complete. 2024-05-06T13:58:45.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:44 smithi123 ceph-mon[27254]: from='osd.3 [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T13:58:45.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:44 smithi123 ceph-mon[27254]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T13:58:45.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:44 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:45.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:44 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:45.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:44 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:58:45.157 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:44 smithi174 ceph-mon[35160]: from='osd.3 [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T13:58:45.157 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:44 smithi174 ceph-mon[35160]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T13:58:45.157 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:44 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:45.157 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:44 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:45.157 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:44 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:58:45.179 DEBUG:teuthology.orchestra.run.smithi174:osd.3> sudo journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.3.service 2024-05-06T13:58:45.181 INFO:tasks.cephadm:Deploying osd.4 on smithi174 with /dev/vg_nvme/lv_3... 2024-05-06T13:58:45.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-06T13:58:45.972 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi174/config 2024-05-06T13:58:46.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:45 smithi174 ceph-mon[35160]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-06T13:58:46.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:45 smithi174 ceph-mon[35160]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T13:58:46.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:45 smithi174 ceph-mon[35160]: osdmap e24: 4 total, 3 up, 4 in 2024-05-06T13:58:46.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:45 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:58:46.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:45 smithi174 ceph-mon[35160]: from='osd.3 [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-05-06T13:58:46.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:45 smithi174 ceph-mon[35160]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-05-06T13:58:46.023 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 13:58:45 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T13:58:45.831+0000 7f1505e6e700 -1 osd.3 0 waiting for initial osdmap 2024-05-06T13:58:46.023 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 13:58:45 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T13:58:45.836+0000 7f1502464700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:58:46.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:45 smithi123 ceph-mon[27254]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-06T13:58:46.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:45 smithi123 ceph-mon[27254]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T13:58:46.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:45 smithi123 ceph-mon[27254]: osdmap e24: 4 total, 3 up, 4 in 2024-05-06T13:58:46.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:45 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:58:46.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:45 smithi123 ceph-mon[27254]: from='osd.3 [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-05-06T13:58:46.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:45 smithi123 ceph-mon[27254]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-05-06T13:58:47.022 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:46 smithi174 ceph-mon[35160]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-05-06T13:58:47.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:46 smithi174 ceph-mon[35160]: osdmap e25: 4 total, 3 up, 4 in 2024-05-06T13:58:47.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:46 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:58:47.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:46 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:58:47.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:46 smithi123 ceph-mon[27254]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-05-06T13:58:47.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:46 smithi123 ceph-mon[27254]: osdmap e25: 4 total, 3 up, 4 in 2024-05-06T13:58:47.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:46 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:58:47.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:46 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:58:48.008 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:47 smithi174 ceph-mon[35160]: purged_snaps scrub starts 2024-05-06T13:58:48.008 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:47 smithi174 ceph-mon[35160]: purged_snaps scrub ok 2024-05-06T13:58:48.008 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:47 smithi174 ceph-mon[35160]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-06T13:58:48.008 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:47 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:58:48.008 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:47 smithi174 ceph-mon[35160]: osd.3 [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218] boot 2024-05-06T13:58:48.009 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:47 smithi174 ceph-mon[35160]: osdmap e26: 4 total, 4 up, 4 in 2024-05-06T13:58:48.009 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:47 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:58:48.103 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:47 smithi123 ceph-mon[27254]: purged_snaps scrub starts 2024-05-06T13:58:48.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:47 smithi123 ceph-mon[27254]: purged_snaps scrub ok 2024-05-06T13:58:48.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:47 smithi123 ceph-mon[27254]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-06T13:58:48.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:47 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:58:48.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:47 smithi123 ceph-mon[27254]: osd.3 [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218] boot 2024-05-06T13:58:48.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:47 smithi123 ceph-mon[27254]: osdmap e26: 4 total, 4 up, 4 in 2024-05-06T13:58:48.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:47 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:58:48.329 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-06T13:58:48.329 INFO:teuthology.orchestra.run.smithi174.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-06T13:58:48.329 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10+0 records in 2024-05-06T13:58:48.329 INFO:teuthology.orchestra.run.smithi174.stderr:10+0 records out 2024-05-06T13:58:48.329 INFO:teuthology.orchestra.run.smithi174.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122994 s, 853 MB/s 2024-05-06T13:58:48.329 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping successful for: 2024-05-06T13:58:48.971 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:48 smithi174 ceph-mon[35160]: osdmap e27: 4 total, 4 up, 4 in 2024-05-06T13:58:48.994 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi174:vg_nvme/lv_3 2024-05-06T13:58:49.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:48 smithi123 ceph-mon[27254]: osdmap e27: 4 total, 4 up, 4 in 2024-05-06T13:58:49.630 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi174/config 2024-05-06T13:58:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:49 smithi174 ceph-mon[35160]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:58:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:49 smithi174 ceph-mon[35160]: osdmap e28: 4 total, 4 up, 4 in 2024-05-06T13:58:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:58:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:58:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:50.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:49 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:58:50.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:49 smithi123 ceph-mon[27254]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:58:50.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:49 smithi123 ceph-mon[27254]: osdmap e28: 4 total, 4 up, 4 in 2024-05-06T13:58:50.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:50.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:50.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:58:50.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:50.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:50.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:58:50.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:58:50.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:49 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:58:50.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:50 smithi174 ceph-mon[35160]: Detected new or changed devices on smithi174 2024-05-06T13:58:50.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:50 smithi174 ceph-mon[35160]: Adjusting osd_memory_target on smithi174 to 14912M 2024-05-06T13:58:50.950 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:50 smithi174 ceph-mon[35160]: osdmap e29: 4 total, 4 up, 4 in 2024-05-06T13:58:51.172 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.170+0000 7ff6e651a700 1 -- 172.21.15.174:0/1937775027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6e0100bb0 msgr2=0x7ff6e0100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:58:51.172 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.170+0000 7ff6e651a700 1 --2- 172.21.15.174:0/1937775027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6e0100bb0 0x7ff6e0100fd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009910 tx=0x7ff6d0009c20 comp rx=0 tx=0).stop 2024-05-06T13:58:51.172 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.171+0000 7ff6e651a700 1 -- 172.21.15.174:0/1937775027 shutdown_connections 2024-05-06T13:58:51.172 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.171+0000 7ff6e651a700 1 --2- 172.21.15.174:0/1937775027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e0101db0 0x7ff6e0102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:58:51.172 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.171+0000 7ff6e651a700 1 --2- 172.21.15.174:0/1937775027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6e0100bb0 0x7ff6e0100fd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:58:51.172 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.171+0000 7ff6e651a700 1 -- 172.21.15.174:0/1937775027 >> 172.21.15.174:0/1937775027 conn(0x7ff6e00fc110 msgr2=0x7ff6e00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:58:51.172 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.171+0000 7ff6e651a700 1 -- 172.21.15.174:0/1937775027 shutdown_connections 2024-05-06T13:58:51.172 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.171+0000 7ff6e651a700 1 -- 172.21.15.174:0/1937775027 wait complete. 2024-05-06T13:58:51.172 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.171+0000 7ff6e651a700 1 Processor -- start 2024-05-06T13:58:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.171+0000 7ff6e651a700 1 -- start start 2024-05-06T13:58:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6e651a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6e0100bb0 0x7ff6e01963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:58:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6e651a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e0101db0 0x7ff6e0196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:58:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6e651a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0196f40 con 0x7ff6e0101db0 2024-05-06T13:58:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6e651a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0197080 con 0x7ff6e0100bb0 2024-05-06T13:58:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6dffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6e0100bb0 0x7ff6e01963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6dffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6e0100bb0 0x7ff6e01963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:54542/0 (socket says 172.21.15.174:54542) 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6dffff700 1 -- 172.21.15.174:0/657485777 learned_addr learned my addr 172.21.15.174:0/657485777 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6df7fe700 1 --2- 172.21.15.174:0/657485777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e0101db0 0x7ff6e0196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6dffff700 1 -- 172.21.15.174:0/657485777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e0101db0 msgr2=0x7ff6e0196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6dffff700 1 --2- 172.21.15.174:0/657485777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e0101db0 0x7ff6e0196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6dffff700 1 -- 172.21.15.174:0/657485777 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d00095f0 con 0x7ff6e0100bb0 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6df7fe700 1 --2- 172.21.15.174:0/657485777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e0101db0 0x7ff6e0196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6dffff700 1 --2- 172.21.15.174:0/657485777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6e0100bb0 0x7ff6e01963e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000bda0 tx=0x7ff6d000be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6dd7fa700 1 -- 172.21.15.174:0/657485777 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6d001d070 con 0x7ff6e0100bb0 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6e651a700 1 -- 172.21.15.174:0/657485777 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e019bad0 con 0x7ff6e0100bb0 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6dd7fa700 1 -- 172.21.15.174:0/657485777 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff6d0004c50 con 0x7ff6e0100bb0 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6dd7fa700 1 -- 172.21.15.174:0/657485777 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6d000f690 con 0x7ff6e0100bb0 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.172+0000 7ff6e651a700 1 -- 172.21.15.174:0/657485777 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e019c040 con 0x7ff6e0100bb0 2024-05-06T13:58:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.173+0000 7ff6e651a700 1 -- 172.21.15.174:0/657485777 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e0109790 con 0x7ff6e0100bb0 2024-05-06T13:58:51.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.174+0000 7ff6dd7fa700 1 -- 172.21.15.174:0/657485777 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7ff6d00229b0 con 0x7ff6e0100bb0 2024-05-06T13:58:51.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.174+0000 7ff6dd7fa700 1 --2- 172.21.15.174:0/657485777 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff6c806c4e0 0x7ff6c806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:58:51.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.174+0000 7ff6dd7fa700 1 -- 172.21.15.174:0/657485777 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3774+0+0 (secure 0 0 0) 0x7ff6d008c8e0 con 0x7ff6e0100bb0 2024-05-06T13:58:51.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.174+0000 7ff6df7fe700 1 --2- 172.21.15.174:0/657485777 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff6c806c4e0 0x7ff6c806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:58:51.176 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.175+0000 7ff6df7fe700 1 --2- 172.21.15.174:0/657485777 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff6c806c4e0 0x7ff6c806e9a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40099d0 tx=0x7ff6d4008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:58:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.179+0000 7ff6dd7fa700 1 -- 172.21.15.174:0/657485777 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff6d005b2a0 con 0x7ff6e0100bb0 2024-05-06T13:58:51.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:50 smithi123 ceph-mon[27254]: Detected new or changed devices on smithi174 2024-05-06T13:58:51.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:50 smithi123 ceph-mon[27254]: Adjusting osd_memory_target on smithi174 to 14912M 2024-05-06T13:58:51.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:50 smithi123 ceph-mon[27254]: osdmap e29: 4 total, 4 up, 4 in 2024-05-06T13:58:51.375 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:58:51.374+0000 7ff6e651a700 1 -- 172.21.15.174:0/657485777 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6e0106700 con 0x7ff6c806c4e0 2024-05-06T13:58:52.145 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:51 smithi174 ceph-mon[35160]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:58:52.145 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:51 smithi174 ceph-mon[35160]: osdmap e30: 4 total, 4 up, 4 in 2024-05-06T13:58:52.145 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:51 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T13:58:52.146 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:51 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T13:58:52.146 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:51 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:52.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:51 smithi123 ceph-mon[27254]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:58:52.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:51 smithi123 ceph-mon[27254]: osdmap e30: 4 total, 4 up, 4 in 2024-05-06T13:58:52.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:51 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T13:58:52.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:51 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T13:58:52.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:51 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:58:53.144 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:52 smithi123 ceph-mon[27254]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:58:53.235 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:52 smithi174 ceph-mon[35160]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:58:54.185 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:53 smithi174 ceph-mon[35160]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-05-06T13:58:54.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:53 smithi123 ceph-mon[27254]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-05-06T13:58:55.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:54 smithi174 ceph-mon[35160]: from='client.? 172.21.15.174:0/2510464512' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5145c459-5691-41de-a537-aaf278530b72"}]: dispatch 2024-05-06T13:58:55.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:54 smithi174 ceph-mon[35160]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5145c459-5691-41de-a537-aaf278530b72"}]: dispatch 2024-05-06T13:58:55.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:54 smithi174 ceph-mon[35160]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5145c459-5691-41de-a537-aaf278530b72"}]': finished 2024-05-06T13:58:55.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:54 smithi174 ceph-mon[35160]: osdmap e31: 5 total, 4 up, 5 in 2024-05-06T13:58:55.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:54 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:58:55.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:54 smithi174 ceph-mon[35160]: from='client.? 172.21.15.174:0/938760625' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T13:58:55.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:54 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/2510464512' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5145c459-5691-41de-a537-aaf278530b72"}]: dispatch 2024-05-06T13:58:55.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:54 smithi123 ceph-mon[27254]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5145c459-5691-41de-a537-aaf278530b72"}]: dispatch 2024-05-06T13:58:55.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:54 smithi123 ceph-mon[27254]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5145c459-5691-41de-a537-aaf278530b72"}]': finished 2024-05-06T13:58:55.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:54 smithi123 ceph-mon[27254]: osdmap e31: 5 total, 4 up, 5 in 2024-05-06T13:58:55.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:54 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:58:55.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:54 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/938760625' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T13:58:56.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:56 smithi123 ceph-mon[27254]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-06T13:58:56.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:56 smithi174 ceph-mon[35160]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-06T13:58:58.164 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:58:58 smithi174 ceph-mon[35160]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-06T13:58:58.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:58:58 smithi123 ceph-mon[27254]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-06T13:59:00.190 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:00 smithi174 ceph-mon[35160]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-06T13:59:00.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:00 smithi123 ceph-mon[27254]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-06T13:59:02.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:02 smithi123 ceph-mon[27254]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-06T13:59:02.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:02 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T13:59:02.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:02 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:02.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:02 smithi174 ceph-mon[35160]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-06T13:59:02.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:02 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T13:59:02.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:02 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:03.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:03 smithi123 ceph-mon[27254]: Deploying daemon osd.4 on smithi174 2024-05-06T13:59:03.388 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:03 smithi174 ceph-mon[35160]: Deploying daemon osd.4 on smithi174 2024-05-06T13:59:04.139 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:04 smithi174 ceph-mon[35160]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:59:04.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:04 smithi123 ceph-mon[27254]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:59:05.212 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:05 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:59:05.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:05 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:59:06.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:06 smithi123 ceph-mon[27254]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:59:06.418 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:06 smithi174 ceph-mon[35160]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:59:08.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:08.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:08.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:59:08.023 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:07 smithi174 ceph-mon[35160]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:59:08.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:08.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:08.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:59:08.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:07 smithi123 ceph-mon[27254]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:59:10.094 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:09 smithi174 ceph-mon[35160]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:59:10.141 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:10.139+0000 7ff6dd7fa700 1 -- 172.21.15.174:0/657485777 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff6e0106700 con 0x7ff6c806c4e0 2024-05-06T13:59:10.141 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 4 on host 'smithi174' 2024-05-06T13:59:10.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:10.142+0000 7ff6e651a700 1 -- 172.21.15.174:0/657485777 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff6c806c4e0 msgr2=0x7ff6c806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:10.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:10.142+0000 7ff6e651a700 1 --2- 172.21.15.174:0/657485777 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff6c806c4e0 0x7ff6c806e9a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40099d0 tx=0x7ff6d4008040 comp rx=0 tx=0).stop 2024-05-06T13:59:10.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:10.142+0000 7ff6e651a700 1 -- 172.21.15.174:0/657485777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6e0100bb0 msgr2=0x7ff6e01963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:10.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:10.142+0000 7ff6e651a700 1 --2- 172.21.15.174:0/657485777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6e0100bb0 0x7ff6e01963e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000bda0 tx=0x7ff6d000be80 comp rx=0 tx=0).stop 2024-05-06T13:59:10.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:10.142+0000 7ff6e651a700 1 -- 172.21.15.174:0/657485777 shutdown_connections 2024-05-06T13:59:10.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:10.142+0000 7ff6e651a700 1 --2- 172.21.15.174:0/657485777 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff6c806c4e0 0x7ff6c806e9a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:10.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:10.142+0000 7ff6e651a700 1 --2- 172.21.15.174:0/657485777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6e0100bb0 0x7ff6e01963e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:10.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:10.142+0000 7ff6e651a700 1 --2- 172.21.15.174:0/657485777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e0101db0 0x7ff6e0196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:10.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:10.142+0000 7ff6e651a700 1 -- 172.21.15.174:0/657485777 >> 172.21.15.174:0/657485777 conn(0x7ff6e00fc110 msgr2=0x7ff6e0104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:10.144 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:10.142+0000 7ff6e651a700 1 -- 172.21.15.174:0/657485777 shutdown_connections 2024-05-06T13:59:10.144 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:10.142+0000 7ff6e651a700 1 -- 172.21.15.174:0/657485777 wait complete. 2024-05-06T13:59:10.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:09 smithi123 ceph-mon[27254]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:59:10.737 DEBUG:teuthology.orchestra.run.smithi174:osd.4> sudo journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.4.service 2024-05-06T13:59:10.739 INFO:tasks.cephadm:Deploying osd.5 on smithi174 with /dev/vg_nvme/lv_2... 2024-05-06T13:59:10.739 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-06T13:59:11.219 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:11 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:11.219 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:11 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:11.219 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:11 smithi174 ceph-mon[35160]: from='osd.4 [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:59:11.219 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:11 smithi174 ceph-mon[35160]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:59:11.429 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi174/config 2024-05-06T13:59:11.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:11.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:11.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:11 smithi123 ceph-mon[27254]: from='osd.4 [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:59:11.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:11 smithi123 ceph-mon[27254]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:59:12.461 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:12 smithi174 ceph-mon[35160]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:59:12.461 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:12 smithi174 ceph-mon[35160]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T13:59:12.462 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:12 smithi174 ceph-mon[35160]: osdmap e32: 5 total, 4 up, 5 in 2024-05-06T13:59:12.462 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:12 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:59:12.462 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:12 smithi174 ceph-mon[35160]: from='osd.4 [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-05-06T13:59:12.462 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:12 smithi174 ceph-mon[35160]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-05-06T13:59:12.462 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 13:59:12 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T13:59:12.138+0000 7fea918ce700 -1 osd.4 0 waiting for initial osdmap 2024-05-06T13:59:12.463 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 13:59:12 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T13:59:12.145+0000 7fea8cec2700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:59:12.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:12 smithi123 ceph-mon[27254]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:59:12.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:12 smithi123 ceph-mon[27254]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T13:59:12.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:12 smithi123 ceph-mon[27254]: osdmap e32: 5 total, 4 up, 5 in 2024-05-06T13:59:12.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:12 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:59:12.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:12 smithi123 ceph-mon[27254]: from='osd.4 [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-05-06T13:59:12.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:12 smithi123 ceph-mon[27254]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-05-06T13:59:13.267 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-06T13:59:13.267 INFO:teuthology.orchestra.run.smithi174.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-06T13:59:13.267 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10+0 records in 2024-05-06T13:59:13.267 INFO:teuthology.orchestra.run.smithi174.stderr:10+0 records out 2024-05-06T13:59:13.267 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0124395 s, 843 MB/s 2024-05-06T13:59:13.267 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping successful for: 2024-05-06T13:59:13.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:13 smithi174 ceph-mon[35160]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-05-06T13:59:13.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:13 smithi174 ceph-mon[35160]: osdmap e33: 5 total, 4 up, 5 in 2024-05-06T13:59:13.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:13 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:59:13.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:13 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:59:13.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:13 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:13.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:13 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:13.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:13 smithi123 ceph-mon[27254]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-05-06T13:59:13.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:13 smithi123 ceph-mon[27254]: osdmap e33: 5 total, 4 up, 5 in 2024-05-06T13:59:13.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:13 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:59:13.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:13 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:59:13.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:13 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:13.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:13 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:13.903 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi174:vg_nvme/lv_2 2024-05-06T13:59:14.396 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:14 smithi174 ceph-mon[35160]: purged_snaps scrub starts 2024-05-06T13:59:14.396 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:14 smithi174 ceph-mon[35160]: purged_snaps scrub ok 2024-05-06T13:59:14.396 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:14 smithi174 ceph-mon[35160]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:59:14.396 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:14 smithi174 ceph-mon[35160]: osd.4 [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942] boot 2024-05-06T13:59:14.396 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:14 smithi174 ceph-mon[35160]: osdmap e34: 5 total, 5 up, 5 in 2024-05-06T13:59:14.397 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:14 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:59:14.598 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi174/config 2024-05-06T13:59:14.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:14 smithi123 ceph-mon[27254]: purged_snaps scrub starts 2024-05-06T13:59:14.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:14 smithi123 ceph-mon[27254]: purged_snaps scrub ok 2024-05-06T13:59:14.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:14 smithi123 ceph-mon[27254]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T13:59:14.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:14 smithi123 ceph-mon[27254]: osd.4 [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942] boot 2024-05-06T13:59:14.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:14 smithi123 ceph-mon[27254]: osdmap e34: 5 total, 5 up, 5 in 2024-05-06T13:59:14.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:14 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:59:15.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:15 smithi174 ceph-mon[35160]: osdmap e35: 5 total, 5 up, 5 in 2024-05-06T13:59:15.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:15 smithi123 ceph-mon[27254]: osdmap e35: 5 total, 5 up, 5 in 2024-05-06T13:59:16.450 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:16 smithi174 ceph-mon[35160]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:16.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:16 smithi123 ceph-mon[27254]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:17.614 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.608+0000 7f543f89d700 1 -- 172.21.15.174:0/3169157527 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5438101640 msgr2=0x7f5438103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:17.614 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.608+0000 7f543f89d700 1 --2- 172.21.15.174:0/3169157527 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5438101640 0x7f5438103a30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5434009910 tx=0x7f5434009c20 comp rx=0 tx=0).stop 2024-05-06T13:59:17.615 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.608+0000 7f543f89d700 1 -- 172.21.15.174:0/3169157527 shutdown_connections 2024-05-06T13:59:17.615 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.608+0000 7f543f89d700 1 --2- 172.21.15.174:0/3169157527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5438103f70 0x7f5438106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:17.615 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.608+0000 7f543f89d700 1 --2- 172.21.15.174:0/3169157527 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5438101640 0x7f5438103a30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:17.615 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.608+0000 7f543f89d700 1 -- 172.21.15.174:0/3169157527 >> 172.21.15.174:0/3169157527 conn(0x7f54380fb050 msgr2=0x7f54380fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:17.615 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.608+0000 7f543f89d700 1 -- 172.21.15.174:0/3169157527 shutdown_connections 2024-05-06T13:59:17.615 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.608+0000 7f543f89d700 1 -- 172.21.15.174:0/3169157527 wait complete. 2024-05-06T13:59:17.615 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543f89d700 1 Processor -- start 2024-05-06T13:59:17.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543f89d700 1 -- start start 2024-05-06T13:59:17.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543f89d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5438101640 0x7f5438100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:17.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543f89d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5438103f70 0x7f54380ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:17.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543f89d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54380ffb30 con 0x7f5438101640 2024-05-06T13:59:17.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543f89d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54380ffc70 con 0x7f5438103f70 2024-05-06T13:59:17.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543ce38700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5438103f70 0x7f54380ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:17.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543ce38700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5438103f70 0x7f54380ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:38072/0 (socket says 172.21.15.174:38072) 2024-05-06T13:59:17.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543ce38700 1 -- 172.21.15.174:0/2691287564 learned_addr learned my addr 172.21.15.174:0/2691287564 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:59:17.616 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543d639700 1 --2- 172.21.15.174:0/2691287564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5438101640 0x7f5438100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:17.617 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543ce38700 1 -- 172.21.15.174:0/2691287564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5438101640 msgr2=0x7f5438100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:17.617 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543ce38700 1 --2- 172.21.15.174:0/2691287564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5438101640 0x7f5438100fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:17.617 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.609+0000 7f543ce38700 1 -- 172.21.15.174:0/2691287564 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54340095f0 con 0x7f5438103f70 2024-05-06T13:59:17.617 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.610+0000 7f543ce38700 1 --2- 172.21.15.174:0/2691287564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5438103f70 0x7f54380ff5f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f542800d8d0 tx=0x7f542800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:17.617 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.610+0000 7f542e7fc700 1 -- 172.21.15.174:0/2691287564 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5428009940 con 0x7f5438103f70 2024-05-06T13:59:17.617 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.610+0000 7f542e7fc700 1 -- 172.21.15.174:0/2691287564 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5428010460 con 0x7f5438103f70 2024-05-06T13:59:17.618 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.610+0000 7f542e7fc700 1 -- 172.21.15.174:0/2691287564 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f542800f5f0 con 0x7f5438103f70 2024-05-06T13:59:17.618 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.610+0000 7f543f89d700 1 -- 172.21.15.174:0/2691287564 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54380fff50 con 0x7f5438103f70 2024-05-06T13:59:17.618 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.610+0000 7f543f89d700 1 -- 172.21.15.174:0/2691287564 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5438100450 con 0x7f5438103f70 2024-05-06T13:59:17.618 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.611+0000 7f543f89d700 1 -- 172.21.15.174:0/2691287564 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5438190520 con 0x7f5438103f70 2024-05-06T13:59:17.618 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.612+0000 7f542e7fc700 1 -- 172.21.15.174:0/2691287564 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f54280105d0 con 0x7f5438103f70 2024-05-06T13:59:17.618 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.612+0000 7f542e7fc700 1 --2- 172.21.15.174:0/2691287564 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f542406c4e0 0x7f542406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:17.618 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.612+0000 7f542e7fc700 1 -- 172.21.15.174:0/2691287564 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f542808b340 con 0x7f5438103f70 2024-05-06T13:59:17.618 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.612+0000 7f543d639700 1 --2- 172.21.15.174:0/2691287564 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f542406c4e0 0x7f542406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:17.618 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.613+0000 7f543d639700 1 --2- 172.21.15.174:0/2691287564 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f542406c4e0 0x7f542406e9a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5434005b40 tx=0x7f5434005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:17.619 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.617+0000 7f542e7fc700 1 -- 172.21.15.174:0/2691287564 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5428059aa0 con 0x7f5438103f70 2024-05-06T13:59:17.814 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:17.814+0000 7f543f89d700 1 -- 172.21.15.174:0/2691287564 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f54380611d0 con 0x7f542406c4e0 2024-05-06T13:59:18.484 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: pgmap v119: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:18.484 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:18.484 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:18.484 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:59:18.484 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:59:18.484 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:18.484 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:18.485 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:59:18.485 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:18.485 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:59:18.485 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:18.485 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:59:18.485 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:18.485 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T13:59:18.485 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T13:59:18.485 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:18 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:18.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: pgmap v119: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:18.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:18.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:18.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:59:18.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:59:18.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:18.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:18.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:59:18.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:18.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:59:18.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:18.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:59:18.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:18.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T13:59:18.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T13:59:18.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:18 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:19.188 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:19 smithi174 ceph-mon[35160]: Detected new or changed devices on smithi174 2024-05-06T13:59:19.188 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:19 smithi174 ceph-mon[35160]: Adjusting osd_memory_target on smithi174 to 7456M 2024-05-06T13:59:19.188 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:19 smithi174 ceph-mon[35160]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:59:19.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:19 smithi123 ceph-mon[27254]: Detected new or changed devices on smithi174 2024-05-06T13:59:19.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:19 smithi123 ceph-mon[27254]: Adjusting osd_memory_target on smithi174 to 7456M 2024-05-06T13:59:19.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:19 smithi123 ceph-mon[27254]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:59:20.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:20 smithi174 ceph-mon[35160]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:20.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:20 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:59:20.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:20 smithi123 ceph-mon[27254]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:20.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:59:21.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:21 smithi174 ceph-mon[35160]: from='client.? 172.21.15.174:0/177265979' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c59c801-2ae9-4660-8feb-d2474527cc09"}]: dispatch 2024-05-06T13:59:21.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:21 smithi174 ceph-mon[35160]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c59c801-2ae9-4660-8feb-d2474527cc09"}]: dispatch 2024-05-06T13:59:21.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:21 smithi174 ceph-mon[35160]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c59c801-2ae9-4660-8feb-d2474527cc09"}]': finished 2024-05-06T13:59:21.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:21 smithi174 ceph-mon[35160]: osdmap e36: 6 total, 5 up, 6 in 2024-05-06T13:59:21.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:21 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:59:21.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:21 smithi174 ceph-mon[35160]: from='client.? 172.21.15.174:0/1716429735' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T13:59:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:21 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/177265979' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c59c801-2ae9-4660-8feb-d2474527cc09"}]: dispatch 2024-05-06T13:59:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:21 smithi123 ceph-mon[27254]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c59c801-2ae9-4660-8feb-d2474527cc09"}]: dispatch 2024-05-06T13:59:21.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:21 smithi123 ceph-mon[27254]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c59c801-2ae9-4660-8feb-d2474527cc09"}]': finished 2024-05-06T13:59:21.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:21 smithi123 ceph-mon[27254]: osdmap e36: 6 total, 5 up, 6 in 2024-05-06T13:59:21.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:21 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:59:21.605 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:21 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/1716429735' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T13:59:22.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:22 smithi174 ceph-mon[35160]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:22.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:22 smithi123 ceph-mon[27254]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:24.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:24 smithi174 ceph-mon[35160]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:24.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:24 smithi123 ceph-mon[27254]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:26.352 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:26 smithi174 ceph-mon[35160]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:26.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:26 smithi123 ceph-mon[27254]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:28.444 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:28 smithi174 ceph-mon[35160]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:28.445 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T13:59:28.445 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:28 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:28.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:28 smithi123 ceph-mon[27254]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:28.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T13:59:28.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:28 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:29.465 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:29 smithi174 ceph-mon[35160]: Deploying daemon osd.5 on smithi174 2024-05-06T13:59:29.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:29 smithi123 ceph-mon[27254]: Deploying daemon osd.5 on smithi174 2024-05-06T13:59:30.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:30 smithi174 ceph-mon[35160]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:30.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:30 smithi123 ceph-mon[27254]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:32.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:32 smithi174 ceph-mon[35160]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:32.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:32 smithi123 ceph-mon[27254]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:34.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:34 smithi174 ceph-mon[35160]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:34.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:34 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:34.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:34 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:34.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:34 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:59:34.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:34 smithi123 ceph-mon[27254]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:34.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:34 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:34.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:34 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:34.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:34 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:59:35.506 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:59:35.507 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:59:36.400 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:36 smithi174 ceph-mon[35160]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:36.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:36 smithi123 ceph-mon[27254]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:37.132 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:37.131+0000 7f542e7fc700 1 -- 172.21.15.174:0/2691287564 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f54380611d0 con 0x7f542406c4e0 2024-05-06T13:59:37.132 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 5 on host 'smithi174' 2024-05-06T13:59:37.134 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:37.132+0000 7f543f89d700 1 -- 172.21.15.174:0/2691287564 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f542406c4e0 msgr2=0x7f542406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:37.134 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:37.132+0000 7f543f89d700 1 --2- 172.21.15.174:0/2691287564 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f542406c4e0 0x7f542406e9a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5434005b40 tx=0x7f5434005a90 comp rx=0 tx=0).stop 2024-05-06T13:59:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:37.132+0000 7f543f89d700 1 -- 172.21.15.174:0/2691287564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5438103f70 msgr2=0x7f54380ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:37.132+0000 7f543f89d700 1 --2- 172.21.15.174:0/2691287564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5438103f70 0x7f54380ff5f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f542800d8d0 tx=0x7f542800dc90 comp rx=0 tx=0).stop 2024-05-06T13:59:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:37.132+0000 7f543f89d700 1 -- 172.21.15.174:0/2691287564 shutdown_connections 2024-05-06T13:59:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:37.132+0000 7f543f89d700 1 --2- 172.21.15.174:0/2691287564 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f542406c4e0 0x7f542406e9a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:37.132+0000 7f543f89d700 1 --2- 172.21.15.174:0/2691287564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5438101640 0x7f5438100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:37.132+0000 7f543f89d700 1 --2- 172.21.15.174:0/2691287564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5438103f70 0x7f54380ff5f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:37.132+0000 7f543f89d700 1 -- 172.21.15.174:0/2691287564 >> 172.21.15.174:0/2691287564 conn(0x7f54380fb050 msgr2=0x7f54380fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:37.133+0000 7f543f89d700 1 -- 172.21.15.174:0/2691287564 shutdown_connections 2024-05-06T13:59:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:37.133+0000 7f543f89d700 1 -- 172.21.15.174:0/2691287564 wait complete. 2024-05-06T13:59:37.727 DEBUG:teuthology.orchestra.run.smithi174:osd.5> sudo journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.5.service 2024-05-06T13:59:37.729 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-05-06T13:59:37.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-06T13:59:37.948 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:59:38.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:38 smithi123 ceph-mon[27254]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:38.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:38 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:38.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:38 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:38.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:38 smithi123 ceph-mon[27254]: from='osd.5 [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:59:38.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:38 smithi123 ceph-mon[27254]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:59:38.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:38 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:38.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:38 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:38.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:38 smithi174 ceph-mon[35160]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:38.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:38 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:38.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:38 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:38.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:38 smithi174 ceph-mon[35160]: from='osd.5 [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:59:38.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:38 smithi174 ceph-mon[35160]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:59:38.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:38 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:38.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:38 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:39.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:39 smithi174 ceph-mon[35160]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T13:59:39.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:39 smithi174 ceph-mon[35160]: osdmap e37: 6 total, 5 up, 6 in 2024-05-06T13:59:39.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:39 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:59:39.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:39 smithi174 ceph-mon[35160]: from='osd.5 [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-05-06T13:59:39.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:39 smithi174 ceph-mon[35160]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-05-06T13:59:39.273 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 13:59:39 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T13:59:39.102+0000 7ff1a14e8700 -1 osd.5 0 waiting for initial osdmap 2024-05-06T13:59:39.273 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 13:59:39 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T13:59:39.110+0000 7ff19a2d7700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:59:39.344 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:39 smithi123 ceph-mon[27254]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T13:59:39.345 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:39 smithi123 ceph-mon[27254]: osdmap e37: 6 total, 5 up, 6 in 2024-05-06T13:59:39.345 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:39 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:59:39.345 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:39 smithi123 ceph-mon[27254]: from='osd.5 [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-05-06T13:59:39.345 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:39 smithi123 ceph-mon[27254]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-05-06T13:59:39.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.628+0000 7f0ad826c700 1 -- 172.21.15.123:0/3193765792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad0100cb0 msgr2=0x7f0ad0101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:39.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.628+0000 7f0ad826c700 1 --2- 172.21.15.123:0/3193765792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad0100cb0 0x7f0ad0101110 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009910 tx=0x7f0ac0009c20 comp rx=0 tx=0).stop 2024-05-06T13:59:39.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad826c700 1 -- 172.21.15.123:0/3193765792 shutdown_connections 2024-05-06T13:59:39.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad826c700 1 --2- 172.21.15.123:0/3193765792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad0100cb0 0x7f0ad0101110 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:39.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad826c700 1 --2- 172.21.15.123:0/3193765792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ad00ffab0 0x7f0ad00ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:39.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad826c700 1 -- 172.21.15.123:0/3193765792 >> 172.21.15.123:0/3193765792 conn(0x7f0ad00fb030 msgr2=0x7f0ad00fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:39.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad826c700 1 -- 172.21.15.123:0/3193765792 shutdown_connections 2024-05-06T13:59:39.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad826c700 1 -- 172.21.15.123:0/3193765792 wait complete. 2024-05-06T13:59:39.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad826c700 1 Processor -- start 2024-05-06T13:59:39.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad826c700 1 -- start start 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad826c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad00ffab0 0x7f0ad0196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad826c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ad0100cb0 0x7f0ad0196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad826c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0196ea0 con 0x7f0ad00ffab0 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad826c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0196fe0 con 0x7f0ad0100cb0 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad6008700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad00ffab0 0x7f0ad0196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad6008700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad00ffab0 0x7f0ad0196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35826/0 (socket says 172.21.15.123:35826) 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad6008700 1 -- 172.21.15.123:0/654917439 learned_addr learned my addr 172.21.15.123:0/654917439 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.629+0000 7f0ad5807700 1 --2- 172.21.15.123:0/654917439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ad0100cb0 0x7f0ad0196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.630+0000 7f0ad6008700 1 -- 172.21.15.123:0/654917439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ad0100cb0 msgr2=0x7f0ad0196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.630+0000 7f0ad6008700 1 --2- 172.21.15.123:0/654917439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ad0100cb0 0x7f0ad0196880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.630+0000 7f0ad6008700 1 -- 172.21.15.123:0/654917439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00095f0 con 0x7f0ad00ffab0 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.630+0000 7f0ad6008700 1 --2- 172.21.15.123:0/654917439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad00ffab0 0x7f0ad0196340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00d900 tx=0x7f0acc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.630+0000 7f0ac77fe700 1 -- 172.21.15.123:0/654917439 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0acc0041f0 con 0x7f0ad00ffab0 2024-05-06T13:59:39.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.630+0000 7f0ad826c700 1 -- 172.21.15.123:0/654917439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad019ba90 con 0x7f0ad00ffab0 2024-05-06T13:59:39.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.630+0000 7f0ac77fe700 1 -- 172.21.15.123:0/654917439 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0acc004350 con 0x7f0ad00ffab0 2024-05-06T13:59:39.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.630+0000 7f0ac77fe700 1 -- 172.21.15.123:0/654917439 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0acc003d20 con 0x7f0ad00ffab0 2024-05-06T13:59:39.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.630+0000 7f0ad826c700 1 -- 172.21.15.123:0/654917439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad019bfe0 con 0x7f0ad00ffab0 2024-05-06T13:59:39.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.631+0000 7f0ad826c700 1 -- 172.21.15.123:0/654917439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad0108610 con 0x7f0ad00ffab0 2024-05-06T13:59:39.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.632+0000 7f0ac77fe700 1 -- 172.21.15.123:0/654917439 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f0acc009730 con 0x7f0ad00ffab0 2024-05-06T13:59:39.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.632+0000 7f0ac77fe700 1 --2- 172.21.15.123:0/654917439 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f0abc06c4e0 0x7f0abc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:39.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.632+0000 7f0ad5807700 1 --2- 172.21.15.123:0/654917439 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f0abc06c4e0 0x7f0abc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:39.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.632+0000 7f0ac77fe700 1 -- 172.21.15.123:0/654917439 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4358+0+0 (secure 0 0 0) 0x7f0acc08b260 con 0x7f0ad00ffab0 2024-05-06T13:59:39.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.632+0000 7f0ad5807700 1 --2- 172.21.15.123:0/654917439 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f0abc06c4e0 0x7f0abc06e9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0006010 tx=0x7f0ac000b560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:39.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.637+0000 7f0ac77fe700 1 -- 172.21.15.123:0/654917439 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0acc059920 con 0x7f0ad00ffab0 2024-05-06T13:59:39.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.824+0000 7f0ad826c700 1 -- 172.21.15.123:0/654917439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f0ad01087d0 con 0x7f0ad00ffab0 2024-05-06T13:59:39.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.824+0000 7f0ac77fe700 1 -- 172.21.15.123:0/654917439 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f0acc003e80 con 0x7f0ad00ffab0 2024-05-06T13:59:39.825 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:59:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.826+0000 7f0ad826c700 1 -- 172.21.15.123:0/654917439 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f0abc06c4e0 msgr2=0x7f0abc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.826+0000 7f0ad826c700 1 --2- 172.21.15.123:0/654917439 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f0abc06c4e0 0x7f0abc06e9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0006010 tx=0x7f0ac000b560 comp rx=0 tx=0).stop 2024-05-06T13:59:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.826+0000 7f0ad826c700 1 -- 172.21.15.123:0/654917439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad00ffab0 msgr2=0x7f0ad0196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.826+0000 7f0ad826c700 1 --2- 172.21.15.123:0/654917439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad00ffab0 0x7f0ad0196340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00d900 tx=0x7f0acc00dc10 comp rx=0 tx=0).stop 2024-05-06T13:59:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.826+0000 7f0ad826c700 1 -- 172.21.15.123:0/654917439 shutdown_connections 2024-05-06T13:59:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.826+0000 7f0ad826c700 1 --2- 172.21.15.123:0/654917439 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f0abc06c4e0 0x7f0abc06e9a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.826+0000 7f0ad826c700 1 --2- 172.21.15.123:0/654917439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad00ffab0 0x7f0ad0196340 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:39.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.826+0000 7f0ad826c700 1 --2- 172.21.15.123:0/654917439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ad0100cb0 0x7f0ad0196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:39.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.826+0000 7f0ad826c700 1 -- 172.21.15.123:0/654917439 >> 172.21.15.123:0/654917439 conn(0x7f0ad00fb030 msgr2=0x7f0ad0068410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:39.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.826+0000 7f0ad826c700 1 -- 172.21.15.123:0/654917439 shutdown_connections 2024-05-06T13:59:39.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:39.826+0000 7f0ad826c700 1 -- 172.21.15.123:0/654917439 wait complete. 2024-05-06T13:59:40.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:40 smithi174 ceph-mon[35160]: purged_snaps scrub starts 2024-05-06T13:59:40.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:40 smithi174 ceph-mon[35160]: purged_snaps scrub ok 2024-05-06T13:59:40.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:40 smithi174 ceph-mon[35160]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:40.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:40 smithi174 ceph-mon[35160]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-05-06T13:59:40.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:40 smithi174 ceph-mon[35160]: osdmap e38: 6 total, 5 up, 6 in 2024-05-06T13:59:40.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:40 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:59:40.274 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:40 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:59:40.274 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:40 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/654917439' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-06T13:59:40.551 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:40 smithi123 ceph-mon[27254]: purged_snaps scrub starts 2024-05-06T13:59:40.552 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:40 smithi123 ceph-mon[27254]: purged_snaps scrub ok 2024-05-06T13:59:40.552 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:40 smithi123 ceph-mon[27254]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:40.552 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:40 smithi123 ceph-mon[27254]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-05-06T13:59:40.552 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:40 smithi123 ceph-mon[27254]: osdmap e38: 6 total, 5 up, 6 in 2024-05-06T13:59:40.552 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:40 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:59:40.552 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:40 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:59:40.552 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:40 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/654917439' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-06T13:59:40.573 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1715003953,"num_in_osds":6,"osd_in_since":1715003960,"num_remapped_pgs":0} 2024-05-06T13:59:41.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:41 smithi174 ceph-mon[35160]: osd.5 [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711] boot 2024-05-06T13:59:41.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:41 smithi174 ceph-mon[35160]: osdmap e39: 6 total, 6 up, 6 in 2024-05-06T13:59:41.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:59:41.574 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-06T13:59:41.596 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:41 smithi123 ceph-mon[27254]: osd.5 [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711] boot 2024-05-06T13:59:41.596 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:41 smithi123 ceph-mon[27254]: osdmap e39: 6 total, 6 up, 6 in 2024-05-06T13:59:41.596 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:59:41.783 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:59:42.188 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:42.188 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: osdmap e40: 6 total, 6 up, 6 in 2024-05-06T13:59:42.188 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:42.188 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:42.188 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:59:42.188 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:59:42.188 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:59:42.188 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:42.188 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:42.188 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:59:42.188 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:42.188 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:59:42.189 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:42.189 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:59:42.189 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:42 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:42.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T13:59:42.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: osdmap e40: 6 total, 6 up, 6 in 2024-05-06T13:59:42.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:42.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:42.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:59:42.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:59:42.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:59:42.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:42.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:42.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:59:42.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:42.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:59:42.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:59:42.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:59:42.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:42 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T13:59:43.220 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:43 smithi123 ceph-mon[27254]: Detected new or changed devices on smithi174 2024-05-06T13:59:43.220 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:43 smithi123 ceph-mon[27254]: Adjusting osd_memory_target on smithi174 to 4970M 2024-05-06T13:59:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.410+0000 7f6e16db3700 1 -- 172.21.15.123:0/1468440887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100ffdc0 msgr2=0x7f6e10100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.410+0000 7f6e16db3700 1 --2- 172.21.15.123:0/1468440887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100ffdc0 0x7f6e10100220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009910 tx=0x7f6e00009c20 comp rx=0 tx=0).stop 2024-05-06T13:59:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.410+0000 7f6e16db3700 1 -- 172.21.15.123:0/1468440887 shutdown_connections 2024-05-06T13:59:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.410+0000 7f6e16db3700 1 --2- 172.21.15.123:0/1468440887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e100ffdc0 0x7f6e10100220 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.410+0000 7f6e16db3700 1 --2- 172.21.15.123:0/1468440887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e10101080 0x7f6e101014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.410+0000 7f6e16db3700 1 -- 172.21.15.123:0/1468440887 >> 172.21.15.123:0/1468440887 conn(0x7f6e100fa810 msgr2=0x7f6e100fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.410+0000 7f6e16db3700 1 -- 172.21.15.123:0/1468440887 shutdown_connections 2024-05-06T13:59:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.410+0000 7f6e16db3700 1 -- 172.21.15.123:0/1468440887 wait complete. 2024-05-06T13:59:43.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e16db3700 1 Processor -- start 2024-05-06T13:59:43.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e16db3700 1 -- start start 2024-05-06T13:59:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e16db3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e100ffdc0 0x7f6e101952e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e16db3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e10101080 0x7f6e10195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e16db3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e10195e40 con 0x7f6e10101080 2024-05-06T13:59:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e16db3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e10195f80 con 0x7f6e100ffdc0 2024-05-06T13:59:43.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e0ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e10101080 0x7f6e10195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e0ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e10101080 0x7f6e10195820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35844/0 (socket says 172.21.15.123:35844) 2024-05-06T13:59:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e0ffff700 1 -- 172.21.15.123:0/503234522 learned_addr learned my addr 172.21.15.123:0/503234522 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:59:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e14b4f700 1 --2- 172.21.15.123:0/503234522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e100ffdc0 0x7f6e101952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e0ffff700 1 -- 172.21.15.123:0/503234522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e100ffdc0 msgr2=0x7f6e101952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e0ffff700 1 --2- 172.21.15.123:0/503234522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e100ffdc0 0x7f6e101952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.411+0000 7f6e0ffff700 1 -- 172.21.15.123:0/503234522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e000095f0 con 0x7f6e10101080 2024-05-06T13:59:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.412+0000 7f6e0ffff700 1 --2- 172.21.15.123:0/503234522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e10101080 0x7f6e10195820 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6e00006010 tx=0x7f6e0000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.412+0000 7f6e0dffb700 1 -- 172.21.15.123:0/503234522 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e0001d070 con 0x7f6e10101080 2024-05-06T13:59:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.412+0000 7f6e0dffb700 1 -- 172.21.15.123:0/503234522 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e0000f460 con 0x7f6e10101080 2024-05-06T13:59:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.412+0000 7f6e16db3700 1 -- 172.21.15.123:0/503234522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1019a9d0 con 0x7f6e10101080 2024-05-06T13:59:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.412+0000 7f6e0dffb700 1 -- 172.21.15.123:0/503234522 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e00021640 con 0x7f6e10101080 2024-05-06T13:59:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.412+0000 7f6e16db3700 1 -- 172.21.15.123:0/503234522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1019aec0 con 0x7f6e10101080 2024-05-06T13:59:43.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.413+0000 7f6e16db3700 1 -- 172.21.15.123:0/503234522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e10108660 con 0x7f6e10101080 2024-05-06T13:59:43.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.413+0000 7f6e0dffb700 1 -- 172.21.15.123:0/503234522 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f6e0000faf0 con 0x7f6e10101080 2024-05-06T13:59:43.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.414+0000 7f6e0dffb700 1 --2- 172.21.15.123:0/503234522 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f6dfc06c4e0 0x7f6dfc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:43.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.414+0000 7f6e0dffb700 1 -- 172.21.15.123:0/503234522 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6e0008c8d0 con 0x7f6e10101080 2024-05-06T13:59:43.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.414+0000 7f6e14b4f700 1 --2- 172.21.15.123:0/503234522 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f6dfc06c4e0 0x7f6dfc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:43.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.414+0000 7f6e14b4f700 1 --2- 172.21.15.123:0/503234522 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f6dfc06c4e0 0x7f6dfc06e9a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6e08007720 tx=0x7f6e080076b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:43.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.418+0000 7f6e0dffb700 1 -- 172.21.15.123:0/503234522 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6e0005ae80 con 0x7f6e10101080 2024-05-06T13:59:43.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:43 smithi174 ceph-mon[35160]: Detected new or changed devices on smithi174 2024-05-06T13:59:43.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:43 smithi174 ceph-mon[35160]: Adjusting osd_memory_target on smithi174 to 4970M 2024-05-06T13:59:43.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.613+0000 7f6e16db3700 1 -- 172.21.15.123:0/503234522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f6e10108820 con 0x7f6e10101080 2024-05-06T13:59:43.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.614+0000 7f6e0dffb700 1 -- 172.21.15.123:0/503234522 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f6e0005aa10 con 0x7f6e10101080 2024-05-06T13:59:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:59:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.616+0000 7f6e16db3700 1 -- 172.21.15.123:0/503234522 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f6dfc06c4e0 msgr2=0x7f6dfc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.616+0000 7f6e16db3700 1 --2- 172.21.15.123:0/503234522 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f6dfc06c4e0 0x7f6dfc06e9a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6e08007720 tx=0x7f6e080076b0 comp rx=0 tx=0).stop 2024-05-06T13:59:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.616+0000 7f6e16db3700 1 -- 172.21.15.123:0/503234522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e10101080 msgr2=0x7f6e10195820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.616+0000 7f6e16db3700 1 --2- 172.21.15.123:0/503234522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e10101080 0x7f6e10195820 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6e00006010 tx=0x7f6e0000be20 comp rx=0 tx=0).stop 2024-05-06T13:59:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.616+0000 7f6e16db3700 1 -- 172.21.15.123:0/503234522 shutdown_connections 2024-05-06T13:59:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.616+0000 7f6e16db3700 1 --2- 172.21.15.123:0/503234522 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f6dfc06c4e0 0x7f6dfc06e9a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.616+0000 7f6e16db3700 1 --2- 172.21.15.123:0/503234522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e100ffdc0 0x7f6e101952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.616+0000 7f6e16db3700 1 --2- 172.21.15.123:0/503234522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e10101080 0x7f6e10195820 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.616+0000 7f6e16db3700 1 -- 172.21.15.123:0/503234522 >> 172.21.15.123:0/503234522 conn(0x7f6e100fa810 msgr2=0x7f6e10104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:43.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.616+0000 7f6e16db3700 1 -- 172.21.15.123:0/503234522 shutdown_connections 2024-05-06T13:59:43.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:43.616+0000 7f6e16db3700 1 -- 172.21.15.123:0/503234522 wait complete. 2024-05-06T13:59:44.316 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:44 smithi123 ceph-mon[27254]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:44.316 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:44 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/503234522' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-06T13:59:44.340 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1715003980,"num_in_osds":6,"osd_in_since":1715003960,"num_remapped_pgs":0} 2024-05-06T13:59:44.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-06T13:59:44.439 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:44 smithi174 ceph-mon[35160]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:44.439 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:44 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/503234522' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-06T13:59:44.588 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:59:46.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.209+0000 7fe865639700 1 -- 172.21.15.123:0/293708329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe860100de0 msgr2=0x7fe8601011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:46.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.209+0000 7fe865639700 1 --2- 172.21.15.123:0/293708329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe860100de0 0x7fe8601011c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe850009910 tx=0x7fe850009c20 comp rx=0 tx=0).stop 2024-05-06T13:59:46.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.209+0000 7fe865639700 1 -- 172.21.15.123:0/293708329 shutdown_connections 2024-05-06T13:59:46.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.209+0000 7fe865639700 1 --2- 172.21.15.123:0/293708329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe860101790 0x7fe8601057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:46.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.209+0000 7fe865639700 1 --2- 172.21.15.123:0/293708329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe860100de0 0x7fe8601011c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:46.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.209+0000 7fe865639700 1 -- 172.21.15.123:0/293708329 >> 172.21.15.123:0/293708329 conn(0x7fe8600fc670 msgr2=0x7fe8600fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:46.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.209+0000 7fe865639700 1 -- 172.21.15.123:0/293708329 shutdown_connections 2024-05-06T13:59:46.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.209+0000 7fe865639700 1 -- 172.21.15.123:0/293708329 wait complete. 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.209+0000 7fe865639700 1 Processor -- start 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe865639700 1 -- start start 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe865639700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe860100de0 0x7fe86019c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe865639700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe860101790 0x7fe86019cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe865639700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86019d150 con 0x7fe860101790 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe865639700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe860196600 con 0x7fe860100de0 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe85e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe860101790 0x7fe86019cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe85e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe860101790 0x7fe86019cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35866/0 (socket says 172.21.15.123:35866) 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe85e7fc700 1 -- 172.21.15.123:0/3742077528 learned_addr learned my addr 172.21.15.123:0/3742077528 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe85effd700 1 --2- 172.21.15.123:0/3742077528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe860100de0 0x7fe86019c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe85e7fc700 1 -- 172.21.15.123:0/3742077528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe860100de0 msgr2=0x7fe86019c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe85e7fc700 1 --2- 172.21.15.123:0/3742077528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe860100de0 0x7fe86019c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe85e7fc700 1 -- 172.21.15.123:0/3742077528 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500095f0 con 0x7fe860101790 2024-05-06T13:59:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe85e7fc700 1 --2- 172.21.15.123:0/3742077528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe860101790 0x7fe86019cac0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe85400b480 tx=0x7fe85400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.210+0000 7fe847fff700 1 -- 172.21.15.123:0/3742077528 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe854011800 con 0x7fe860101790 2024-05-06T13:59:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.211+0000 7fe847fff700 1 -- 172.21.15.123:0/3742077528 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe854011e10 con 0x7fe860101790 2024-05-06T13:59:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.211+0000 7fe865639700 1 -- 172.21.15.123:0/3742077528 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8601968e0 con 0x7fe860101790 2024-05-06T13:59:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.211+0000 7fe847fff700 1 -- 172.21.15.123:0/3742077528 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe854010ea0 con 0x7fe860101790 2024-05-06T13:59:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.211+0000 7fe865639700 1 -- 172.21.15.123:0/3742077528 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe860196e30 con 0x7fe860101790 2024-05-06T13:59:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.211+0000 7fe865639700 1 -- 172.21.15.123:0/3742077528 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe860109180 con 0x7fe860101790 2024-05-06T13:59:46.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.212+0000 7fe847fff700 1 -- 172.21.15.123:0/3742077528 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fe854010380 con 0x7fe860101790 2024-05-06T13:59:46.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.212+0000 7fe847fff700 1 --2- 172.21.15.123:0/3742077528 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe84806c4e0 0x7fe84806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:46.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.212+0000 7fe847fff700 1 -- 172.21.15.123:0/3742077528 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe85408b060 con 0x7fe860101790 2024-05-06T13:59:46.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.212+0000 7fe85effd700 1 --2- 172.21.15.123:0/3742077528 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe84806c4e0 0x7fe84806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:46.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.213+0000 7fe85effd700 1 --2- 172.21.15.123:0/3742077528 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe84806c4e0 0x7fe84806e9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe850006010 tx=0x7fe85001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:46.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.217+0000 7fe847fff700 1 -- 172.21.15.123:0/3742077528 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe854059610 con 0x7fe860101790 2024-05-06T13:59:46.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:46 smithi123 ceph-mon[27254]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.406+0000 7fe865639700 1 -- 172.21.15.123:0/3742077528 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe86004ea90 con 0x7fe860101790 2024-05-06T13:59:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.407+0000 7fe847fff700 1 -- 172.21.15.123:0/3742077528 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11382 (secure 0 0 0) 0x7fe8540591a0 con 0x7fe860101790 2024-05-06T13:59:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:59:46.408 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":40,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","created":"2024-05-06T13:53:53.764041+0000","modified":"2024-05-06T13:59:41.105757+0000","last_up_change":"2024-05-06T13:59:40.100058+0000","last_in_change":"2024-05-06T13:59:20.268409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T13:58:23.113471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4803adcc-ea08-4773-99f0-65485b08489f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":990362393},{"type":"v1","addr":"172.21.15.123:6803","nonce":990362393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":990362393},{"type":"v1","addr":"172.21.15.123:6805","nonce":990362393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":990362393},{"type":"v1","addr":"172.21.15.123:6809","nonce":990362393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":990362393},{"type":"v1","addr":"172.21.15.123:6807","nonce":990362393}]},"public_addr":"172.21.15.123:6803/990362393","cluster_addr":"172.21.15.123:6805/990362393","heartbeat_back_addr":"172.21.15.123:6809/990362393","heartbeat_front_addr":"172.21.15.123:6807/990362393","state":["exists","up"]},{"osd":1,"uuid":"a34740b3-d6c1-4d4e-8a4d-efe3b3dc26ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2243856034},{"type":"v1","addr":"172.21.15.123:6811","nonce":2243856034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2243856034},{"type":"v1","addr":"172.21.15.123:6813","nonce":2243856034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2243856034},{"type":"v1","addr":"172.21.15.123:6817","nonce":2243856034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2243856034},{"type":"v1","addr":"172.21.15.123:6815","nonce":2243856034}]},"public_addr":"172.21.15.123:6811/2243856034","cluster_addr":"172.21.15.123:6813/2243856034","heartbeat_back_addr":"172.21.15.123:6817/2243856034","heartbeat_front_addr":"172.21.15.123:6815/2243856034","state":["exists","up"]},{"osd":2,"uuid":"075dfad3-ac71-4c06-b9eb-0f3813c7e309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3515428076},{"type":"v1","addr":"172.21.15.123:6819","nonce":3515428076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3515428076},{"type":"v1","addr":"172.21.15.123:6821","nonce":3515428076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3515428076},{"type":"v1","addr":"172.21.15.123:6825","nonce":3515428076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3515428076},{"type":"v1","addr":"172.21.15.123:6823","nonce":3515428076}]},"public_addr":"172.21.15.123:6819/3515428076","cluster_addr":"172.21.15.123:6821/3515428076","heartbeat_back_addr":"172.21.15.123:6825/3515428076","heartbeat_front_addr":"172.21.15.123:6823/3515428076","state":["exists","up"]},{"osd":3,"uuid":"1ee0a686-0cf2-48df-838f-9d10a55c6a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3542331218},{"type":"v1","addr":"172.21.15.174:6801","nonce":3542331218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3542331218},{"type":"v1","addr":"172.21.15.174:6803","nonce":3542331218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3542331218},{"type":"v1","addr":"172.21.15.174:6807","nonce":3542331218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3542331218},{"type":"v1","addr":"172.21.15.174:6805","nonce":3542331218}]},"public_addr":"172.21.15.174:6801/3542331218","cluster_addr":"172.21.15.174:6803/3542331218","heartbeat_back_addr":"172.21.15.174:6807/3542331218","heartbeat_front_addr":"172.21.15.174:6805/3542331218","state":["exists","up"]},{"osd":4,"uuid":"5145c459-5691-41de-a537-aaf278530b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3350136942},{"type":"v1","addr":"172.21.15.174:6809","nonce":3350136942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3350136942},{"type":"v1","addr":"172.21.15.174:6811","nonce":3350136942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3350136942},{"type":"v1","addr":"172.21.15.174:6815","nonce":3350136942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3350136942},{"type":"v1","addr":"172.21.15.174:6813","nonce":3350136942}]},"public_addr":"172.21.15.174:6809/3350136942","cluster_addr":"172.21.15.174:6811/3350136942","heartbeat_back_addr":"172.21.15.174:6815/3350136942","heartbeat_front_addr":"172.21.15.174:6813/3350136942","state":["exists","up"]},{"osd":5,"uuid":"7c59c801-2ae9-4660-8feb-d2474527cc09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2336253711},{"type":"v1","addr":"172.21.15.174:6817","nonce":2336253711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2336253711},{"type":"v1","addr":"172.21.15.174:6819","nonce":2336253711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2336253711},{"type":"v1","addr":"172.21.15.174:6823","nonce":2336253711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2336253711},{"type":"v1","addr":"172.21.15.174:6821","nonce":2336253711}]},"public_addr":"172.21.15.174:6817/2336253711","cluster_addr":"172.21.15.174:6819/2336253711","heartbeat_back_addr":"172.21.15.174:6823/2336253711","heartbeat_front_addr":"172.21.15.174:6821/2336253711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:57:26.135182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:57:53.556186+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:58:20.967654+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:58:45.035949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:59:11.636777+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:59:38.098428+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/2647159870":"2024-05-07T13:56:04.790493+0000","172.21.15.123:6800/388885730":"2024-05-07T13:56:04.790493+0000","172.21.15.123:0/306885224":"2024-05-07T13:54:54.367854+0000","172.21.15.123:6801/2710951021":"2024-05-07T13:54:54.367854+0000","172.21.15.123:0/634683219":"2024-05-07T13:54:54.367854+0000","172.21.15.123:6801/35564330":"2024-05-07T13:54:21.525408+0000","172.21.15.123:0/4277354301":"2024-05-07T13:54:21.525408+0000","172.21.15.123:0/1999705925":"2024-05-07T13:56:04.790493+0000","172.21.15.123:6800/35564330":"2024-05-07T13:54:21.525408+0000","172.21.15.123:0/1489655906":"2024-05-07T13:54:21.525408+0000","172.21.15.123:6801/388885730":"2024-05-07T13:56:04.790493+0000","172.21.15.123:0/1506782592":"2024-05-07T13:56:04.790493+0000","172.21.15.123:6800/2710951021":"2024-05-07T13:54:54.367854+0000","172.21.15.123:0/3708790365":"2024-05-07T13:54:21.525408+0000","172.21.15.123:0/1961046585":"2024-05-07T13:54:54.367854+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T13:59:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.409+0000 7fe865639700 1 -- 172.21.15.123:0/3742077528 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe84806c4e0 msgr2=0x7fe84806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.409+0000 7fe865639700 1 --2- 172.21.15.123:0/3742077528 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe84806c4e0 0x7fe84806e9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe850006010 tx=0x7fe85001a040 comp rx=0 tx=0).stop 2024-05-06T13:59:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.409+0000 7fe865639700 1 -- 172.21.15.123:0/3742077528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe860101790 msgr2=0x7fe86019cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.409+0000 7fe865639700 1 --2- 172.21.15.123:0/3742077528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe860101790 0x7fe86019cac0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe85400b480 tx=0x7fe85400b790 comp rx=0 tx=0).stop 2024-05-06T13:59:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.409+0000 7fe865639700 1 -- 172.21.15.123:0/3742077528 shutdown_connections 2024-05-06T13:59:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.409+0000 7fe865639700 1 --2- 172.21.15.123:0/3742077528 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe84806c4e0 0x7fe84806e9a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.409+0000 7fe865639700 1 --2- 172.21.15.123:0/3742077528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe860100de0 0x7fe86019c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.409+0000 7fe865639700 1 --2- 172.21.15.123:0/3742077528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe860101790 0x7fe86019cac0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.409+0000 7fe865639700 1 -- 172.21.15.123:0/3742077528 >> 172.21.15.123:0/3742077528 conn(0x7fe8600fc670 msgr2=0x7fe8600fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.409+0000 7fe865639700 1 -- 172.21.15.123:0/3742077528 shutdown_connections 2024-05-06T13:59:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:46.409+0000 7fe865639700 1 -- 172.21.15.123:0/3742077528 wait complete. 2024-05-06T13:59:46.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:46 smithi174 ceph-mon[35160]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:47.059 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-06T13:58:23.113471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-06T13:59:47.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-06T13:59:47.262 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:59:47.383 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:47 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3742077528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T13:59:47.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:47 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/3742077528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T13:59:48.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:48 smithi123 ceph-mon[27254]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:48.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:48 smithi174 ceph-mon[35160]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:48.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.825+0000 7fc7c11ea700 1 -- 172.21.15.123:0/3428096244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7bc100dd0 msgr2=0x7fc7bc1011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:48.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.825+0000 7fc7c11ea700 1 --2- 172.21.15.123:0/3428096244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7bc100dd0 0x7fc7bc1011b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009910 tx=0x7fc7ac009c20 comp rx=0 tx=0).stop 2024-05-06T13:59:48.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.825+0000 7fc7c11ea700 1 -- 172.21.15.123:0/3428096244 shutdown_connections 2024-05-06T13:59:48.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.825+0000 7fc7c11ea700 1 --2- 172.21.15.123:0/3428096244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7bc101780 0x7fc7bc1057d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:48.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.825+0000 7fc7c11ea700 1 --2- 172.21.15.123:0/3428096244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7bc100dd0 0x7fc7bc1011b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:48.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.825+0000 7fc7c11ea700 1 -- 172.21.15.123:0/3428096244 >> 172.21.15.123:0/3428096244 conn(0x7fc7bc0fc640 msgr2=0x7fc7bc0fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:48.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.825+0000 7fc7c11ea700 1 -- 172.21.15.123:0/3428096244 shutdown_connections 2024-05-06T13:59:48.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.825+0000 7fc7c11ea700 1 -- 172.21.15.123:0/3428096244 wait complete. 2024-05-06T13:59:48.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.826+0000 7fc7c11ea700 1 Processor -- start 2024-05-06T13:59:48.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.826+0000 7fc7c11ea700 1 -- start start 2024-05-06T13:59:48.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.826+0000 7fc7c11ea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7bc100dd0 0x7fc7bc073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.826+0000 7fc7c11ea700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7bc101780 0x7fc7bc0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.826+0000 7fc7c11ea700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc073b10 con 0x7fc7bc100dd0 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.826+0000 7fc7c11ea700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc073c50 con 0x7fc7bc101780 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7bad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7bc100dd0 0x7fc7bc073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7bad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7bc100dd0 0x7fc7bc073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60870/0 (socket says 172.21.15.123:60870) 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7bad9d700 1 -- 172.21.15.123:0/4119648159 learned_addr learned my addr 172.21.15.123:0/4119648159 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7ba59c700 1 --2- 172.21.15.123:0/4119648159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7bc101780 0x7fc7bc0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7bad9d700 1 -- 172.21.15.123:0/4119648159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7bc101780 msgr2=0x7fc7bc0735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7bad9d700 1 --2- 172.21.15.123:0/4119648159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7bc101780 0x7fc7bc0735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7bad9d700 1 -- 172.21.15.123:0/4119648159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac0095f0 con 0x7fc7bc100dd0 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7bad9d700 1 --2- 172.21.15.123:0/4119648159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7bc100dd0 0x7fc7bc073090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00b5c0 tx=0x7fc7ac00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7a3fff700 1 -- 172.21.15.123:0/4119648159 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7ac01d070 con 0x7fc7bc100dd0 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7a3fff700 1 -- 172.21.15.123:0/4119648159 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc7ac022470 con 0x7fc7bc100dd0 2024-05-06T13:59:48.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7c11ea700 1 -- 172.21.15.123:0/4119648159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc073ed0 con 0x7fc7bc100dd0 2024-05-06T13:59:48.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7a3fff700 1 -- 172.21.15.123:0/4119648159 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7ac00f670 con 0x7fc7bc100dd0 2024-05-06T13:59:48.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.827+0000 7fc7c11ea700 1 -- 172.21.15.123:0/4119648159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc1a2c40 con 0x7fc7bc100dd0 2024-05-06T13:59:48.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.828+0000 7fc7c11ea700 1 -- 172.21.15.123:0/4119648159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7bc109170 con 0x7fc7bc100dd0 2024-05-06T13:59:48.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.829+0000 7fc7a3fff700 1 -- 172.21.15.123:0/4119648159 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fc7ac00f8e0 con 0x7fc7bc100dd0 2024-05-06T13:59:48.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.829+0000 7fc7a3fff700 1 --2- 172.21.15.123:0/4119648159 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc7a406c4e0 0x7fc7a406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:48.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.829+0000 7fc7ba59c700 1 --2- 172.21.15.123:0/4119648159 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc7a406c4e0 0x7fc7a406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:48.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.829+0000 7fc7a3fff700 1 -- 172.21.15.123:0/4119648159 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc7ac08cb10 con 0x7fc7bc100dd0 2024-05-06T13:59:48.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.829+0000 7fc7ba59c700 1 --2- 172.21.15.123:0/4119648159 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc7a406c4e0 0x7fc7a406e9a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0005fd0 tx=0x7fc7b000a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:48.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:48.834+0000 7fc7a3fff700 1 -- 172.21.15.123:0/4119648159 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc7ac057870 con 0x7fc7bc100dd0 2024-05-06T13:59:49.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.020+0000 7fc7c11ea700 1 -- 172.21.15.123:0/4119648159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7bc108b50 con 0x7fc7bc100dd0 2024-05-06T13:59:49.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.020+0000 7fc7a3fff700 1 -- 172.21.15.123:0/4119648159 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7ac027020 con 0x7fc7bc100dd0 2024-05-06T13:59:49.021 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-05-06T13:59:49.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.022+0000 7fc7c11ea700 1 -- 172.21.15.123:0/4119648159 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc7a406c4e0 msgr2=0x7fc7a406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:49.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.022+0000 7fc7c11ea700 1 --2- 172.21.15.123:0/4119648159 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc7a406c4e0 0x7fc7a406e9a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0005fd0 tx=0x7fc7b000a560 comp rx=0 tx=0).stop 2024-05-06T13:59:49.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.022+0000 7fc7c11ea700 1 -- 172.21.15.123:0/4119648159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7bc100dd0 msgr2=0x7fc7bc073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:49.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.022+0000 7fc7c11ea700 1 --2- 172.21.15.123:0/4119648159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7bc100dd0 0x7fc7bc073090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00b5c0 tx=0x7fc7ac00be00 comp rx=0 tx=0).stop 2024-05-06T13:59:49.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.022+0000 7fc7c11ea700 1 -- 172.21.15.123:0/4119648159 shutdown_connections 2024-05-06T13:59:49.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.022+0000 7fc7c11ea700 1 --2- 172.21.15.123:0/4119648159 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc7a406c4e0 0x7fc7a406e9a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:49.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.022+0000 7fc7c11ea700 1 --2- 172.21.15.123:0/4119648159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7bc100dd0 0x7fc7bc073090 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:49.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.022+0000 7fc7c11ea700 1 --2- 172.21.15.123:0/4119648159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7bc101780 0x7fc7bc0735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:49.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.022+0000 7fc7c11ea700 1 -- 172.21.15.123:0/4119648159 >> 172.21.15.123:0/4119648159 conn(0x7fc7bc0fc640 msgr2=0x7fc7bc0fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:49.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.023+0000 7fc7c11ea700 1 -- 172.21.15.123:0/4119648159 shutdown_connections 2024-05-06T13:59:49.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:49.023+0000 7fc7c11ea700 1 -- 172.21.15.123:0/4119648159 wait complete. 2024-05-06T13:59:49.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:49 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/4119648159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T13:59:49.477 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:49 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/4119648159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T13:59:49.717 INFO:tasks.cephadm:Setting up client nodes... 2024-05-06T13:59:49.718 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-06T13:59:49.922 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:59:50.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:50 smithi123 ceph-mon[27254]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:50.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:50 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:59:50.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:50 smithi174 ceph-mon[35160]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:50.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:50 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:59:51.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.501+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1167785369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc101120 msgr2=0x7ffabc101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:51.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.501+0000 7ffac1ab4700 1 --2- 172.21.15.123:0/1167785369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc101120 0x7ffabc101540 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009910 tx=0x7ffaac009c20 comp rx=0 tx=0).stop 2024-05-06T13:59:51.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.501+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1167785369 shutdown_connections 2024-05-06T13:59:51.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.501+0000 7ffac1ab4700 1 --2- 172.21.15.123:0/1167785369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffabc0ffd80 0x7ffabc100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.501+0000 7ffac1ab4700 1 --2- 172.21.15.123:0/1167785369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc101120 0x7ffabc101540 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.501+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1167785369 >> 172.21.15.123:0/1167785369 conn(0x7ffabc0fa810 msgr2=0x7ffabc0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.502+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1167785369 shutdown_connections 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.502+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1167785369 wait complete. 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.502+0000 7ffac1ab4700 1 Processor -- start 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.502+0000 7ffac1ab4700 1 -- start start 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.502+0000 7ffac1ab4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc0ffd80 0x7ffabc0ff7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.502+0000 7ffac1ab4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffabc101120 0x7ffabc19b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.502+0000 7ffac1ab4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc19b810 con 0x7ffabc0ffd80 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.502+0000 7ffac1ab4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc19b950 con 0x7ffabc101120 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffabb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc0ffd80 0x7ffabc0ff7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffabb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc0ffd80 0x7ffabc0ff7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60892/0 (socket says 172.21.15.123:60892) 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffabb7fe700 1 -- 172.21.15.123:0/1425523131 learned_addr learned my addr 172.21.15.123:0/1425523131 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:59:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffabaffd700 1 --2- 172.21.15.123:0/1425523131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffabc101120 0x7ffabc19b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffabb7fe700 1 -- 172.21.15.123:0/1425523131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffabc101120 msgr2=0x7ffabc19b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffabb7fe700 1 --2- 172.21.15.123:0/1425523131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffabc101120 0x7ffabc19b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffabb7fe700 1 -- 172.21.15.123:0/1425523131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac0095f0 con 0x7ffabc0ffd80 2024-05-06T13:59:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffabb7fe700 1 --2- 172.21.15.123:0/1425523131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc0ffd80 0x7ffabc0ff7d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0092e0 tx=0x7ffaac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffab8ff9700 1 -- 172.21.15.123:0/1425523131 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaac01d070 con 0x7ffabc0ffd80 2024-05-06T13:59:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1425523131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc19bbd0 con 0x7ffabc0ffd80 2024-05-06T13:59:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffab8ff9700 1 -- 172.21.15.123:0/1425523131 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffaac022470 con 0x7ffabc0ffd80 2024-05-06T13:59:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffab8ff9700 1 -- 172.21.15.123:0/1425523131 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaac00f690 con 0x7ffabc0ffd80 2024-05-06T13:59:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.503+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1425523131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc19c140 con 0x7ffabc0ffd80 2024-05-06T13:59:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.504+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1425523131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc108700 con 0x7ffabc0ffd80 2024-05-06T13:59:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.505+0000 7ffab8ff9700 1 -- 172.21.15.123:0/1425523131 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7ffaac0225e0 con 0x7ffabc0ffd80 2024-05-06T13:59:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.505+0000 7ffab8ff9700 1 --2- 172.21.15.123:0/1425523131 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ffaa406c4e0 0x7ffaa406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.505+0000 7ffab8ff9700 1 -- 172.21.15.123:0/1425523131 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ffaac08c9f0 con 0x7ffabc0ffd80 2024-05-06T13:59:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.505+0000 7ffabaffd700 1 --2- 172.21.15.123:0/1425523131 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ffaa406c4e0 0x7ffaa406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.505+0000 7ffabaffd700 1 --2- 172.21.15.123:0/1425523131 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ffaa406c4e0 0x7ffaa406e9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffab0006fd0 tx=0x7ffab0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:51.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.509+0000 7ffab8ff9700 1 -- 172.21.15.123:0/1425523131 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ffaac08ee60 con 0x7ffabc0ffd80 2024-05-06T13:59:51.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.779+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1425523131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ffabc19c7a0 con 0x7ffabc0ffd80 2024-05-06T13:59:51.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.783+0000 7ffab8ff9700 1 -- 172.21.15.123:0/1425523131 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7ffaac08ee60 con 0x7ffabc0ffd80 2024-05-06T13:59:51.784 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-05-06T13:59:51.784 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBX4jhm9DyGLhAA3bA5apn9WUJ0hxKGVDw5Xg== 2024-05-06T13:59:51.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.785+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1425523131 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ffaa406c4e0 msgr2=0x7ffaa406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:51.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.785+0000 7ffac1ab4700 1 --2- 172.21.15.123:0/1425523131 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ffaa406c4e0 0x7ffaa406e9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffab0006fd0 tx=0x7ffab0008040 comp rx=0 tx=0).stop 2024-05-06T13:59:51.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.785+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1425523131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc0ffd80 msgr2=0x7ffabc0ff7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:51.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.785+0000 7ffac1ab4700 1 --2- 172.21.15.123:0/1425523131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc0ffd80 0x7ffabc0ff7d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0092e0 tx=0x7ffaac00be20 comp rx=0 tx=0).stop 2024-05-06T13:59:51.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.785+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1425523131 shutdown_connections 2024-05-06T13:59:51.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.785+0000 7ffac1ab4700 1 --2- 172.21.15.123:0/1425523131 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ffaa406c4e0 0x7ffaa406e9a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:51.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.785+0000 7ffac1ab4700 1 --2- 172.21.15.123:0/1425523131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffabc0ffd80 0x7ffabc0ff7d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:51.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.785+0000 7ffac1ab4700 1 --2- 172.21.15.123:0/1425523131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffabc101120 0x7ffabc19b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:51.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.785+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1425523131 >> 172.21.15.123:0/1425523131 conn(0x7ffabc0fa810 msgr2=0x7ffabc103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:51.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.785+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1425523131 shutdown_connections 2024-05-06T13:59:51.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:51.785+0000 7ffac1ab4700 1 -- 172.21.15.123:0/1425523131 wait complete. 2024-05-06T13:59:52.396 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:52 smithi123 ceph-mon[27254]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:52.396 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:52 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1425523131' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:59:52.396 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:52 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1425523131' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T13:59:52.397 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T13:59:52.397 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-06T13:59:52.397 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-06T13:59:52.432 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-06T13:59:52.460 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:52 smithi174 ceph-mon[35160]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:52.461 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:52 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/1425523131' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:59:52.461 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:52 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/1425523131' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T13:59:52.648 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi174/config 2024-05-06T13:59:54.180 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.174+0000 7f9994062700 1 -- 172.21.15.174:0/212315291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f998c1021e0 msgr2=0x7f998c102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:54.180 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.174+0000 7f9994062700 1 --2- 172.21.15.174:0/212315291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f998c1021e0 0x7f998c102600 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9988009910 tx=0x7f9988009c20 comp rx=0 tx=0).stop 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.174+0000 7f9994062700 1 -- 172.21.15.174:0/212315291 shutdown_connections 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.174+0000 7f9994062700 1 --2- 172.21.15.174:0/212315291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998c0fec60 0x7f998c0ff0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.174+0000 7f9994062700 1 --2- 172.21.15.174:0/212315291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f998c1021e0 0x7f998c102600 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.174+0000 7f9994062700 1 -- 172.21.15.174:0/212315291 >> 172.21.15.174:0/212315291 conn(0x7f998c0fa800 msgr2=0x7f998c0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.174+0000 7f9994062700 1 -- 172.21.15.174:0/212315291 shutdown_connections 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.174+0000 7f9994062700 1 -- 172.21.15.174:0/212315291 wait complete. 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f9994062700 1 Processor -- start 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f9994062700 1 -- start start 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f9994062700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998c0fec60 0x7f998c196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f9994062700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f998c1021e0 0x7f998c1968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f9994062700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c196ed0 con 0x7f998c0fec60 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f9994062700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c197010 con 0x7f998c1021e0 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f99915fd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f998c1021e0 0x7f998c1968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:54.181 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f99915fd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f998c1021e0 0x7f998c1968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:58134/0 (socket says 172.21.15.174:58134) 2024-05-06T13:59:54.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f99915fd700 1 -- 172.21.15.174:0/86152862 learned_addr learned my addr 172.21.15.174:0/86152862 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-06T13:59:54.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f9991dfe700 1 --2- 172.21.15.174:0/86152862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998c0fec60 0x7f998c196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:54.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f99915fd700 1 -- 172.21.15.174:0/86152862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998c0fec60 msgr2=0x7f998c196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:54.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f99915fd700 1 --2- 172.21.15.174:0/86152862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998c0fec60 0x7f998c196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:54.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f99915fd700 1 -- 172.21.15.174:0/86152862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880095f0 con 0x7f998c1021e0 2024-05-06T13:59:54.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f99915fd700 1 --2- 172.21.15.174:0/86152862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f998c1021e0 0x7f998c1968b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f997c00d8d0 tx=0x7f997c00dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:54.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f9982ffd700 1 -- 172.21.15.174:0/86152862 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f997c0098a0 con 0x7f998c1021e0 2024-05-06T13:59:54.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f9982ffd700 1 -- 172.21.15.174:0/86152862 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f997c010460 con 0x7f998c1021e0 2024-05-06T13:59:54.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f9982ffd700 1 -- 172.21.15.174:0/86152862 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f997c00f5f0 con 0x7f998c1021e0 2024-05-06T13:59:54.183 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f9994062700 1 -- 172.21.15.174:0/86152862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c19bac0 con 0x7f998c1021e0 2024-05-06T13:59:54.183 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.175+0000 7f9994062700 1 -- 172.21.15.174:0/86152862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c19c010 con 0x7f998c1021e0 2024-05-06T13:59:54.183 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.176+0000 7f9994062700 1 -- 172.21.15.174:0/86152862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998c109710 con 0x7f998c1021e0 2024-05-06T13:59:54.183 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.177+0000 7f9982ffd700 1 -- 172.21.15.174:0/86152862 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f997c009a00 con 0x7f998c1021e0 2024-05-06T13:59:54.183 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.177+0000 7f9982ffd700 1 --2- 172.21.15.174:0/86152862 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f997806c4e0 0x7f997806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:54.183 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.177+0000 7f9982ffd700 1 -- 172.21.15.174:0/86152862 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f997c08b2f0 con 0x7f998c1021e0 2024-05-06T13:59:54.183 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.178+0000 7f9991dfe700 1 --2- 172.21.15.174:0/86152862 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f997806c4e0 0x7f997806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:54.184 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.178+0000 7f9991dfe700 1 --2- 172.21.15.174:0/86152862 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f997806c4e0 0x7f997806e9a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9988006010 tx=0x7f998800b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:54.184 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.182+0000 7f9982ffd700 1 -- 172.21.15.174:0/86152862 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f997c059920 con 0x7f998c1021e0 2024-05-06T13:59:54.184 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:54 smithi174 ceph-mon[35160]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:54.442 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.441+0000 7f9994062700 1 -- 172.21.15.174:0/86152862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f998c19c670 con 0x7f998c1021e0 2024-05-06T13:59:54.446 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.446+0000 7f9982ffd700 1 -- 172.21.15.174:0/86152862 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f997c0594b0 con 0x7f998c1021e0 2024-05-06T13:59:54.446 INFO:teuthology.orchestra.run.smithi174.stdout:[client.1] 2024-05-06T13:59:54.446 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBa4jhmdL9qGhAAT8rGnC7I2CN8EIeYC/Y9jg== 2024-05-06T13:59:54.448 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.448+0000 7f9994062700 1 -- 172.21.15.174:0/86152862 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f997806c4e0 msgr2=0x7f997806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:54.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.448+0000 7f9994062700 1 --2- 172.21.15.174:0/86152862 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f997806c4e0 0x7f997806e9a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9988006010 tx=0x7f998800b540 comp rx=0 tx=0).stop 2024-05-06T13:59:54.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.448+0000 7f9994062700 1 -- 172.21.15.174:0/86152862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f998c1021e0 msgr2=0x7f998c1968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:54.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.448+0000 7f9994062700 1 --2- 172.21.15.174:0/86152862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f998c1021e0 0x7f998c1968b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f997c00d8d0 tx=0x7f997c00dbe0 comp rx=0 tx=0).stop 2024-05-06T13:59:54.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.448+0000 7f9994062700 1 -- 172.21.15.174:0/86152862 shutdown_connections 2024-05-06T13:59:54.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.448+0000 7f9994062700 1 --2- 172.21.15.174:0/86152862 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f997806c4e0 0x7f997806e9a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:54.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.448+0000 7f9994062700 1 --2- 172.21.15.174:0/86152862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998c0fec60 0x7f998c196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:54.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.448+0000 7f9994062700 1 --2- 172.21.15.174:0/86152862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f998c1021e0 0x7f998c1968b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:54.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.448+0000 7f9994062700 1 -- 172.21.15.174:0/86152862 >> 172.21.15.174:0/86152862 conn(0x7f998c0fa800 msgr2=0x7f998c1051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:54.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.448+0000 7f9994062700 1 -- 172.21.15.174:0/86152862 shutdown_connections 2024-05-06T13:59:54.449 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T13:59:54.448+0000 7f9994062700 1 -- 172.21.15.174:0/86152862 wait complete. 2024-05-06T13:59:54.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:54 smithi123 ceph-mon[27254]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:55.031 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T13:59:55.031 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-05-06T13:59:55.031 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-06T13:59:55.108 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-06T13:59:55.108 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-06T13:59:55.109 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-06T13:59:55.338 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:59:55.460 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:55 smithi123 ceph-mon[27254]: from='client.? 172.21.15.174:0/86152862' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:59:55.461 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:55 smithi123 ceph-mon[27254]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:59:55.461 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:55 smithi123 ceph-mon[27254]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T13:59:55.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:55 smithi174 ceph-mon[35160]: from='client.? 172.21.15.174:0/86152862' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:59:55.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:55 smithi174 ceph-mon[35160]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:59:55.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:55 smithi174 ceph-mon[35160]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T13:59:56.478 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:56 smithi123 ceph-mon[27254]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:56.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:56 smithi174 ceph-mon[35160]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.975+0000 7f34dadd4700 1 -- 172.21.15.123:0/2090895626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d40ffa40 msgr2=0x7f34d40ffec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.975+0000 7f34dadd4700 1 --2- 172.21.15.123:0/2090895626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d40ffa40 0x7f34d40ffec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009910 tx=0x7f34c0009c20 comp rx=0 tx=0).stop 2024-05-06T13:59:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.975+0000 7f34dadd4700 1 -- 172.21.15.123:0/2090895626 shutdown_connections 2024-05-06T13:59:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.975+0000 7f34dadd4700 1 --2- 172.21.15.123:0/2090895626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d40ffa40 0x7f34d40ffec0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.975+0000 7f34dadd4700 1 --2- 172.21.15.123:0/2090895626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34d4105a40 0x7f34d4105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.975+0000 7f34dadd4700 1 -- 172.21.15.123:0/2090895626 >> 172.21.15.123:0/2090895626 conn(0x7f34d40fb550 msgr2=0x7f34d40fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.975+0000 7f34dadd4700 1 -- 172.21.15.123:0/2090895626 shutdown_connections 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.975+0000 7f34dadd4700 1 -- 172.21.15.123:0/2090895626 wait complete. 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34dadd4700 1 Processor -- start 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34dadd4700 1 -- start start 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34dadd4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34d40ffa40 0x7f34d4197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34dadd4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4105a40 0x7f34d4197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34dadd4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4198140 con 0x7f34d4105a40 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34dadd4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4198280 con 0x7f34d40ffa40 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34d3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4105a40 0x7f34d4197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34d3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4105a40 0x7f34d4197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60912/0 (socket says 172.21.15.123:60912) 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34d3fff700 1 -- 172.21.15.123:0/4065400710 learned_addr learned my addr 172.21.15.123:0/4065400710 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34d8b70700 1 --2- 172.21.15.123:0/4065400710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34d40ffa40 0x7f34d4197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34d3fff700 1 -- 172.21.15.123:0/4065400710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34d40ffa40 msgr2=0x7f34d4197630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:56.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34d3fff700 1 --2- 172.21.15.123:0/4065400710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34d40ffa40 0x7f34d4197630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:56.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34d3fff700 1 -- 172.21.15.123:0/4065400710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c00095f0 con 0x7f34d4105a40 2024-05-06T13:59:56.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.976+0000 7f34d8b70700 1 --2- 172.21.15.123:0/4065400710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34d40ffa40 0x7f34d4197630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T13:59:56.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.977+0000 7f34d3fff700 1 --2- 172.21.15.123:0/4065400710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4105a40 0x7f34d4197b70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f34c0006010 tx=0x7f34c000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:56.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.977+0000 7f34d1ffb700 1 -- 172.21.15.123:0/4065400710 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34c001d070 con 0x7f34d4105a40 2024-05-06T13:59:56.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.977+0000 7f34d1ffb700 1 -- 172.21.15.123:0/4065400710 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f34c000f460 con 0x7f34d4105a40 2024-05-06T13:59:56.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.977+0000 7f34dadd4700 1 -- 172.21.15.123:0/4065400710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d41a06a0 con 0x7f34d4105a40 2024-05-06T13:59:56.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.977+0000 7f34d1ffb700 1 -- 172.21.15.123:0/4065400710 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34c0017630 con 0x7f34d4105a40 2024-05-06T13:59:56.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.977+0000 7f34dadd4700 1 -- 172.21.15.123:0/4065400710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d41a0a50 con 0x7f34d4105a40 2024-05-06T13:59:56.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.978+0000 7f34dadd4700 1 -- 172.21.15.123:0/4065400710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d4108060 con 0x7f34d4105a40 2024-05-06T13:59:56.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.978+0000 7f34d1ffb700 1 -- 172.21.15.123:0/4065400710 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f34c000f5d0 con 0x7f34d4105a40 2024-05-06T13:59:56.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.979+0000 7f34d1ffb700 1 --2- 172.21.15.123:0/4065400710 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f34c406c4e0 0x7f34c406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:56.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.979+0000 7f34d1ffb700 1 -- 172.21.15.123:0/4065400710 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f34c008cb70 con 0x7f34d4105a40 2024-05-06T13:59:56.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.979+0000 7f34d8b70700 1 --2- 172.21.15.123:0/4065400710 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f34c406c4e0 0x7f34c406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:56.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.979+0000 7f34d8b70700 1 --2- 172.21.15.123:0/4065400710 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f34c406c4e0 0x7f34c406e9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f34c8007900 tx=0x7f34c8008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:56.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:56.983+0000 7f34d1ffb700 1 -- 172.21.15.123:0/4065400710 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f34c0057690 con 0x7f34d4105a40 2024-05-06T13:59:57.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.223+0000 7f34dadd4700 1 -- 172.21.15.123:0/4065400710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f34d404ea90 con 0x7f34d4105a40 2024-05-06T13:59:57.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.226+0000 7f34d1ffb700 1 -- 172.21.15.123:0/4065400710 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+173047 (secure 0 0 0) 0x7f34c005acb0 con 0x7f34d4105a40 2024-05-06T13:59:57.230 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:59:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.229+0000 7f34dadd4700 1 -- 172.21.15.123:0/4065400710 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f34c406c4e0 msgr2=0x7f34c406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.229+0000 7f34dadd4700 1 --2- 172.21.15.123:0/4065400710 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f34c406c4e0 0x7f34c406e9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f34c8007900 tx=0x7f34c8008040 comp rx=0 tx=0).stop 2024-05-06T13:59:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.229+0000 7f34dadd4700 1 -- 172.21.15.123:0/4065400710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4105a40 msgr2=0x7f34d4197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.229+0000 7f34dadd4700 1 --2- 172.21.15.123:0/4065400710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4105a40 0x7f34d4197b70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f34c0006010 tx=0x7f34c000be20 comp rx=0 tx=0).stop 2024-05-06T13:59:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.229+0000 7f34dadd4700 1 -- 172.21.15.123:0/4065400710 shutdown_connections 2024-05-06T13:59:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.229+0000 7f34dadd4700 1 --2- 172.21.15.123:0/4065400710 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f34c406c4e0 0x7f34c406e9a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.229+0000 7f34dadd4700 1 --2- 172.21.15.123:0/4065400710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34d40ffa40 0x7f34d4197630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.229+0000 7f34dadd4700 1 --2- 172.21.15.123:0/4065400710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34d4105a40 0x7f34d4197b70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.229+0000 7f34dadd4700 1 -- 172.21.15.123:0/4065400710 >> 172.21.15.123:0/4065400710 conn(0x7f34d40fb550 msgr2=0x7f34d40fbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.229+0000 7f34dadd4700 1 -- 172.21.15.123:0/4065400710 shutdown_connections 2024-05-06T13:59:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:57.229+0000 7f34dadd4700 1 -- 172.21.15.123:0/4065400710 wait complete. 2024-05-06T13:59:57.828 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":19,"active_gid":14217,"active_name":"smithi123.vjztrj","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3135616195},{"type":"v1","addr":"172.21.15.123:6801","nonce":3135616195}]},"active_addr":"172.21.15.123:6801/3135616195","active_change":"2024-05-06T13:56:04.790636+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14244,"name":"smithi174.ybuavj","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.123:8443/","prometheus":"http://172.21.15.123:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":3359771000}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":4206659990}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":611914495}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":1584783764}]}]} 2024-05-06T13:59:57.832 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-06T13:59:57.832 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-06T13:59:57.833 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-06T13:59:58.037 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T13:59:58.474 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:58 smithi123 ceph-mon[27254]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:58.474 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 13:59:58 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/4065400710' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-06T13:59:58.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:58 smithi174 ceph-mon[35160]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T13:59:58.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 13:59:58 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/4065400710' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-06T13:59:59.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.695+0000 7f61fe3f3700 1 -- 172.21.15.123:0/2660050675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61f8102620 msgr2=0x7f61f810ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:59.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.695+0000 7f61fe3f3700 1 --2- 172.21.15.123:0/2660050675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61f8102620 0x7f61f810ab10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009910 tx=0x7f61e8009c20 comp rx=0 tx=0).stop 2024-05-06T13:59:59.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.695+0000 7f61fe3f3700 1 -- 172.21.15.123:0/2660050675 shutdown_connections 2024-05-06T13:59:59.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.695+0000 7f61fe3f3700 1 --2- 172.21.15.123:0/2660050675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61f8102620 0x7f61f810ab10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:59.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.695+0000 7f61fe3f3700 1 --2- 172.21.15.123:0/2660050675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61f8101c70 0x7f61f8102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:59.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.695+0000 7f61fe3f3700 1 -- 172.21.15.123:0/2660050675 >> 172.21.15.123:0/2660050675 conn(0x7f61f80fb530 msgr2=0x7f61f80fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:59.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.695+0000 7f61fe3f3700 1 -- 172.21.15.123:0/2660050675 shutdown_connections 2024-05-06T13:59:59.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.695+0000 7f61fe3f3700 1 -- 172.21.15.123:0/2660050675 wait complete. 2024-05-06T13:59:59.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.696+0000 7f61fe3f3700 1 Processor -- start 2024-05-06T13:59:59.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.696+0000 7f61fe3f3700 1 -- start start 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.696+0000 7f61fe3f3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61f8101c70 0x7f61f819e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.696+0000 7f61fe3f3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61f8102620 0x7f61f819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.696+0000 7f61fe3f3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f819f3a0 con 0x7f61f8102620 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.696+0000 7f61fe3f3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8198850 con 0x7f61f8101c70 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.696+0000 7f61f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61f8102620 0x7f61f819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.696+0000 7f61f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61f8102620 0x7f61f819ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39414/0 (socket says 172.21.15.123:39414) 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.696+0000 7f61f77fe700 1 -- 172.21.15.123:0/57621441 learned_addr learned my addr 172.21.15.123:0/57621441 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.696+0000 7f61f7fff700 1 --2- 172.21.15.123:0/57621441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61f8101c70 0x7f61f819e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.697+0000 7f61f77fe700 1 -- 172.21.15.123:0/57621441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61f8101c70 msgr2=0x7f61f819e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.697+0000 7f61f77fe700 1 --2- 172.21.15.123:0/57621441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61f8101c70 0x7f61f819e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.697+0000 7f61f77fe700 1 -- 172.21.15.123:0/57621441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80095f0 con 0x7f61f8102620 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.697+0000 7f61f77fe700 1 --2- 172.21.15.123:0/57621441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61f8102620 0x7f61f819ed10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f61e80092e0 tx=0x7f61e800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.697+0000 7f61f57fa700 1 -- 172.21.15.123:0/57621441 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61e801d070 con 0x7f61f8102620 2024-05-06T13:59:59.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.697+0000 7f61fe3f3700 1 -- 172.21.15.123:0/57621441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f8198ad0 con 0x7f61f8102620 2024-05-06T13:59:59.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.697+0000 7f61f57fa700 1 -- 172.21.15.123:0/57621441 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f61e8005dc0 con 0x7f61f8102620 2024-05-06T13:59:59.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.697+0000 7f61f57fa700 1 -- 172.21.15.123:0/57621441 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61e8017400 con 0x7f61f8102620 2024-05-06T13:59:59.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.697+0000 7f61fe3f3700 1 -- 172.21.15.123:0/57621441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f8198fc0 con 0x7f61f8102620 2024-05-06T13:59:59.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.698+0000 7f61fe3f3700 1 -- 172.21.15.123:0/57621441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f810a670 con 0x7f61f8102620 2024-05-06T13:59:59.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.698+0000 7f61f57fa700 1 -- 172.21.15.123:0/57621441 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f61e800f460 con 0x7f61f8102620 2024-05-06T13:59:59.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.699+0000 7f61f57fa700 1 --2- 172.21.15.123:0/57621441 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f61e006c4e0 0x7f61e006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T13:59:59.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.699+0000 7f61f57fa700 1 -- 172.21.15.123:0/57621441 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f61e808c950 con 0x7f61f8102620 2024-05-06T13:59:59.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.699+0000 7f61f7fff700 1 --2- 172.21.15.123:0/57621441 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f61e006c4e0 0x7f61e006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T13:59:59.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.699+0000 7f61f7fff700 1 --2- 172.21.15.123:0/57621441 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f61e006c4e0 0x7f61e006e9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f61ec005950 tx=0x7f61ec00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T13:59:59.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.703+0000 7f61f57fa700 1 -- 172.21.15.123:0/57621441 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f61e805af00 con 0x7f61f8102620 2024-05-06T13:59:59.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.897+0000 7f61fe3f3700 1 -- 172.21.15.123:0/57621441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61f802cc70 con 0x7f61f8102620 2024-05-06T13:59:59.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.898+0000 7f61f57fa700 1 -- 172.21.15.123:0/57621441 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11382 (secure 0 0 0) 0x7f61e805aa90 con 0x7f61f8102620 2024-05-06T13:59:59.900 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T13:59:59.900 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":40,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","created":"2024-05-06T13:53:53.764041+0000","modified":"2024-05-06T13:59:41.105757+0000","last_up_change":"2024-05-06T13:59:40.100058+0000","last_in_change":"2024-05-06T13:59:20.268409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T13:58:23.113471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4803adcc-ea08-4773-99f0-65485b08489f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":990362393},{"type":"v1","addr":"172.21.15.123:6803","nonce":990362393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":990362393},{"type":"v1","addr":"172.21.15.123:6805","nonce":990362393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":990362393},{"type":"v1","addr":"172.21.15.123:6809","nonce":990362393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":990362393},{"type":"v1","addr":"172.21.15.123:6807","nonce":990362393}]},"public_addr":"172.21.15.123:6803/990362393","cluster_addr":"172.21.15.123:6805/990362393","heartbeat_back_addr":"172.21.15.123:6809/990362393","heartbeat_front_addr":"172.21.15.123:6807/990362393","state":["exists","up"]},{"osd":1,"uuid":"a34740b3-d6c1-4d4e-8a4d-efe3b3dc26ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2243856034},{"type":"v1","addr":"172.21.15.123:6811","nonce":2243856034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2243856034},{"type":"v1","addr":"172.21.15.123:6813","nonce":2243856034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2243856034},{"type":"v1","addr":"172.21.15.123:6817","nonce":2243856034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2243856034},{"type":"v1","addr":"172.21.15.123:6815","nonce":2243856034}]},"public_addr":"172.21.15.123:6811/2243856034","cluster_addr":"172.21.15.123:6813/2243856034","heartbeat_back_addr":"172.21.15.123:6817/2243856034","heartbeat_front_addr":"172.21.15.123:6815/2243856034","state":["exists","up"]},{"osd":2,"uuid":"075dfad3-ac71-4c06-b9eb-0f3813c7e309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3515428076},{"type":"v1","addr":"172.21.15.123:6819","nonce":3515428076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3515428076},{"type":"v1","addr":"172.21.15.123:6821","nonce":3515428076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3515428076},{"type":"v1","addr":"172.21.15.123:6825","nonce":3515428076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3515428076},{"type":"v1","addr":"172.21.15.123:6823","nonce":3515428076}]},"public_addr":"172.21.15.123:6819/3515428076","cluster_addr":"172.21.15.123:6821/3515428076","heartbeat_back_addr":"172.21.15.123:6825/3515428076","heartbeat_front_addr":"172.21.15.123:6823/3515428076","state":["exists","up"]},{"osd":3,"uuid":"1ee0a686-0cf2-48df-838f-9d10a55c6a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3542331218},{"type":"v1","addr":"172.21.15.174:6801","nonce":3542331218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3542331218},{"type":"v1","addr":"172.21.15.174:6803","nonce":3542331218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3542331218},{"type":"v1","addr":"172.21.15.174:6807","nonce":3542331218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3542331218},{"type":"v1","addr":"172.21.15.174:6805","nonce":3542331218}]},"public_addr":"172.21.15.174:6801/3542331218","cluster_addr":"172.21.15.174:6803/3542331218","heartbeat_back_addr":"172.21.15.174:6807/3542331218","heartbeat_front_addr":"172.21.15.174:6805/3542331218","state":["exists","up"]},{"osd":4,"uuid":"5145c459-5691-41de-a537-aaf278530b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3350136942},{"type":"v1","addr":"172.21.15.174:6809","nonce":3350136942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3350136942},{"type":"v1","addr":"172.21.15.174:6811","nonce":3350136942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3350136942},{"type":"v1","addr":"172.21.15.174:6815","nonce":3350136942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3350136942},{"type":"v1","addr":"172.21.15.174:6813","nonce":3350136942}]},"public_addr":"172.21.15.174:6809/3350136942","cluster_addr":"172.21.15.174:6811/3350136942","heartbeat_back_addr":"172.21.15.174:6815/3350136942","heartbeat_front_addr":"172.21.15.174:6813/3350136942","state":["exists","up"]},{"osd":5,"uuid":"7c59c801-2ae9-4660-8feb-d2474527cc09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2336253711},{"type":"v1","addr":"172.21.15.174:6817","nonce":2336253711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2336253711},{"type":"v1","addr":"172.21.15.174:6819","nonce":2336253711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2336253711},{"type":"v1","addr":"172.21.15.174:6823","nonce":2336253711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2336253711},{"type":"v1","addr":"172.21.15.174:6821","nonce":2336253711}]},"public_addr":"172.21.15.174:6817/2336253711","cluster_addr":"172.21.15.174:6819/2336253711","heartbeat_back_addr":"172.21.15.174:6823/2336253711","heartbeat_front_addr":"172.21.15.174:6821/2336253711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:57:26.135182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:57:53.556186+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:58:20.967654+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:58:45.035949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:59:11.636777+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:59:38.098428+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/2647159870":"2024-05-07T13:56:04.790493+0000","172.21.15.123:6800/388885730":"2024-05-07T13:56:04.790493+0000","172.21.15.123:0/306885224":"2024-05-07T13:54:54.367854+0000","172.21.15.123:6801/2710951021":"2024-05-07T13:54:54.367854+0000","172.21.15.123:0/634683219":"2024-05-07T13:54:54.367854+0000","172.21.15.123:6801/35564330":"2024-05-07T13:54:21.525408+0000","172.21.15.123:0/4277354301":"2024-05-07T13:54:21.525408+0000","172.21.15.123:0/1999705925":"2024-05-07T13:56:04.790493+0000","172.21.15.123:6800/35564330":"2024-05-07T13:54:21.525408+0000","172.21.15.123:0/1489655906":"2024-05-07T13:54:21.525408+0000","172.21.15.123:6801/388885730":"2024-05-07T13:56:04.790493+0000","172.21.15.123:0/1506782592":"2024-05-07T13:56:04.790493+0000","172.21.15.123:6800/2710951021":"2024-05-07T13:54:54.367854+0000","172.21.15.123:0/3708790365":"2024-05-07T13:54:21.525408+0000","172.21.15.123:0/1961046585":"2024-05-07T13:54:54.367854+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T13:59:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.900+0000 7f61fe3f3700 1 -- 172.21.15.123:0/57621441 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f61e006c4e0 msgr2=0x7f61e006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.900+0000 7f61fe3f3700 1 --2- 172.21.15.123:0/57621441 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f61e006c4e0 0x7f61e006e9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f61ec005950 tx=0x7f61ec00b410 comp rx=0 tx=0).stop 2024-05-06T13:59:59.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.900+0000 7f61fe3f3700 1 -- 172.21.15.123:0/57621441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61f8102620 msgr2=0x7f61f819ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T13:59:59.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.900+0000 7f61fe3f3700 1 --2- 172.21.15.123:0/57621441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61f8102620 0x7f61f819ed10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f61e80092e0 tx=0x7f61e800bd70 comp rx=0 tx=0).stop 2024-05-06T13:59:59.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.900+0000 7f61fe3f3700 1 -- 172.21.15.123:0/57621441 shutdown_connections 2024-05-06T13:59:59.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.900+0000 7f61fe3f3700 1 --2- 172.21.15.123:0/57621441 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f61e006c4e0 0x7f61e006e9a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:59.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.900+0000 7f61fe3f3700 1 --2- 172.21.15.123:0/57621441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61f8101c70 0x7f61f819e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:59.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.900+0000 7f61fe3f3700 1 --2- 172.21.15.123:0/57621441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61f8102620 0x7f61f819ed10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T13:59:59.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.900+0000 7f61fe3f3700 1 -- 172.21.15.123:0/57621441 >> 172.21.15.123:0/57621441 conn(0x7f61f80fb530 msgr2=0x7f61f8100100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T13:59:59.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.900+0000 7f61fe3f3700 1 -- 172.21.15.123:0/57621441 shutdown_connections 2024-05-06T13:59:59.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T13:59:59.900+0000 7f61fe3f3700 1 -- 172.21.15.123:0/57621441 wait complete. 2024-05-06T14:00:00.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:00 smithi174 ceph-mon[35160]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:00.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:00 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/57621441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T14:00:00.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:00 smithi174 ceph-mon[35160]: overall HEALTH_OK 2024-05-06T14:00:00.577 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:00 smithi123 ceph-mon[27254]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:00.577 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:00 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/57621441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T14:00:00.577 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:00 smithi123 ceph-mon[27254]: overall HEALTH_OK 2024-05-06T14:00:00.600 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-06T14:00:00.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-06T14:00:00.804 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:02.215 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:02 smithi123 ceph-mon[27254]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:02.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:02 smithi174 ceph-mon[35160]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:02.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.570+0000 7f1fc9cec700 1 -- 172.21.15.123:0/3566507590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fc4101770 msgr2=0x7f1fc41057c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:02.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.570+0000 7f1fc9cec700 1 --2- 172.21.15.123:0/3566507590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fc4101770 0x7f1fc41057c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009910 tx=0x7f1fb8009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:02.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.570+0000 7f1fc9cec700 1 -- 172.21.15.123:0/3566507590 shutdown_connections 2024-05-06T14:00:02.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.570+0000 7f1fc9cec700 1 --2- 172.21.15.123:0/3566507590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fc4101770 0x7f1fc41057c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:02.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.570+0000 7f1fc9cec700 1 --2- 172.21.15.123:0/3566507590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc4100dc0 0x7f1fc41011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:02.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.570+0000 7f1fc9cec700 1 -- 172.21.15.123:0/3566507590 >> 172.21.15.123:0/3566507590 conn(0x7f1fc40fc650 msgr2=0x7f1fc40fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:02.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.570+0000 7f1fc9cec700 1 -- 172.21.15.123:0/3566507590 shutdown_connections 2024-05-06T14:00:02.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.571+0000 7f1fc9cec700 1 -- 172.21.15.123:0/3566507590 wait complete. 2024-05-06T14:00:02.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.571+0000 7f1fc9cec700 1 Processor -- start 2024-05-06T14:00:02.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.571+0000 7f1fc9cec700 1 -- start start 2024-05-06T14:00:02.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc9cec700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fc4100dc0 0x7f1fc419c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:02.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc9cec700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc4101770 0x7f1fc419cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:02.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc9cec700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc419d190 con 0x7f1fc4100dc0 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc9cec700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc4196640 con 0x7f1fc4101770 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fc4100dc0 0x7f1fc419c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fc4100dc0 0x7f1fc419c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39446/0 (socket says 172.21.15.123:39446) 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc37fe700 1 -- 172.21.15.123:0/2880469044 learned_addr learned my addr 172.21.15.123:0/2880469044 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc2ffd700 1 --2- 172.21.15.123:0/2880469044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc4101770 0x7f1fc419cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc37fe700 1 -- 172.21.15.123:0/2880469044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc4101770 msgr2=0x7f1fc419cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc37fe700 1 --2- 172.21.15.123:0/2880469044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc4101770 0x7f1fc419cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc37fe700 1 -- 172.21.15.123:0/2880469044 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb80095f0 con 0x7f1fc4100dc0 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc2ffd700 1 --2- 172.21.15.123:0/2880469044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc4101770 0x7f1fc419cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc37fe700 1 --2- 172.21.15.123:0/2880469044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fc4100dc0 0x7f1fc419c5c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400b4b0 tx=0x7f1fb400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc0ff9700 1 -- 172.21.15.123:0/2880469044 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb4011800 con 0x7f1fc4100dc0 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc0ff9700 1 -- 172.21.15.123:0/2880469044 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1fb4011e10 con 0x7f1fc4100dc0 2024-05-06T14:00:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc9cec700 1 -- 172.21.15.123:0/2880469044 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc4196920 con 0x7f1fc4100dc0 2024-05-06T14:00:02.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc0ff9700 1 -- 172.21.15.123:0/2880469044 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb400f2e0 con 0x7f1fc4100dc0 2024-05-06T14:00:02.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.572+0000 7f1fc9cec700 1 -- 172.21.15.123:0/2880469044 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc4196e70 con 0x7f1fc4100dc0 2024-05-06T14:00:02.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.573+0000 7f1fc9cec700 1 -- 172.21.15.123:0/2880469044 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc41090f0 con 0x7f1fc4100dc0 2024-05-06T14:00:02.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.574+0000 7f1fc0ff9700 1 -- 172.21.15.123:0/2880469044 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f1fb4010380 con 0x7f1fc4100dc0 2024-05-06T14:00:02.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.574+0000 7f1fc0ff9700 1 --2- 172.21.15.123:0/2880469044 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f1fac06c4e0 0x7f1fac06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:02.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.574+0000 7f1fc0ff9700 1 -- 172.21.15.123:0/2880469044 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f1fb408b130 con 0x7f1fc4100dc0 2024-05-06T14:00:02.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.574+0000 7f1fc2ffd700 1 --2- 172.21.15.123:0/2880469044 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f1fac06c4e0 0x7f1fac06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:02.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.575+0000 7f1fc2ffd700 1 --2- 172.21.15.123:0/2880469044 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f1fac06c4e0 0x7f1fac06e9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4105a40 tx=0x7f1fb801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:02.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.579+0000 7f1fc0ff9700 1 -- 172.21.15.123:0/2880469044 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1fb40596e0 con 0x7f1fc4100dc0 2024-05-06T14:00:02.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.771+0000 7f1fc9cec700 1 -- 172.21.15.123:0/2880469044 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fc404ea90 con 0x7f1fc4100dc0 2024-05-06T14:00:02.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.771+0000 7f1fc0ff9700 1 -- 172.21.15.123:0/2880469044 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11382 (secure 0 0 0) 0x7f1fb4059270 con 0x7f1fc4100dc0 2024-05-06T14:00:02.773 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T14:00:02.773 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":40,"fsid":"f22edd3c-0baf-11ef-bc97-c7b262605968","created":"2024-05-06T13:53:53.764041+0000","modified":"2024-05-06T13:59:41.105757+0000","last_up_change":"2024-05-06T13:59:40.100058+0000","last_in_change":"2024-05-06T13:59:20.268409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T13:58:23.113471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4803adcc-ea08-4773-99f0-65485b08489f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":990362393},{"type":"v1","addr":"172.21.15.123:6803","nonce":990362393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":990362393},{"type":"v1","addr":"172.21.15.123:6805","nonce":990362393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":990362393},{"type":"v1","addr":"172.21.15.123:6809","nonce":990362393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":990362393},{"type":"v1","addr":"172.21.15.123:6807","nonce":990362393}]},"public_addr":"172.21.15.123:6803/990362393","cluster_addr":"172.21.15.123:6805/990362393","heartbeat_back_addr":"172.21.15.123:6809/990362393","heartbeat_front_addr":"172.21.15.123:6807/990362393","state":["exists","up"]},{"osd":1,"uuid":"a34740b3-d6c1-4d4e-8a4d-efe3b3dc26ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2243856034},{"type":"v1","addr":"172.21.15.123:6811","nonce":2243856034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2243856034},{"type":"v1","addr":"172.21.15.123:6813","nonce":2243856034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2243856034},{"type":"v1","addr":"172.21.15.123:6817","nonce":2243856034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2243856034},{"type":"v1","addr":"172.21.15.123:6815","nonce":2243856034}]},"public_addr":"172.21.15.123:6811/2243856034","cluster_addr":"172.21.15.123:6813/2243856034","heartbeat_back_addr":"172.21.15.123:6817/2243856034","heartbeat_front_addr":"172.21.15.123:6815/2243856034","state":["exists","up"]},{"osd":2,"uuid":"075dfad3-ac71-4c06-b9eb-0f3813c7e309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3515428076},{"type":"v1","addr":"172.21.15.123:6819","nonce":3515428076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3515428076},{"type":"v1","addr":"172.21.15.123:6821","nonce":3515428076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3515428076},{"type":"v1","addr":"172.21.15.123:6825","nonce":3515428076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3515428076},{"type":"v1","addr":"172.21.15.123:6823","nonce":3515428076}]},"public_addr":"172.21.15.123:6819/3515428076","cluster_addr":"172.21.15.123:6821/3515428076","heartbeat_back_addr":"172.21.15.123:6825/3515428076","heartbeat_front_addr":"172.21.15.123:6823/3515428076","state":["exists","up"]},{"osd":3,"uuid":"1ee0a686-0cf2-48df-838f-9d10a55c6a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3542331218},{"type":"v1","addr":"172.21.15.174:6801","nonce":3542331218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3542331218},{"type":"v1","addr":"172.21.15.174:6803","nonce":3542331218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3542331218},{"type":"v1","addr":"172.21.15.174:6807","nonce":3542331218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3542331218},{"type":"v1","addr":"172.21.15.174:6805","nonce":3542331218}]},"public_addr":"172.21.15.174:6801/3542331218","cluster_addr":"172.21.15.174:6803/3542331218","heartbeat_back_addr":"172.21.15.174:6807/3542331218","heartbeat_front_addr":"172.21.15.174:6805/3542331218","state":["exists","up"]},{"osd":4,"uuid":"5145c459-5691-41de-a537-aaf278530b72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3350136942},{"type":"v1","addr":"172.21.15.174:6809","nonce":3350136942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3350136942},{"type":"v1","addr":"172.21.15.174:6811","nonce":3350136942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3350136942},{"type":"v1","addr":"172.21.15.174:6815","nonce":3350136942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3350136942},{"type":"v1","addr":"172.21.15.174:6813","nonce":3350136942}]},"public_addr":"172.21.15.174:6809/3350136942","cluster_addr":"172.21.15.174:6811/3350136942","heartbeat_back_addr":"172.21.15.174:6815/3350136942","heartbeat_front_addr":"172.21.15.174:6813/3350136942","state":["exists","up"]},{"osd":5,"uuid":"7c59c801-2ae9-4660-8feb-d2474527cc09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2336253711},{"type":"v1","addr":"172.21.15.174:6817","nonce":2336253711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2336253711},{"type":"v1","addr":"172.21.15.174:6819","nonce":2336253711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2336253711},{"type":"v1","addr":"172.21.15.174:6823","nonce":2336253711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2336253711},{"type":"v1","addr":"172.21.15.174:6821","nonce":2336253711}]},"public_addr":"172.21.15.174:6817/2336253711","cluster_addr":"172.21.15.174:6819/2336253711","heartbeat_back_addr":"172.21.15.174:6823/2336253711","heartbeat_front_addr":"172.21.15.174:6821/2336253711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:57:26.135182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:57:53.556186+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:58:20.967654+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:58:45.035949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:59:11.636777+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:59:38.098428+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/2647159870":"2024-05-07T13:56:04.790493+0000","172.21.15.123:6800/388885730":"2024-05-07T13:56:04.790493+0000","172.21.15.123:0/306885224":"2024-05-07T13:54:54.367854+0000","172.21.15.123:6801/2710951021":"2024-05-07T13:54:54.367854+0000","172.21.15.123:0/634683219":"2024-05-07T13:54:54.367854+0000","172.21.15.123:6801/35564330":"2024-05-07T13:54:21.525408+0000","172.21.15.123:0/4277354301":"2024-05-07T13:54:21.525408+0000","172.21.15.123:0/1999705925":"2024-05-07T13:56:04.790493+0000","172.21.15.123:6800/35564330":"2024-05-07T13:54:21.525408+0000","172.21.15.123:0/1489655906":"2024-05-07T13:54:21.525408+0000","172.21.15.123:6801/388885730":"2024-05-07T13:56:04.790493+0000","172.21.15.123:0/1506782592":"2024-05-07T13:56:04.790493+0000","172.21.15.123:6800/2710951021":"2024-05-07T13:54:54.367854+0000","172.21.15.123:0/3708790365":"2024-05-07T13:54:21.525408+0000","172.21.15.123:0/1961046585":"2024-05-07T13:54:54.367854+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T14:00:02.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.774+0000 7f1fc9cec700 1 -- 172.21.15.123:0/2880469044 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f1fac06c4e0 msgr2=0x7f1fac06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:02.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.774+0000 7f1fc9cec700 1 --2- 172.21.15.123:0/2880469044 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f1fac06c4e0 0x7f1fac06e9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4105a40 tx=0x7f1fb801a040 comp rx=0 tx=0).stop 2024-05-06T14:00:02.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.774+0000 7f1fc9cec700 1 -- 172.21.15.123:0/2880469044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fc4100dc0 msgr2=0x7f1fc419c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:02.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.774+0000 7f1fc9cec700 1 --2- 172.21.15.123:0/2880469044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fc4100dc0 0x7f1fc419c5c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400b4b0 tx=0x7f1fb400b870 comp rx=0 tx=0).stop 2024-05-06T14:00:02.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.774+0000 7f1fc9cec700 1 -- 172.21.15.123:0/2880469044 shutdown_connections 2024-05-06T14:00:02.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.774+0000 7f1fc9cec700 1 --2- 172.21.15.123:0/2880469044 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f1fac06c4e0 0x7f1fac06e9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:02.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.774+0000 7f1fc9cec700 1 --2- 172.21.15.123:0/2880469044 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fc4100dc0 0x7f1fc419c5c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:02.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.774+0000 7f1fc9cec700 1 --2- 172.21.15.123:0/2880469044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc4101770 0x7f1fc419cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:02.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.774+0000 7f1fc9cec700 1 -- 172.21.15.123:0/2880469044 >> 172.21.15.123:0/2880469044 conn(0x7f1fc40fc650 msgr2=0x7f1fc40fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:02.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.774+0000 7f1fc9cec700 1 -- 172.21.15.123:0/2880469044 shutdown_connections 2024-05-06T14:00:02.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:02.774+0000 7f1fc9cec700 1 -- 172.21.15.123:0/2880469044 wait complete. 2024-05-06T14:00:03.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:03 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2880469044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T14:00:03.432 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-06T14:00:03.433 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-06T14:00:03.433 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-06T14:00:03.434 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-06T14:00:03.434 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-06T14:00:03.434 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-06T14:00:03.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:03 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/2880469044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T14:00:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:04.228 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:04 smithi123 ceph-mon[27254]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:04.425 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:04 smithi174 ceph-mon[35160]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:05.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:05 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:00:05.606 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:05 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:00:06.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.089+0000 7fe111d02700 1 -- 172.21.15.123:0/3907423075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe10c104ae0 msgr2=0x7fe10c104ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:06.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.089+0000 7fe111d02700 1 --2- 172.21.15.123:0/3907423075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe10c104ae0 0x7fe10c104ec0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009910 tx=0x7fe0fc009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:06.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.089+0000 7fe111d02700 1 -- 172.21.15.123:0/3907423075 shutdown_connections 2024-05-06T14:00:06.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.089+0000 7fe111d02700 1 --2- 172.21.15.123:0/3907423075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c1003e0 0x7fe10c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:06.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.089+0000 7fe111d02700 1 --2- 172.21.15.123:0/3907423075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe10c104ae0 0x7fe10c104ec0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:06.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.089+0000 7fe111d02700 1 -- 172.21.15.123:0/3907423075 >> 172.21.15.123:0/3907423075 conn(0x7fe10c074df0 msgr2=0x7fe10c075200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:06.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.089+0000 7fe111d02700 1 -- 172.21.15.123:0/3907423075 shutdown_connections 2024-05-06T14:00:06.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.089+0000 7fe111d02700 1 -- 172.21.15.123:0/3907423075 wait complete. 2024-05-06T14:00:06.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.089+0000 7fe111d02700 1 Processor -- start 2024-05-06T14:00:06.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.089+0000 7fe111d02700 1 -- start start 2024-05-06T14:00:06.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe111d02700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe10c1003e0 0x7fe10c197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:06.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe111d02700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c104ae0 0x7fe10c197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:06.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe111d02700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c198140 con 0x7fe10c1003e0 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe111d02700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c1982b0 con 0x7fe10c104ae0 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe10b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe10c1003e0 0x7fe10c197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe10b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe10c1003e0 0x7fe10c197670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39468/0 (socket says 172.21.15.123:39468) 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe10b7fe700 1 -- 172.21.15.123:0/1106514994 learned_addr learned my addr 172.21.15.123:0/1106514994 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe103fff700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c104ae0 0x7fe10c197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe10b7fe700 1 -- 172.21.15.123:0/1106514994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c104ae0 msgr2=0x7fe10c197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe10b7fe700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c104ae0 0x7fe10c197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe10b7fe700 1 -- 172.21.15.123:0/1106514994 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc0095f0 con 0x7fe10c1003e0 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe103fff700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c104ae0 0x7fe10c197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe10b7fe700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe10c1003e0 0x7fe10c197670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc006010 tx=0x7fe0fc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe1097fa700 1 -- 172.21.15.123:0/1106514994 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0fc01d070 con 0x7fe10c1003e0 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe1097fa700 1 -- 172.21.15.123:0/1106514994 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe0fc00f460 con 0x7fe10c1003e0 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe111d02700 1 -- 172.21.15.123:0/1106514994 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10c1a06e0 con 0x7fe10c1003e0 2024-05-06T14:00:06.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe1097fa700 1 -- 172.21.15.123:0/1106514994 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0fc021640 con 0x7fe10c1003e0 2024-05-06T14:00:06.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.090+0000 7fe111d02700 1 -- 172.21.15.123:0/1106514994 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c1a0a90 con 0x7fe10c1003e0 2024-05-06T14:00:06.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.091+0000 7fe111d02700 1 -- 172.21.15.123:0/1106514994 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe10c10d000 con 0x7fe10c1003e0 2024-05-06T14:00:06.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.092+0000 7fe1097fa700 1 -- 172.21.15.123:0/1106514994 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fe0fc00fab0 con 0x7fe10c1003e0 2024-05-06T14:00:06.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.092+0000 7fe1097fa700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe0f806c4e0 0x7fe0f806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:06.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.092+0000 7fe1097fa700 1 -- 172.21.15.123:0/1106514994 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe0fc08c7a0 con 0x7fe10c1003e0 2024-05-06T14:00:06.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.092+0000 7fe103fff700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe0f806c4e0 0x7fe0f806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:06.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.092+0000 7fe1097fa700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034] conn(0x7fe0f80721c0 0x7fe0f80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:06.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.092+0000 7fe1097fa700 1 -- 172.21.15.123:0/1106514994 --> [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0f8074c90 con 0x7fe0f80721c0 2024-05-06T14:00:06.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.092+0000 7fe1097fa700 1 -- 172.21.15.123:0/1106514994 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0fc0912a0 con 0x7fe10c1003e0 2024-05-06T14:00:06.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.093+0000 7fe10bfff700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034] conn(0x7fe0f80721c0 0x7fe0f80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:06.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.093+0000 7fe103fff700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe0f806c4e0 0x7fe0f806e9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4005fd0 tx=0x7fe0f4005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:06.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.093+0000 7fe10bfff700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034] conn(0x7fe0f80721c0 0x7fe0f80745e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:06.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.094+0000 7fe1097fa700 1 -- 172.21.15.123:0/1106514994 <== osd.1 v2:172.21.15.123:6810/2243856034 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe0f8074c90 con 0x7fe0f80721c0 2024-05-06T14:00:06.103 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:06.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.113+0000 7fe111d02700 1 -- 172.21.15.123:0/1106514994 --> [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe10c04ea90 con 0x7fe0f80721c0 2024-05-06T14:00:06.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.113+0000 7fe1097fa700 1 -- 172.21.15.123:0/1106514994 <== osd.1 v2:172.21.15.123:6810/2243856034 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe10c04ea90 con 0x7fe0f80721c0 2024-05-06T14:00:06.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 -- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034] conn(0x7fe0f80721c0 msgr2=0x7fe0f80745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:06.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034] conn(0x7fe0f80721c0 0x7fe0f80745e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:06.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 -- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe0f806c4e0 msgr2=0x7fe0f806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:06.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe0f806c4e0 0x7fe0f806e9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4005fd0 tx=0x7fe0f4005ee0 comp rx=0 tx=0).stop 2024-05-06T14:00:06.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 -- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe10c1003e0 msgr2=0x7fe10c197670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:06.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe10c1003e0 0x7fe10c197670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc006010 tx=0x7fe0fc00be20 comp rx=0 tx=0).stop 2024-05-06T14:00:06.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 -- 172.21.15.123:0/1106514994 shutdown_connections 2024-05-06T14:00:06.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:6810/2243856034,v1:172.21.15.123:6811/2243856034] conn(0x7fe0f80721c0 0x7fe0f80745e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:06.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe0f806c4e0 0x7fe0f806e9a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:06.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe10c1003e0 0x7fe10c197670 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:06.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 --2- 172.21.15.123:0/1106514994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c104ae0 0x7fe10c197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:06.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 -- 172.21.15.123:0/1106514994 >> 172.21.15.123:0/1106514994 conn(0x7fe10c074df0 msgr2=0x7fe10c0fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:06.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 -- 172.21.15.123:0/1106514994 shutdown_connections 2024-05-06T14:00:06.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:06.114+0000 7fe111d02700 1 -- 172.21.15.123:0/1106514994 wait complete. 2024-05-06T14:00:06.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:06 smithi174 ceph-mon[35160]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:06.561 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:06 smithi123 ceph-mon[27254]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:06.576 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:06.576 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:07.858 INFO:teuthology.orchestra.run.smithi123.stdout:60129542174 2024-05-06T14:00:07.859 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-06T14:00:08.390 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:08 smithi123 ceph-mon[27254]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:08.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.389+0000 7f67be55a700 1 -- 172.21.15.123:0/3979941612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b8101750 msgr2=0x7f67b81057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:08.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.389+0000 7f67be55a700 1 --2- 172.21.15.123:0/3979941612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b8101750 0x7f67b81057a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f67ac009910 tx=0x7f67ac009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:08.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.389+0000 7f67be55a700 1 -- 172.21.15.123:0/3979941612 shutdown_connections 2024-05-06T14:00:08.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.389+0000 7f67be55a700 1 --2- 172.21.15.123:0/3979941612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b8101750 0x7f67b81057a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:08.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.389+0000 7f67be55a700 1 --2- 172.21.15.123:0/3979941612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b8100da0 0x7f67b8101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:08.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.389+0000 7f67be55a700 1 -- 172.21.15.123:0/3979941612 >> 172.21.15.123:0/3979941612 conn(0x7f67b80fc630 msgr2=0x7f67b80fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:08.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.390+0000 7f67be55a700 1 -- 172.21.15.123:0/3979941612 shutdown_connections 2024-05-06T14:00:08.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.390+0000 7f67be55a700 1 -- 172.21.15.123:0/3979941612 wait complete. 2024-05-06T14:00:08.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.390+0000 7f67be55a700 1 Processor -- start 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.390+0000 7f67be55a700 1 -- start start 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67be55a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b8100da0 0x7f67b819c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67be55a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b8101750 0x7f67b819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67be55a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b819d0d0 con 0x7f67b8100da0 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67be55a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b8196580 con 0x7f67b8101750 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67b7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b8100da0 0x7f67b819c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67b7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b8100da0 0x7f67b819c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50436/0 (socket says 172.21.15.123:50436) 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67b7fff700 1 -- 172.21.15.123:0/4263648512 learned_addr learned my addr 172.21.15.123:0/4263648512 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67b7fff700 1 -- 172.21.15.123:0/4263648512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b8101750 msgr2=0x7f67b819ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67b7fff700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b8101750 0x7f67b819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67b7fff700 1 -- 172.21.15.123:0/4263648512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac0095f0 con 0x7f67b8100da0 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67b7fff700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b8100da0 0x7f67b819c500 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f67a800c8a0 tx=0x7f67a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67b57fa700 1 -- 172.21.15.123:0/4263648512 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67a800cea0 con 0x7f67b8100da0 2024-05-06T14:00:08.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67b57fa700 1 -- 172.21.15.123:0/4263648512 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f67a8004830 con 0x7f67b8100da0 2024-05-06T14:00:08.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67b57fa700 1 -- 172.21.15.123:0/4263648512 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67a80055b0 con 0x7f67b8100da0 2024-05-06T14:00:08.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.391+0000 7f67be55a700 1 -- 172.21.15.123:0/4263648512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b8196860 con 0x7f67b8100da0 2024-05-06T14:00:08.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.392+0000 7f67be55a700 1 -- 172.21.15.123:0/4263648512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b8196db0 con 0x7f67b8100da0 2024-05-06T14:00:08.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.392+0000 7f67be55a700 1 -- 172.21.15.123:0/4263648512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f67b810e040 con 0x7f67b8100da0 2024-05-06T14:00:08.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.393+0000 7f67b57fa700 1 -- 172.21.15.123:0/4263648512 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f67a8007ad0 con 0x7f67b8100da0 2024-05-06T14:00:08.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.393+0000 7f67b57fa700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f67a006c4e0 0x7f67a006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:08.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.393+0000 7f67b77fe700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f67a006c4e0 0x7f67a006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:08.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.393+0000 7f67b57fa700 1 -- 172.21.15.123:0/4263648512 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f67a808b130 con 0x7f67b8100da0 2024-05-06T14:00:08.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.394+0000 7f67b57fa700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393] conn(0x7f67a00721c0 0x7f67a00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:08.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.394+0000 7f67b57fa700 1 -- 172.21.15.123:0/4263648512 --> [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f67a0074c90 con 0x7f67a00721c0 2024-05-06T14:00:08.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.394+0000 7f67b57fa700 1 -- 172.21.15.123:0/4263648512 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67a808d800 con 0x7f67b8100da0 2024-05-06T14:00:08.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.394+0000 7f67bcaf7700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393] conn(0x7f67a00721c0 0x7f67a00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:08.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.394+0000 7f67b77fe700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f67a006c4e0 0x7f67a006e9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00b5c0 tx=0x7f67ac005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:08.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.394+0000 7f67bcaf7700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393] conn(0x7f67a00721c0 0x7f67a00745e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:08.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.395+0000 7f67b57fa700 1 -- 172.21.15.123:0/4263648512 <== osd.0 v2:172.21.15.123:6802/990362393 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f67a0074c90 con 0x7f67a00721c0 2024-05-06T14:00:08.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.410+0000 7f67be55a700 1 -- 172.21.15.123:0/4263648512 --> [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f67b804ea90 con 0x7f67a00721c0 2024-05-06T14:00:08.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67b57fa700 1 -- 172.21.15.123:0/4263648512 <== osd.0 v2:172.21.15.123:6802/990362393 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f67b804ea90 con 0x7f67a00721c0 2024-05-06T14:00:08.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 -- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393] conn(0x7f67a00721c0 msgr2=0x7f67a00745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:08.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393] conn(0x7f67a00721c0 0x7f67a00745e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 -- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f67a006c4e0 msgr2=0x7f67a006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f67a006c4e0 0x7f67a006e9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00b5c0 tx=0x7f67ac005960 comp rx=0 tx=0).stop 2024-05-06T14:00:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 -- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b8100da0 msgr2=0x7f67b819c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b8100da0 0x7f67b819c500 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f67a800c8a0 tx=0x7f67a800cc60 comp rx=0 tx=0).stop 2024-05-06T14:00:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 -- 172.21.15.123:0/4263648512 shutdown_connections 2024-05-06T14:00:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:6802/990362393,v1:172.21.15.123:6803/990362393] conn(0x7f67a00721c0 0x7f67a00745e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f67a006c4e0 0x7f67a006e9a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b8100da0 0x7f67b819c500 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 --2- 172.21.15.123:0/4263648512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b8101750 0x7f67b819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 -- 172.21.15.123:0/4263648512 >> 172.21.15.123:0/4263648512 conn(0x7f67b80fc630 msgr2=0x7f67b80fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 -- 172.21.15.123:0/4263648512 shutdown_connections 2024-05-06T14:00:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:08.411+0000 7f67be55a700 1 -- 172.21.15.123:0/4263648512 wait complete. 2024-05-06T14:00:08.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:08 smithi174 ceph-mon[35160]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:10.410 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:10 smithi123 ceph-mon[27254]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:10.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:10 smithi174 ceph-mon[35160]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:12.053 INFO:teuthology.orchestra.run.smithi123.stdout:38654705699 2024-05-06T14:00:12.054 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-06T14:00:12.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:12 smithi123 ceph-mon[27254]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:12.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:12 smithi174 ceph-mon[35160]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:13.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.338+0000 7fe6fe570700 1 -- 172.21.15.123:0/3423843543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8100de0 msgr2=0x7fe6f81011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:13.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.338+0000 7fe6fe570700 1 --2- 172.21.15.123:0/3423843543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8100de0 0x7fe6f81011c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009910 tx=0x7fe6e8009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:13.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.338+0000 7fe6fe570700 1 -- 172.21.15.123:0/3423843543 shutdown_connections 2024-05-06T14:00:13.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.338+0000 7fe6fe570700 1 --2- 172.21.15.123:0/3423843543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6f8101790 0x7fe6f81057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.338+0000 7fe6fe570700 1 --2- 172.21.15.123:0/3423843543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8100de0 0x7fe6f81011c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.338+0000 7fe6fe570700 1 -- 172.21.15.123:0/3423843543 >> 172.21.15.123:0/3423843543 conn(0x7fe6f80fc670 msgr2=0x7fe6f80fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:13.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.338+0000 7fe6fe570700 1 -- 172.21.15.123:0/3423843543 shutdown_connections 2024-05-06T14:00:13.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.338+0000 7fe6fe570700 1 -- 172.21.15.123:0/3423843543 wait complete. 2024-05-06T14:00:13.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.338+0000 7fe6fe570700 1 Processor -- start 2024-05-06T14:00:13.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.338+0000 7fe6fe570700 1 -- start start 2024-05-06T14:00:13.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.339+0000 7fe6fe570700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6f8100de0 0x7fe6f81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.339+0000 7fe6fe570700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8101790 0x7fe6f8198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.339+0000 7fe6fe570700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8199570 con 0x7fe6f8101790 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.339+0000 7fe6fe570700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f819d380 con 0x7fe6f8100de0 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.339+0000 7fe6f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8101790 0x7fe6f8198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.339+0000 7fe6f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8101790 0x7fe6f8198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50454/0 (socket says 172.21.15.123:50454) 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.339+0000 7fe6f77fe700 1 -- 172.21.15.123:0/4171891709 learned_addr learned my addr 172.21.15.123:0/4171891709 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.339+0000 7fe6f7fff700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6f8100de0 0x7fe6f81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.339+0000 7fe6f77fe700 1 -- 172.21.15.123:0/4171891709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6f8100de0 msgr2=0x7fe6f81989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.339+0000 7fe6f77fe700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6f8100de0 0x7fe6f81989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.339+0000 7fe6f77fe700 1 -- 172.21.15.123:0/4171891709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e80095f0 con 0x7fe6f8101790 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.340+0000 7fe6f77fe700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8101790 0x7fe6f8198ee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00b480 tx=0x7fe6ec00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.340+0000 7fe6f57fa700 1 -- 172.21.15.123:0/4171891709 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ec0118c0 con 0x7fe6f8101790 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.340+0000 7fe6f57fa700 1 -- 172.21.15.123:0/4171891709 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe6ec010380 con 0x7fe6f8101790 2024-05-06T14:00:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.340+0000 7fe6f57fa700 1 -- 172.21.15.123:0/4171891709 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ec00f4f0 con 0x7fe6f8101790 2024-05-06T14:00:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.340+0000 7fe6fe570700 1 -- 172.21.15.123:0/4171891709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f819d660 con 0x7fe6f8101790 2024-05-06T14:00:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.340+0000 7fe6fe570700 1 -- 172.21.15.123:0/4171891709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f819dbb0 con 0x7fe6f8101790 2024-05-06T14:00:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.341+0000 7fe6fe570700 1 -- 172.21.15.123:0/4171891709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6f810e120 con 0x7fe6f8101790 2024-05-06T14:00:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.341+0000 7fe6f57fa700 1 -- 172.21.15.123:0/4171891709 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fe6ec0104f0 con 0x7fe6f8101790 2024-05-06T14:00:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.341+0000 7fe6f57fa700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe6e006c4e0 0x7fe6e006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.342+0000 7fe6f57fa700 1 -- 172.21.15.123:0/4171891709 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe6ec08b060 con 0x7fe6f8101790 2024-05-06T14:00:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.342+0000 7fe6f7fff700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe6e006c4e0 0x7fe6e006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.342+0000 7fe6f57fa700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076] conn(0x7fe6e00721c0 0x7fe6e00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.342+0000 7fe6f57fa700 1 -- 172.21.15.123:0/4171891709 --> [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6e0074c90 con 0x7fe6e00721c0 2024-05-06T14:00:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.342+0000 7fe6f57fa700 1 -- 172.21.15.123:0/4171891709 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6ec08d730 con 0x7fe6f8101790 2024-05-06T14:00:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.342+0000 7fe6fcb0d700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076] conn(0x7fe6e00721c0 0x7fe6e00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:13.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.342+0000 7fe6f7fff700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe6e006c4e0 0x7fe6e006e9a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800b5c0 tx=0x7fe6e8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:13.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.342+0000 7fe6fcb0d700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076] conn(0x7fe6e00721c0 0x7fe6e00745e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:13.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.343+0000 7fe6f57fa700 1 -- 172.21.15.123:0/4171891709 <== osd.2 v2:172.21.15.123:6818/3515428076 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe6e0074c90 con 0x7fe6e00721c0 2024-05-06T14:00:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.358+0000 7fe6fe570700 1 -- 172.21.15.123:0/4171891709 --> [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6f804ea90 con 0x7fe6e00721c0 2024-05-06T14:00:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.358+0000 7fe6f57fa700 1 -- 172.21.15.123:0/4171891709 <== osd.2 v2:172.21.15.123:6818/3515428076 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe6f804ea90 con 0x7fe6e00721c0 2024-05-06T14:00:13.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 -- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076] conn(0x7fe6e00721c0 msgr2=0x7fe6e00745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:13.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076] conn(0x7fe6e00721c0 0x7fe6e00745e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 -- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe6e006c4e0 msgr2=0x7fe6e006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:13.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe6e006c4e0 0x7fe6e006e9a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800b5c0 tx=0x7fe6e8005960 comp rx=0 tx=0).stop 2024-05-06T14:00:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 -- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8101790 msgr2=0x7fe6f8198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8101790 0x7fe6f8198ee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00b480 tx=0x7fe6ec00b840 comp rx=0 tx=0).stop 2024-05-06T14:00:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 -- 172.21.15.123:0/4171891709 shutdown_connections 2024-05-06T14:00:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fe6e006c4e0 0x7fe6e006e9a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6f8100de0 0x7fe6f81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:6818/3515428076,v1:172.21.15.123:6819/3515428076] conn(0x7fe6e00721c0 0x7fe6e00745e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 --2- 172.21.15.123:0/4171891709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8101790 0x7fe6f8198ee0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 -- 172.21.15.123:0/4171891709 >> 172.21.15.123:0/4171891709 conn(0x7fe6f80fc670 msgr2=0x7fe6f80fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 -- 172.21.15.123:0/4171891709 shutdown_connections 2024-05-06T14:00:13.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.359+0000 7fe6fe570700 1 -- 172.21.15.123:0/4171891709 wait complete. 2024-05-06T14:00:13.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.922+0000 7f20d1314700 1 -- 172.21.15.123:0/1291816159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20cc100dc0 msgr2=0x7f20cc1011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:13.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.922+0000 7f20d1314700 1 --2- 172.21.15.123:0/1291816159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20cc100dc0 0x7f20cc1011a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009910 tx=0x7f20bc009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:13.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.922+0000 7f20d1314700 1 -- 172.21.15.123:0/1291816159 shutdown_connections 2024-05-06T14:00:13.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.922+0000 7f20d1314700 1 --2- 172.21.15.123:0/1291816159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20cc101770 0x7f20cc1057c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.922+0000 7f20d1314700 1 --2- 172.21.15.123:0/1291816159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20cc100dc0 0x7f20cc1011a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.922+0000 7f20d1314700 1 -- 172.21.15.123:0/1291816159 >> 172.21.15.123:0/1291816159 conn(0x7f20cc0fc650 msgr2=0x7f20cc0fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:13.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.922+0000 7f20d1314700 1 -- 172.21.15.123:0/1291816159 shutdown_connections 2024-05-06T14:00:13.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.922+0000 7f20d1314700 1 -- 172.21.15.123:0/1291816159 wait complete. 2024-05-06T14:00:13.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.922+0000 7f20d1314700 1 Processor -- start 2024-05-06T14:00:13.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20d1314700 1 -- start start 2024-05-06T14:00:13.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20d1314700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20cc100dc0 0x7f20cc073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:13.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20d1314700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20cc101770 0x7f20cc0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:13.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20d1314700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc073b10 con 0x7f20cc101770 2024-05-06T14:00:13.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20d1314700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc073c50 con 0x7f20cc100dc0 2024-05-06T14:00:13.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20ca7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20cc101770 0x7f20cc0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:13.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20ca7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20cc101770 0x7f20cc0735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50462/0 (socket says 172.21.15.123:50462) 2024-05-06T14:00:13.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20ca7fc700 1 -- 172.21.15.123:0/3134189597 learned_addr learned my addr 172.21.15.123:0/3134189597 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:13.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20caffd700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20cc100dc0 0x7f20cc073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:13.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20ca7fc700 1 -- 172.21.15.123:0/3134189597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20cc100dc0 msgr2=0x7f20cc073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:13.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20ca7fc700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20cc100dc0 0x7f20cc073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20ca7fc700 1 -- 172.21.15.123:0/3134189597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc0095f0 con 0x7f20cc101770 2024-05-06T14:00:13.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20ca7fc700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20cc101770 0x7f20cc0735d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20c000d900 tx=0x7f20c000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:13.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20b3fff700 1 -- 172.21.15.123:0/3134189597 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20c0009900 con 0x7f20cc101770 2024-05-06T14:00:13.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20d1314700 1 -- 172.21.15.123:0/3134189597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20cc1a2940 con 0x7f20cc101770 2024-05-06T14:00:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.923+0000 7f20b3fff700 1 -- 172.21.15.123:0/3134189597 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f20c0010460 con 0x7f20cc101770 2024-05-06T14:00:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.924+0000 7f20b3fff700 1 -- 172.21.15.123:0/3134189597 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20c000f5f0 con 0x7f20cc101770 2024-05-06T14:00:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.924+0000 7f20d1314700 1 -- 172.21.15.123:0/3134189597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20cc1a2d50 con 0x7f20cc101770 2024-05-06T14:00:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.924+0000 7f20d1314700 1 -- 172.21.15.123:0/3134189597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20cc10e080 con 0x7f20cc101770 2024-05-06T14:00:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.925+0000 7f20b3fff700 1 -- 172.21.15.123:0/3134189597 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f20c00105d0 con 0x7f20cc101770 2024-05-06T14:00:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.925+0000 7f20b3fff700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f20b406c4e0 0x7f20b406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.925+0000 7f20caffd700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f20b406c4e0 0x7f20b406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.925+0000 7f20b3fff700 1 -- 172.21.15.123:0/3134189597 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f20c008b450 con 0x7f20cc101770 2024-05-06T14:00:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.926+0000 7f20b3fff700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942] conn(0x7f20b40721c0 0x7f20b40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.926+0000 7f20b3fff700 1 -- 172.21.15.123:0/3134189597 --> [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20b4074c90 con 0x7f20b40721c0 2024-05-06T14:00:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.926+0000 7f20b3fff700 1 -- 172.21.15.123:0/3134189597 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20c008b8b0 con 0x7f20cc101770 2024-05-06T14:00:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.926+0000 7f20caffd700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f20b406c4e0 0x7f20b406e9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f20bc006010 tx=0x7f20bc01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:13.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.926+0000 7f20cb7fe700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942] conn(0x7f20b40721c0 0x7f20b40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:13.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.926+0000 7f20cb7fe700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942] conn(0x7f20b40721c0 0x7f20b40745e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:13.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.927+0000 7f20b3fff700 1 -- 172.21.15.123:0/3134189597 <== osd.4 v2:172.21.15.174:6808/3350136942 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f20b4074c90 con 0x7f20b40721c0 2024-05-06T14:00:13.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.944+0000 7f20d1314700 1 -- 172.21.15.123:0/3134189597 --> [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20cc04ea90 con 0x7f20b40721c0 2024-05-06T14:00:13.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.944+0000 7f20b3fff700 1 -- 172.21.15.123:0/3134189597 <== osd.4 v2:172.21.15.174:6808/3350136942 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f20cc04ea90 con 0x7f20b40721c0 2024-05-06T14:00:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 -- 172.21.15.123:0/3134189597 >> [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942] conn(0x7f20b40721c0 msgr2=0x7f20b40745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942] conn(0x7f20b40721c0 0x7f20b40745e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 -- 172.21.15.123:0/3134189597 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f20b406c4e0 msgr2=0x7f20b406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f20b406c4e0 0x7f20b406e9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f20bc006010 tx=0x7f20bc01a040 comp rx=0 tx=0).stop 2024-05-06T14:00:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 -- 172.21.15.123:0/3134189597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20cc101770 msgr2=0x7f20cc0735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20cc101770 0x7f20cc0735d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20c000d900 tx=0x7f20c000dc10 comp rx=0 tx=0).stop 2024-05-06T14:00:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 -- 172.21.15.123:0/3134189597 shutdown_connections 2024-05-06T14:00:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.174:6808/3350136942,v1:172.21.15.174:6809/3350136942] conn(0x7f20b40721c0 0x7f20b40745e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f20b406c4e0 0x7f20b406e9a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20cc100dc0 0x7f20cc073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 --2- 172.21.15.123:0/3134189597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20cc101770 0x7f20cc0735d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 -- 172.21.15.123:0/3134189597 >> 172.21.15.123:0/3134189597 conn(0x7f20cc0fc650 msgr2=0x7f20cc0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 -- 172.21.15.123:0/3134189597 shutdown_connections 2024-05-06T14:00:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:13.945+0000 7f20d1314700 1 -- 172.21.15.123:0/3134189597 wait complete. 2024-05-06T14:00:14.453 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:14 smithi123 ceph-mon[27254]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:14.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:14 smithi174 ceph-mon[35160]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:15.180 INFO:teuthology.orchestra.run.smithi123.stdout:81604378650 2024-05-06T14:00:15.180 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-06T14:00:15.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.553+0000 7fde046bc700 1 -- 172.21.15.123:0/2923092012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddfc101cb0 msgr2=0x7fddfc102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:15.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.553+0000 7fde046bc700 1 --2- 172.21.15.123:0/2923092012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddfc101cb0 0x7fddfc102090 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009910 tx=0x7fddf8009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:15.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.553+0000 7fde046bc700 1 -- 172.21.15.123:0/2923092012 shutdown_connections 2024-05-06T14:00:15.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.553+0000 7fde046bc700 1 --2- 172.21.15.123:0/2923092012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc102660 0x7fddfc10ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:15.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.553+0000 7fde046bc700 1 --2- 172.21.15.123:0/2923092012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddfc101cb0 0x7fddfc102090 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:15.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.553+0000 7fde046bc700 1 -- 172.21.15.123:0/2923092012 >> 172.21.15.123:0/2923092012 conn(0x7fddfc0fb590 msgr2=0x7fddfc0fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:15.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.554+0000 7fde046bc700 1 -- 172.21.15.123:0/2923092012 shutdown_connections 2024-05-06T14:00:15.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.554+0000 7fde046bc700 1 -- 172.21.15.123:0/2923092012 wait complete. 2024-05-06T14:00:15.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.554+0000 7fde046bc700 1 Processor -- start 2024-05-06T14:00:15.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.554+0000 7fde046bc700 1 -- start start 2024-05-06T14:00:15.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde046bc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddfc101cb0 0x7fddfc196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:15.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde046bc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc102660 0x7fddfc196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:15.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde046bc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc1972d0 con 0x7fddfc101cb0 2024-05-06T14:00:15.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde046bc700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc19a000 con 0x7fddfc102660 2024-05-06T14:00:15.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde02458700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddfc101cb0 0x7fddfc196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde02458700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddfc101cb0 0x7fddfc196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50470/0 (socket says 172.21.15.123:50470) 2024-05-06T14:00:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde02458700 1 -- 172.21.15.123:0/475301243 learned_addr learned my addr 172.21.15.123:0/475301243 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde01c57700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc102660 0x7fddfc196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde02458700 1 -- 172.21.15.123:0/475301243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc102660 msgr2=0x7fddfc196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde02458700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc102660 0x7fddfc196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde02458700 1 -- 172.21.15.123:0/475301243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80095f0 con 0x7fddfc101cb0 2024-05-06T14:00:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde02458700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddfc101cb0 0x7fddfc196700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fddf8006010 tx=0x7fddf800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fddf37fe700 1 -- 172.21.15.123:0/475301243 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddf801d070 con 0x7fddfc101cb0 2024-05-06T14:00:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fddf37fe700 1 -- 172.21.15.123:0/475301243 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fddf800f460 con 0x7fddfc101cb0 2024-05-06T14:00:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fddf37fe700 1 -- 172.21.15.123:0/475301243 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddf8021640 con 0x7fddfc101cb0 2024-05-06T14:00:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde046bc700 1 -- 172.21.15.123:0/475301243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc19a280 con 0x7fddfc101cb0 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.555+0000 7fde046bc700 1 -- 172.21.15.123:0/475301243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc19a720 con 0x7fddfc101cb0 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.556+0000 7fde046bc700 1 -- 172.21.15.123:0/475301243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fddfc10e0a0 con 0x7fddfc101cb0 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.557+0000 7fddf37fe700 1 -- 172.21.15.123:0/475301243 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fddf800faf0 con 0x7fddfc101cb0 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.557+0000 7fddf37fe700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fdde806c4e0 0x7fdde806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.557+0000 7fddf37fe700 1 -- 172.21.15.123:0/475301243 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fddf808d3a0 con 0x7fddfc101cb0 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.557+0000 7fde01c57700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fdde806c4e0 0x7fdde806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.557+0000 7fddf37fe700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218] conn(0x7fdde80721c0 0x7fdde80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.557+0000 7fddf37fe700 1 -- 172.21.15.123:0/475301243 --> [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdde8074c90 con 0x7fdde80721c0 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.557+0000 7fddf37fe700 1 -- 172.21.15.123:0/475301243 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddf808d800 con 0x7fddfc101cb0 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.558+0000 7fde01c57700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fdde806c4e0 0x7fdde806e9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fddec005fd0 tx=0x7fddec00a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.558+0000 7fde02c59700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218] conn(0x7fdde80721c0 0x7fdde80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.558+0000 7fde02c59700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218] conn(0x7fdde80721c0 0x7fdde80745e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.559+0000 7fddf37fe700 1 -- 172.21.15.123:0/475301243 <== osd.3 v2:172.21.15.174:6800/3542331218 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdde8074c90 con 0x7fdde80721c0 2024-05-06T14:00:15.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.574+0000 7fde046bc700 1 -- 172.21.15.123:0/475301243 --> [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fddfc04ea90 con 0x7fdde80721c0 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.575+0000 7fddf37fe700 1 -- 172.21.15.123:0/475301243 <== osd.3 v2:172.21.15.174:6800/3542331218 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fddfc04ea90 con 0x7fdde80721c0 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.575+0000 7fde046bc700 1 -- 172.21.15.123:0/475301243 >> [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218] conn(0x7fdde80721c0 msgr2=0x7fdde80745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.575+0000 7fde046bc700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218] conn(0x7fdde80721c0 0x7fdde80745e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.576+0000 7fde046bc700 1 -- 172.21.15.123:0/475301243 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fdde806c4e0 msgr2=0x7fdde806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.576+0000 7fde046bc700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fdde806c4e0 0x7fdde806e9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fddec005fd0 tx=0x7fddec00a560 comp rx=0 tx=0).stop 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.576+0000 7fde046bc700 1 -- 172.21.15.123:0/475301243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddfc101cb0 msgr2=0x7fddfc196700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.576+0000 7fde046bc700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddfc101cb0 0x7fddfc196700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fddf8006010 tx=0x7fddf800be20 comp rx=0 tx=0).stop 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.576+0000 7fde046bc700 1 -- 172.21.15.123:0/475301243 shutdown_connections 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.576+0000 7fde046bc700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.174:6800/3542331218,v1:172.21.15.174:6801/3542331218] conn(0x7fdde80721c0 0x7fdde80745e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.576+0000 7fde046bc700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fdde806c4e0 0x7fdde806e9a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.576+0000 7fde046bc700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddfc101cb0 0x7fddfc196700 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.576+0000 7fde046bc700 1 --2- 172.21.15.123:0/475301243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc102660 0x7fddfc196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.576+0000 7fde046bc700 1 -- 172.21.15.123:0/475301243 >> 172.21.15.123:0/475301243 conn(0x7fddfc0fb590 msgr2=0x7fddfc105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:15.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.576+0000 7fde046bc700 1 -- 172.21.15.123:0/475301243 shutdown_connections 2024-05-06T14:00:15.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:14.576+0000 7fde046bc700 1 -- 172.21.15.123:0/475301243 wait complete. 2024-05-06T14:00:16.052 INFO:teuthology.orchestra.run.smithi123.stdout:146028888079 2024-05-06T14:00:16.052 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-06T14:00:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.245+0000 7fa48cc58700 1 -- 172.21.15.123:0/2498548970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488101c70 msgr2=0x7fa488102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.245+0000 7fa48cc58700 1 --2- 172.21.15.123:0/2498548970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488101c70 0x7fa488102050 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa478009910 tx=0x7fa478009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.245+0000 7fa48cc58700 1 -- 172.21.15.123:0/2498548970 shutdown_connections 2024-05-06T14:00:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.245+0000 7fa48cc58700 1 --2- 172.21.15.123:0/2498548970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488102620 0x7fa48810ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.245+0000 7fa48cc58700 1 --2- 172.21.15.123:0/2498548970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488101c70 0x7fa488102050 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.245+0000 7fa48cc58700 1 -- 172.21.15.123:0/2498548970 >> 172.21.15.123:0/2498548970 conn(0x7fa4880fb570 msgr2=0x7fa4880fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.245+0000 7fa48cc58700 1 -- 172.21.15.123:0/2498548970 shutdown_connections 2024-05-06T14:00:16.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.245+0000 7fa48cc58700 1 -- 172.21.15.123:0/2498548970 wait complete. 2024-05-06T14:00:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.246+0000 7fa48cc58700 1 Processor -- start 2024-05-06T14:00:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.246+0000 7fa48cc58700 1 -- start start 2024-05-06T14:00:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.246+0000 7fa48cc58700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488101c70 0x7fa48819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.246+0000 7fa48cc58700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488102620 0x7fa48819d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.246+0000 7fa48cc58700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48819da00 con 0x7fa488102620 2024-05-06T14:00:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.246+0000 7fa48cc58700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4881a1790 con 0x7fa488101c70 2024-05-06T14:00:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.246+0000 7fa485d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488102620 0x7fa48819d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.246+0000 7fa485d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488102620 0x7fa48819d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50480/0 (socket says 172.21.15.123:50480) 2024-05-06T14:00:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.246+0000 7fa485d9b700 1 -- 172.21.15.123:0/4264274955 learned_addr learned my addr 172.21.15.123:0/4264274955 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.246+0000 7fa48659c700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488101c70 0x7fa48819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.247+0000 7fa485d9b700 1 -- 172.21.15.123:0/4264274955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488101c70 msgr2=0x7fa48819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.247+0000 7fa485d9b700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488101c70 0x7fa48819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.247+0000 7fa485d9b700 1 -- 172.21.15.123:0/4264274955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4780095f0 con 0x7fa488102620 2024-05-06T14:00:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.247+0000 7fa48659c700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488101c70 0x7fa48819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T14:00:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.247+0000 7fa485d9b700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488102620 0x7fa48819d320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00c8f0 tx=0x7fa47c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.247+0000 7fa4777fe700 1 -- 172.21.15.123:0/4264274955 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47c007ad0 con 0x7fa488102620 2024-05-06T14:00:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.247+0000 7fa48cc58700 1 -- 172.21.15.123:0/4264274955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4881a1a70 con 0x7fa488102620 2024-05-06T14:00:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.247+0000 7fa4777fe700 1 -- 172.21.15.123:0/4264274955 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa47c00ce90 con 0x7fa488102620 2024-05-06T14:00:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.247+0000 7fa4777fe700 1 -- 172.21.15.123:0/4264274955 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47c0055f0 con 0x7fa488102620 2024-05-06T14:00:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.247+0000 7fa48cc58700 1 -- 172.21.15.123:0/4264274955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4881a1fc0 con 0x7fa488102620 2024-05-06T14:00:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.248+0000 7fa48cc58700 1 -- 172.21.15.123:0/4264274955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa48810e000 con 0x7fa488102620 2024-05-06T14:00:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.249+0000 7fa4777fe700 1 -- 172.21.15.123:0/4264274955 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fa47c004830 con 0x7fa488102620 2024-05-06T14:00:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.250+0000 7fa4777fe700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fa47006c4e0 0x7fa47006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.250+0000 7fa4777fe700 1 -- 172.21.15.123:0/4264274955 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa47c08b1e0 con 0x7fa488102620 2024-05-06T14:00:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.250+0000 7fa48659c700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fa47006c4e0 0x7fa47006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.250+0000 7fa4777fe700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711] conn(0x7fa4700721c0 0x7fa4700745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.250+0000 7fa4777fe700 1 -- 172.21.15.123:0/4264274955 --> [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa470074c90 con 0x7fa4700721c0 2024-05-06T14:00:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.250+0000 7fa4777fe700 1 -- 172.21.15.123:0/4264274955 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa47c08d8b0 con 0x7fa488102620 2024-05-06T14:00:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.250+0000 7fa486d9d700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711] conn(0x7fa4700721c0 0x7fa4700745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.250+0000 7fa48659c700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fa47006c4e0 0x7fa47006e9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa478006010 tx=0x7fa47801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.251+0000 7fa486d9d700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711] conn(0x7fa4700721c0 0x7fa4700745e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.251+0000 7fa4777fe700 1 -- 172.21.15.123:0/4264274955 <== osd.5 v2:172.21.15.174:6816/2336253711 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa470074c90 con 0x7fa4700721c0 2024-05-06T14:00:16.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.271+0000 7fa48cc58700 1 -- 172.21.15.123:0/4264274955 --> [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa48804ea90 con 0x7fa4700721c0 2024-05-06T14:00:16.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.272+0000 7fa4777fe700 1 -- 172.21.15.123:0/4264274955 <== osd.5 v2:172.21.15.174:6816/2336253711 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa48804ea90 con 0x7fa4700721c0 2024-05-06T14:00:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.272+0000 7fa48cc58700 1 -- 172.21.15.123:0/4264274955 >> [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711] conn(0x7fa4700721c0 msgr2=0x7fa4700745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.272+0000 7fa48cc58700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711] conn(0x7fa4700721c0 0x7fa4700745e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.272+0000 7fa48cc58700 1 -- 172.21.15.123:0/4264274955 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fa47006c4e0 msgr2=0x7fa47006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.272+0000 7fa48cc58700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fa47006c4e0 0x7fa47006e9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa478006010 tx=0x7fa47801a040 comp rx=0 tx=0).stop 2024-05-06T14:00:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.272+0000 7fa48cc58700 1 -- 172.21.15.123:0/4264274955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488102620 msgr2=0x7fa48819d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.272+0000 7fa48cc58700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488102620 0x7fa48819d320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00c8f0 tx=0x7fa47c00ccb0 comp rx=0 tx=0).stop 2024-05-06T14:00:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.273+0000 7fa48cc58700 1 -- 172.21.15.123:0/4264274955 shutdown_connections 2024-05-06T14:00:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.273+0000 7fa48cc58700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.174:6816/2336253711,v1:172.21.15.174:6817/2336253711] conn(0x7fa4700721c0 0x7fa4700745e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.273+0000 7fa48cc58700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fa47006c4e0 0x7fa47006e9a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.273+0000 7fa48cc58700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa488101c70 0x7fa48819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.273+0000 7fa48cc58700 1 --2- 172.21.15.123:0/4264274955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488102620 0x7fa48819d320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.273+0000 7fa48cc58700 1 -- 172.21.15.123:0/4264274955 >> 172.21.15.123:0/4264274955 conn(0x7fa4880fb570 msgr2=0x7fa488100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:16.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.273+0000 7fa48cc58700 1 -- 172.21.15.123:0/4264274955 shutdown_connections 2024-05-06T14:00:16.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:16.273+0000 7fa48cc58700 1 -- 172.21.15.123:0/4264274955 wait complete. 2024-05-06T14:00:16.283 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:16 smithi123 ceph-mon[27254]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:16.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:16 smithi174 ceph-mon[35160]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:16.724 INFO:teuthology.orchestra.run.smithi123.stdout:111669149717 2024-05-06T14:00:16.724 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-06T14:00:16.908 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:17.346 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:17.346 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:17.372 INFO:teuthology.orchestra.run.smithi123.stdout:167503724554 2024-05-06T14:00:17.373 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-06T14:00:17.390 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:17.392 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:18.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:18 smithi174 ceph-mon[35160]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:18.549 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:18 smithi123 ceph-mon[27254]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:20.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:20 smithi123 ceph-mon[27254]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:20.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:00:20.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:20 smithi174 ceph-mon[35160]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:20.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:20 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:00:20.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.872+0000 7f7e18e65700 1 -- 172.21.15.123:0/1161071700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e140ff530 msgr2=0x7f7e140ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:20.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.872+0000 7f7e18e65700 1 --2- 172.21.15.123:0/1161071700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e140ff530 0x7f7e140ff910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009910 tx=0x7f7e04009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:20.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.872+0000 7f7e18e65700 1 -- 172.21.15.123:0/1161071700 shutdown_connections 2024-05-06T14:00:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.872+0000 7f7e18e65700 1 --2- 172.21.15.123:0/1161071700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e140ffee0 0x7f7e14103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.872+0000 7f7e18e65700 1 --2- 172.21.15.123:0/1161071700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e140ff530 0x7f7e140ff910 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.872+0000 7f7e18e65700 1 -- 172.21.15.123:0/1161071700 >> 172.21.15.123:0/1161071700 conn(0x7f7e14074df0 msgr2=0x7f7e14075200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.872+0000 7f7e18e65700 1 -- 172.21.15.123:0/1161071700 shutdown_connections 2024-05-06T14:00:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.872+0000 7f7e18e65700 1 -- 172.21.15.123:0/1161071700 wait complete. 2024-05-06T14:00:20.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.873+0000 7f7e18e65700 1 Processor -- start 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.873+0000 7f7e18e65700 1 -- start start 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e18e65700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e140ff530 0x7f7e1419b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e18e65700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e140ffee0 0x7f7e1419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e18e65700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1419bfd0 con 0x7f7e140ff530 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e18e65700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14195c00 con 0x7f7e140ffee0 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e1259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e140ff530 0x7f7e1419b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e1259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e140ff530 0x7f7e1419b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53502/0 (socket says 172.21.15.123:53502) 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e1259c700 1 -- 172.21.15.123:0/3084652023 learned_addr learned my addr 172.21.15.123:0/3084652023 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e11d9b700 1 --2- 172.21.15.123:0/3084652023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e140ffee0 0x7f7e1419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e1259c700 1 -- 172.21.15.123:0/3084652023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e140ffee0 msgr2=0x7f7e1419b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e1259c700 1 --2- 172.21.15.123:0/3084652023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e140ffee0 0x7f7e1419b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e1259c700 1 -- 172.21.15.123:0/3084652023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040095f0 con 0x7f7e140ff530 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e1259c700 1 --2- 172.21.15.123:0/3084652023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e140ff530 0x7f7e1419b440 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e04006010 tx=0x7f7e0400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e037fe700 1 -- 172.21.15.123:0/3084652023 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e0401f070 con 0x7f7e140ff530 2024-05-06T14:00:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e037fe700 1 -- 172.21.15.123:0/3084652023 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7e04003680 con 0x7f7e140ff530 2024-05-06T14:00:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e037fe700 1 -- 172.21.15.123:0/3084652023 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e0400f770 con 0x7f7e140ff530 2024-05-06T14:00:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e18e65700 1 -- 172.21.15.123:0/3084652023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e14195e80 con 0x7f7e140ff530 2024-05-06T14:00:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.874+0000 7f7e18e65700 1 -- 172.21.15.123:0/3084652023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e14196370 con 0x7f7e140ff530 2024-05-06T14:00:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.875+0000 7f7e18e65700 1 -- 172.21.15.123:0/3084652023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1404ea90 con 0x7f7e140ff530 2024-05-06T14:00:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.876+0000 7f7e037fe700 1 -- 172.21.15.123:0/3084652023 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f7e0400f930 con 0x7f7e140ff530 2024-05-06T14:00:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.876+0000 7f7e037fe700 1 --2- 172.21.15.123:0/3084652023 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f7dfc06c4e0 0x7f7dfc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.876+0000 7f7e11d9b700 1 --2- 172.21.15.123:0/3084652023 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f7dfc06c4e0 0x7f7dfc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.876+0000 7f7e037fe700 1 -- 172.21.15.123:0/3084652023 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7e0408ebe0 con 0x7f7e140ff530 2024-05-06T14:00:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.877+0000 7f7e11d9b700 1 --2- 172.21.15.123:0/3084652023 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f7dfc06c4e0 0x7f7dfc06e9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e08005ea0 tx=0x7f7e08005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:20.881+0000 7f7e037fe700 1 -- 172.21.15.123:0/3084652023 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7e0405d210 con 0x7f7e140ff530 2024-05-06T14:00:21.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.071+0000 7f7e18e65700 1 -- 172.21.15.123:0/3084652023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e14196760 con 0x7f7e140ff530 2024-05-06T14:00:21.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.071+0000 7f7e037fe700 1 -- 172.21.15.123:0/3084652023 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e0405cda0 con 0x7f7e140ff530 2024-05-06T14:00:21.073 INFO:teuthology.orchestra.run.smithi123.stdout:38654705701 2024-05-06T14:00:21.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.073+0000 7f7e18e65700 1 -- 172.21.15.123:0/3084652023 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f7dfc06c4e0 msgr2=0x7f7dfc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:21.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.073+0000 7f7e18e65700 1 --2- 172.21.15.123:0/3084652023 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f7dfc06c4e0 0x7f7dfc06e9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e08005ea0 tx=0x7f7e08005e30 comp rx=0 tx=0).stop 2024-05-06T14:00:21.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.073+0000 7f7e18e65700 1 -- 172.21.15.123:0/3084652023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e140ff530 msgr2=0x7f7e1419b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:21.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.073+0000 7f7e18e65700 1 --2- 172.21.15.123:0/3084652023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e140ff530 0x7f7e1419b440 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e04006010 tx=0x7f7e0400be20 comp rx=0 tx=0).stop 2024-05-06T14:00:21.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.073+0000 7f7e18e65700 1 -- 172.21.15.123:0/3084652023 shutdown_connections 2024-05-06T14:00:21.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.073+0000 7f7e18e65700 1 --2- 172.21.15.123:0/3084652023 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f7dfc06c4e0 0x7f7dfc06e9a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:21.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.073+0000 7f7e18e65700 1 --2- 172.21.15.123:0/3084652023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e140ff530 0x7f7e1419b440 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:21.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.073+0000 7f7e18e65700 1 --2- 172.21.15.123:0/3084652023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e140ffee0 0x7f7e1419b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:21.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.073+0000 7f7e18e65700 1 -- 172.21.15.123:0/3084652023 >> 172.21.15.123:0/3084652023 conn(0x7f7e14074df0 msgr2=0x7f7e140fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:21.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.074+0000 7f7e18e65700 1 -- 172.21.15.123:0/3084652023 shutdown_connections 2024-05-06T14:00:21.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:21.074+0000 7f7e18e65700 1 -- 172.21.15.123:0/3084652023 wait complete. 2024-05-06T14:00:21.501 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:21 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3084652023' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-06T14:00:21.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:21 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/3084652023' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-06T14:00:22.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:22 smithi123 ceph-mon[27254]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:22.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:22 smithi174 ceph-mon[35160]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:23.886 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705701 for osd.0 2024-05-06T14:00:23.886 DEBUG:teuthology.parallel:result is None 2024-05-06T14:00:24.317 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:24 smithi123 ceph-mon[27254]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.333+0000 7f9ae29d9700 1 -- 172.21.15.123:0/3444253378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9adc101770 msgr2=0x7f9adc1057c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.333+0000 7f9ae29d9700 1 --2- 172.21.15.123:0/3444253378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9adc101770 0x7f9adc1057c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009910 tx=0x7f9ad0009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.333+0000 7f9ae29d9700 1 -- 172.21.15.123:0/3444253378 shutdown_connections 2024-05-06T14:00:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.333+0000 7f9ae29d9700 1 --2- 172.21.15.123:0/3444253378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9adc101770 0x7f9adc1057c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.333+0000 7f9ae29d9700 1 --2- 172.21.15.123:0/3444253378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9adc100dc0 0x7f9adc1011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.333+0000 7f9ae29d9700 1 -- 172.21.15.123:0/3444253378 >> 172.21.15.123:0/3444253378 conn(0x7f9adc0fc650 msgr2=0x7f9adc0fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.333+0000 7f9ae29d9700 1 -- 172.21.15.123:0/3444253378 shutdown_connections 2024-05-06T14:00:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.333+0000 7f9ae29d9700 1 -- 172.21.15.123:0/3444253378 wait complete. 2024-05-06T14:00:24.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.333+0000 7f9ae29d9700 1 Processor -- start 2024-05-06T14:00:24.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.333+0000 7f9ae29d9700 1 -- start start 2024-05-06T14:00:24.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9ae29d9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9adc100dc0 0x7f9adc073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:24.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9ae29d9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9adc101770 0x7f9adc0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:24.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9ae29d9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc073b10 con 0x7f9adc101770 2024-05-06T14:00:24.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9ae29d9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc073c50 con 0x7f9adc100dc0 2024-05-06T14:00:24.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9adb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9adc101770 0x7f9adc0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:24.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9adb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9adc101770 0x7f9adc0735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53526/0 (socket says 172.21.15.123:53526) 2024-05-06T14:00:24.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9adb7fe700 1 -- 172.21.15.123:0/328743788 learned_addr learned my addr 172.21.15.123:0/328743788 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:24.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9adb7fe700 1 -- 172.21.15.123:0/328743788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9adc100dc0 msgr2=0x7f9adc073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:24.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9adbfff700 1 --2- 172.21.15.123:0/328743788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9adc100dc0 0x7f9adc073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:24.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9adb7fe700 1 --2- 172.21.15.123:0/328743788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9adc100dc0 0x7f9adc073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9adb7fe700 1 -- 172.21.15.123:0/328743788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad00095f0 con 0x7f9adc101770 2024-05-06T14:00:24.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9adb7fe700 1 --2- 172.21.15.123:0/328743788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9adc101770 0x7f9adc0735d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00092e0 tx=0x7f9ad000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:24.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9ad97fa700 1 -- 172.21.15.123:0/328743788 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ad001d070 con 0x7f9adc101770 2024-05-06T14:00:24.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9ad97fa700 1 -- 172.21.15.123:0/328743788 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9ad0022470 con 0x7f9adc101770 2024-05-06T14:00:24.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.334+0000 7f9ae29d9700 1 -- 172.21.15.123:0/328743788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9adc073ed0 con 0x7f9adc101770 2024-05-06T14:00:24.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.335+0000 7f9ad97fa700 1 -- 172.21.15.123:0/328743788 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ad000f690 con 0x7f9adc101770 2024-05-06T14:00:24.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.335+0000 7f9ae29d9700 1 -- 172.21.15.123:0/328743788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9adc1a2c90 con 0x7f9adc101770 2024-05-06T14:00:24.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.336+0000 7f9ae29d9700 1 -- 172.21.15.123:0/328743788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9adc1091c0 con 0x7f9adc101770 2024-05-06T14:00:24.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.336+0000 7f9ad97fa700 1 -- 172.21.15.123:0/328743788 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f9ad00225e0 con 0x7f9adc101770 2024-05-06T14:00:24.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.336+0000 7f9ad97fa700 1 --2- 172.21.15.123:0/328743788 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9ac406c4e0 0x7f9ac406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:24.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.336+0000 7f9ad97fa700 1 -- 172.21.15.123:0/328743788 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9ad008c9a0 con 0x7f9adc101770 2024-05-06T14:00:24.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.336+0000 7f9adbfff700 1 --2- 172.21.15.123:0/328743788 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9ac406c4e0 0x7f9ac406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:24.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.337+0000 7f9adbfff700 1 --2- 172.21.15.123:0/328743788 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9ac406c4e0 0x7f9ac406e9a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9acc005950 tx=0x7f9acc005cf0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:24.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.341+0000 7f9ad97fa700 1 -- 172.21.15.123:0/328743788 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9ad00575f0 con 0x7f9adc101770 2024-05-06T14:00:24.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:24 smithi174 ceph-mon[35160]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.536+0000 7f9ae29d9700 1 -- 172.21.15.123:0/328743788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9adc04ea90 con 0x7f9adc101770 2024-05-06T14:00:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.536+0000 7f9ad97fa700 1 -- 172.21.15.123:0/328743788 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ad0027090 con 0x7f9adc101770 2024-05-06T14:00:24.537 INFO:teuthology.orchestra.run.smithi123.stdout:60129542177 2024-05-06T14:00:24.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.538+0000 7f9ae29d9700 1 -- 172.21.15.123:0/328743788 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9ac406c4e0 msgr2=0x7f9ac406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:24.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.538+0000 7f9ae29d9700 1 --2- 172.21.15.123:0/328743788 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9ac406c4e0 0x7f9ac406e9a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9acc005950 tx=0x7f9acc005cf0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.538+0000 7f9ae29d9700 1 -- 172.21.15.123:0/328743788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9adc101770 msgr2=0x7f9adc0735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:24.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.538+0000 7f9ae29d9700 1 --2- 172.21.15.123:0/328743788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9adc101770 0x7f9adc0735d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00092e0 tx=0x7f9ad000be20 comp rx=0 tx=0).stop 2024-05-06T14:00:24.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.538+0000 7f9ae29d9700 1 -- 172.21.15.123:0/328743788 shutdown_connections 2024-05-06T14:00:24.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.538+0000 7f9ae29d9700 1 --2- 172.21.15.123:0/328743788 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9ac406c4e0 0x7f9ac406e9a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.538+0000 7f9ae29d9700 1 --2- 172.21.15.123:0/328743788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9adc100dc0 0x7f9adc073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.539+0000 7f9ae29d9700 1 --2- 172.21.15.123:0/328743788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9adc101770 0x7f9adc0735d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.539+0000 7f9ae29d9700 1 -- 172.21.15.123:0/328743788 >> 172.21.15.123:0/328743788 conn(0x7f9adc0fc650 msgr2=0x7f9adc0fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:24.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.539+0000 7f9ae29d9700 1 -- 172.21.15.123:0/328743788 shutdown_connections 2024-05-06T14:00:24.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.539+0000 7f9ae29d9700 1 -- 172.21.15.123:0/328743788 wait complete. 2024-05-06T14:00:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.711+0000 7fc88a49a700 1 -- 172.21.15.123:0/954698375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8840ff530 msgr2=0x7fc8840ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.711+0000 7fc88a49a700 1 --2- 172.21.15.123:0/954698375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8840ff530 0x7fc8840ff910 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc878009910 tx=0x7fc878009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.711+0000 7fc88a49a700 1 -- 172.21.15.123:0/954698375 shutdown_connections 2024-05-06T14:00:24.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.711+0000 7fc88a49a700 1 --2- 172.21.15.123:0/954698375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8840ffee0 0x7fc884105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.711+0000 7fc88a49a700 1 --2- 172.21.15.123:0/954698375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8840ff530 0x7fc8840ff910 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.711+0000 7fc88a49a700 1 -- 172.21.15.123:0/954698375 >> 172.21.15.123:0/954698375 conn(0x7fc884074d50 msgr2=0x7fc884075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:24.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.711+0000 7fc88a49a700 1 -- 172.21.15.123:0/954698375 shutdown_connections 2024-05-06T14:00:24.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.711+0000 7fc88a49a700 1 -- 172.21.15.123:0/954698375 wait complete. 2024-05-06T14:00:24.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.711+0000 7fc88a49a700 1 Processor -- start 2024-05-06T14:00:24.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc88a49a700 1 -- start start 2024-05-06T14:00:24.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc88a49a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8840ff530 0x7fc88419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:24.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc88a49a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8840ffee0 0x7fc88419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:24.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc88a49a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88419d1e0 con 0x7fc8840ffee0 2024-05-06T14:00:24.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc88a49a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc884196690 con 0x7fc8840ff530 2024-05-06T14:00:24.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc8837fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8840ffee0 0x7fc88419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:24.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc8837fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8840ffee0 0x7fc88419cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53550/0 (socket says 172.21.15.123:53550) 2024-05-06T14:00:24.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc8837fe700 1 -- 172.21.15.123:0/3666436902 learned_addr learned my addr 172.21.15.123:0/3666436902 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:24.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc883fff700 1 --2- 172.21.15.123:0/3666436902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8840ff530 0x7fc88419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:24.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc8837fe700 1 -- 172.21.15.123:0/3666436902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8840ff530 msgr2=0x7fc88419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:24.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc8837fe700 1 --2- 172.21.15.123:0/3666436902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8840ff530 0x7fc88419c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc8837fe700 1 -- 172.21.15.123:0/3666436902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8780095f0 con 0x7fc8840ffee0 2024-05-06T14:00:24.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.712+0000 7fc8837fe700 1 --2- 172.21.15.123:0/3666436902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8840ffee0 0x7fc88419cb50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc87400b4d0 tx=0x7fc87400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:24.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.713+0000 7fc8817fa700 1 -- 172.21.15.123:0/3666436902 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc874011800 con 0x7fc8840ffee0 2024-05-06T14:00:24.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.713+0000 7fc8817fa700 1 -- 172.21.15.123:0/3666436902 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc874011e10 con 0x7fc8840ffee0 2024-05-06T14:00:24.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.713+0000 7fc88a49a700 1 -- 172.21.15.123:0/3666436902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc884196970 con 0x7fc8840ffee0 2024-05-06T14:00:24.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.713+0000 7fc8817fa700 1 -- 172.21.15.123:0/3666436902 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc87400f2e0 con 0x7fc8840ffee0 2024-05-06T14:00:24.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.713+0000 7fc88a49a700 1 -- 172.21.15.123:0/3666436902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc884196ec0 con 0x7fc8840ffee0 2024-05-06T14:00:24.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.714+0000 7fc88a49a700 1 -- 172.21.15.123:0/3666436902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8841091a0 con 0x7fc8840ffee0 2024-05-06T14:00:24.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.714+0000 7fc8817fa700 1 -- 172.21.15.123:0/3666436902 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fc874011960 con 0x7fc8840ffee0 2024-05-06T14:00:24.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.714+0000 7fc8817fa700 1 --2- 172.21.15.123:0/3666436902 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc86c06c4e0 0x7fc86c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:24.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.715+0000 7fc8817fa700 1 -- 172.21.15.123:0/3666436902 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc87408b120 con 0x7fc8840ffee0 2024-05-06T14:00:24.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.715+0000 7fc883fff700 1 --2- 172.21.15.123:0/3666436902 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc86c06c4e0 0x7fc86c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:24.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.715+0000 7fc883fff700 1 --2- 172.21.15.123:0/3666436902 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc86c06c4e0 0x7fc86c06e9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc878000c00 tx=0x7fc878005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:24.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.719+0000 7fc8817fa700 1 -- 172.21.15.123:0/3666436902 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc8740596d0 con 0x7fc8840ffee0 2024-05-06T14:00:24.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.910+0000 7fc88a49a700 1 -- 172.21.15.123:0/3666436902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc88404ea90 con 0x7fc8840ffee0 2024-05-06T14:00:24.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.910+0000 7fc8817fa700 1 -- 172.21.15.123:0/3666436902 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc874059260 con 0x7fc8840ffee0 2024-05-06T14:00:24.911 INFO:teuthology.orchestra.run.smithi123.stdout:146028888080 2024-05-06T14:00:24.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.913+0000 7fc88a49a700 1 -- 172.21.15.123:0/3666436902 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc86c06c4e0 msgr2=0x7fc86c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:24.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.913+0000 7fc88a49a700 1 --2- 172.21.15.123:0/3666436902 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc86c06c4e0 0x7fc86c06e9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc878000c00 tx=0x7fc878005fb0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.913+0000 7fc88a49a700 1 -- 172.21.15.123:0/3666436902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8840ffee0 msgr2=0x7fc88419cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:24.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.913+0000 7fc88a49a700 1 --2- 172.21.15.123:0/3666436902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8840ffee0 0x7fc88419cb50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc87400b4d0 tx=0x7fc87400b890 comp rx=0 tx=0).stop 2024-05-06T14:00:24.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.913+0000 7fc88a49a700 1 -- 172.21.15.123:0/3666436902 shutdown_connections 2024-05-06T14:00:24.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.913+0000 7fc88a49a700 1 --2- 172.21.15.123:0/3666436902 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fc86c06c4e0 0x7fc86c06e9a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.913+0000 7fc88a49a700 1 --2- 172.21.15.123:0/3666436902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8840ff530 0x7fc88419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.913+0000 7fc88a49a700 1 --2- 172.21.15.123:0/3666436902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8840ffee0 0x7fc88419cb50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:24.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.913+0000 7fc88a49a700 1 -- 172.21.15.123:0/3666436902 >> 172.21.15.123:0/3666436902 conn(0x7fc884074d50 msgr2=0x7fc8840fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:24.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.913+0000 7fc88a49a700 1 -- 172.21.15.123:0/3666436902 shutdown_connections 2024-05-06T14:00:24.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:24.913+0000 7fc88a49a700 1 -- 172.21.15.123:0/3666436902 wait complete. 2024-05-06T14:00:25.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:25 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/328743788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-06T14:00:25.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:25 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/3666436902' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-06T14:00:25.592 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:25 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/328743788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-06T14:00:25.592 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:25 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3666436902' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-06T14:00:25.615 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542177 for osd.1 2024-05-06T14:00:25.615 DEBUG:teuthology.parallel:result is None 2024-05-06T14:00:25.776 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:26.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:26 smithi174 ceph-mon[35160]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:26.590 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:26 smithi123 ceph-mon[27254]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:26.611 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888079 got 146028888080 for osd.4 2024-05-06T14:00:26.612 DEBUG:teuthology.parallel:result is None 2024-05-06T14:00:26.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.809+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3936098081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ce00ffa70 msgr2=0x7f9ce00ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:26.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.809+0000 7f9ce7b8f700 1 --2- 172.21.15.123:0/3936098081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ce00ffa70 0x7f9ce00ffef0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009910 tx=0x7f9cd0009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:26.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.809+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3936098081 shutdown_connections 2024-05-06T14:00:26.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.809+0000 7f9ce7b8f700 1 --2- 172.21.15.123:0/3936098081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ce00ffa70 0x7f9ce00ffef0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:26.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.809+0000 7f9ce7b8f700 1 --2- 172.21.15.123:0/3936098081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce0105a70 0x7f9ce0105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:26.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.809+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3936098081 >> 172.21.15.123:0/3936098081 conn(0x7f9ce00fb560 msgr2=0x7f9ce00fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:26.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.809+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3936098081 shutdown_connections 2024-05-06T14:00:26.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.809+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3936098081 wait complete. 2024-05-06T14:00:26.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.809+0000 7f9ce7b8f700 1 Processor -- start 2024-05-06T14:00:26.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.809+0000 7f9ce7b8f700 1 -- start start 2024-05-06T14:00:26.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce7b8f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ce00ffa70 0x7f9ce01975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:26.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce7b8f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce0105a70 0x7f9ce0197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:26.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce7b8f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce01981f0 con 0x7f9ce00ffa70 2024-05-06T14:00:26.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce7b8f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce0198360 con 0x7f9ce0105a70 2024-05-06T14:00:26.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce592b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ce00ffa70 0x7f9ce01975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:26.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce592b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ce00ffa70 0x7f9ce01975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53578/0 (socket says 172.21.15.123:53578) 2024-05-06T14:00:26.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce592b700 1 -- 172.21.15.123:0/3297617436 learned_addr learned my addr 172.21.15.123:0/3297617436 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:26.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce512a700 1 --2- 172.21.15.123:0/3297617436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce0105a70 0x7f9ce0197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:26.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce592b700 1 -- 172.21.15.123:0/3297617436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce0105a70 msgr2=0x7f9ce0197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:26.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce592b700 1 --2- 172.21.15.123:0/3297617436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce0105a70 0x7f9ce0197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:26.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce592b700 1 -- 172.21.15.123:0/3297617436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00095f0 con 0x7f9ce00ffa70 2024-05-06T14:00:26.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce512a700 1 --2- 172.21.15.123:0/3297617436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce0105a70 0x7f9ce0197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T14:00:26.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce592b700 1 --2- 172.21.15.123:0/3297617436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ce00ffa70 0x7f9ce01975d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00d8d0 tx=0x7f9cdc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:26.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9cd6ffd700 1 -- 172.21.15.123:0/3297617436 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cdc009940 con 0x7f9ce00ffa70 2024-05-06T14:00:26.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9cd6ffd700 1 -- 172.21.15.123:0/3297617436 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9cdc010460 con 0x7f9ce00ffa70 2024-05-06T14:00:26.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3297617436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce01a0640 con 0x7f9ce00ffa70 2024-05-06T14:00:26.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9cd6ffd700 1 -- 172.21.15.123:0/3297617436 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cdc00f5f0 con 0x7f9ce00ffa70 2024-05-06T14:00:26.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.810+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3297617436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce01a0b90 con 0x7f9ce00ffa70 2024-05-06T14:00:26.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.811+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3297617436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce0108000 con 0x7f9ce00ffa70 2024-05-06T14:00:26.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.812+0000 7f9cd6ffd700 1 -- 172.21.15.123:0/3297617436 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f9cdc0105d0 con 0x7f9ce00ffa70 2024-05-06T14:00:26.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.812+0000 7f9cd6ffd700 1 --2- 172.21.15.123:0/3297617436 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9ccc06c4e0 0x7f9ccc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:26.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.812+0000 7f9ce512a700 1 --2- 172.21.15.123:0/3297617436 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9ccc06c4e0 0x7f9ccc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:26.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.812+0000 7f9cd6ffd700 1 -- 172.21.15.123:0/3297617436 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9cdc08b3f0 con 0x7f9ce00ffa70 2024-05-06T14:00:26.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.813+0000 7f9ce512a700 1 --2- 172.21.15.123:0/3297617436 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9ccc06c4e0 0x7f9ccc06e9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0069680 tx=0x7f9cd001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:26.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:26.817+0000 7f9cd6ffd700 1 -- 172.21.15.123:0/3297617436 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9cdc055f90 con 0x7f9ce00ffa70 2024-05-06T14:00:27.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.025+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3297617436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ce004ea90 con 0x7f9ce00ffa70 2024-05-06T14:00:27.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.025+0000 7f9cd6ffd700 1 -- 172.21.15.123:0/3297617436 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cdc08b070 con 0x7f9ce00ffa70 2024-05-06T14:00:27.026 INFO:teuthology.orchestra.run.smithi123.stdout:111669149719 2024-05-06T14:00:27.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.027+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3297617436 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9ccc06c4e0 msgr2=0x7f9ccc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:27.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.027+0000 7f9ce7b8f700 1 --2- 172.21.15.123:0/3297617436 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9ccc06c4e0 0x7f9ccc06e9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0069680 tx=0x7f9cd001a040 comp rx=0 tx=0).stop 2024-05-06T14:00:27.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.027+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3297617436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ce00ffa70 msgr2=0x7f9ce01975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:27.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.027+0000 7f9ce7b8f700 1 --2- 172.21.15.123:0/3297617436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ce00ffa70 0x7f9ce01975d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00d8d0 tx=0x7f9cdc00dc90 comp rx=0 tx=0).stop 2024-05-06T14:00:27.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.027+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3297617436 shutdown_connections 2024-05-06T14:00:27.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.027+0000 7f9ce7b8f700 1 --2- 172.21.15.123:0/3297617436 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f9ccc06c4e0 0x7f9ccc06e9a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:27.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.027+0000 7f9ce7b8f700 1 --2- 172.21.15.123:0/3297617436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ce00ffa70 0x7f9ce01975d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:27.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.027+0000 7f9ce7b8f700 1 --2- 172.21.15.123:0/3297617436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce0105a70 0x7f9ce0197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:27.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.027+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3297617436 >> 172.21.15.123:0/3297617436 conn(0x7f9ce00fb560 msgr2=0x7f9ce00fc010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:27.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.027+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3297617436 shutdown_connections 2024-05-06T14:00:27.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:27.027+0000 7f9ce7b8f700 1 -- 172.21.15.123:0/3297617436 wait complete. 2024-05-06T14:00:27.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:27 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/3297617436' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-06T14:00:27.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:27 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3297617436' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-06T14:00:27.796 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149717 got 111669149719 for osd.3 2024-05-06T14:00:27.797 DEBUG:teuthology.parallel:result is None 2024-05-06T14:00:28.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:28 smithi174 ceph-mon[35160]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:28.595 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:28 smithi123 ceph-mon[27254]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:29.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.706+0000 7f2880de7700 1 -- 172.21.15.123:0/2966117022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0ffbd0 msgr2=0x7f287c100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:29.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.706+0000 7f2880de7700 1 --2- 172.21.15.123:0/2966117022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0ffbd0 0x7f287c100050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2870009910 tx=0x7f2870009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:29.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.706+0000 7f2880de7700 1 -- 172.21.15.123:0/2966117022 shutdown_connections 2024-05-06T14:00:29.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.706+0000 7f2880de7700 1 --2- 172.21.15.123:0/2966117022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0ffbd0 0x7f287c100050 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:29.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.706+0000 7f2880de7700 1 --2- 172.21.15.123:0/2966117022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f287c105a40 0x7f287c105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:29.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.706+0000 7f2880de7700 1 -- 172.21.15.123:0/2966117022 >> 172.21.15.123:0/2966117022 conn(0x7f287c0755a0 msgr2=0x7f287c0759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:29.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.706+0000 7f2880de7700 1 -- 172.21.15.123:0/2966117022 shutdown_connections 2024-05-06T14:00:29.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.706+0000 7f2880de7700 1 -- 172.21.15.123:0/2966117022 wait complete. 2024-05-06T14:00:29.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f2880de7700 1 Processor -- start 2024-05-06T14:00:29.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f2880de7700 1 -- start start 2024-05-06T14:00:29.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f2880de7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0ffbd0 0x7f287c197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:29.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f2880de7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f287c105a40 0x7f287c197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:29.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f2880de7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c198170 con 0x7f287c0ffbd0 2024-05-06T14:00:29.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f2880de7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1982b0 con 0x7f287c105a40 2024-05-06T14:00:29.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f287a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0ffbd0 0x7f287c197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:29.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f287a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0ffbd0 0x7f287c197610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33852/0 (socket says 172.21.15.123:33852) 2024-05-06T14:00:29.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f287a59c700 1 -- 172.21.15.123:0/3789930509 learned_addr learned my addr 172.21.15.123:0/3789930509 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:29.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f2879d9b700 1 --2- 172.21.15.123:0/3789930509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f287c105a40 0x7f287c197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:29.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f287a59c700 1 -- 172.21.15.123:0/3789930509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f287c105a40 msgr2=0x7f287c197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:29.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f287a59c700 1 --2- 172.21.15.123:0/3789930509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f287c105a40 0x7f287c197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:29.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f287a59c700 1 -- 172.21.15.123:0/3789930509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700095f0 con 0x7f287c0ffbd0 2024-05-06T14:00:29.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.707+0000 7f2879d9b700 1 --2- 172.21.15.123:0/3789930509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f287c105a40 0x7f287c197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T14:00:29.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.708+0000 7f287a59c700 1 --2- 172.21.15.123:0/3789930509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0ffbd0 0x7f287c197610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f286c00b4b0 tx=0x7f286c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:29.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.708+0000 7f286b7fe700 1 -- 172.21.15.123:0/3789930509 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286c011800 con 0x7f287c0ffbd0 2024-05-06T14:00:29.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.708+0000 7f286b7fe700 1 -- 172.21.15.123:0/3789930509 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f286c011e10 con 0x7f287c0ffbd0 2024-05-06T14:00:29.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.708+0000 7f2880de7700 1 -- 172.21.15.123:0/3789930509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c1a0680 con 0x7f287c0ffbd0 2024-05-06T14:00:29.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.708+0000 7f286b7fe700 1 -- 172.21.15.123:0/3789930509 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286c00f2e0 con 0x7f287c0ffbd0 2024-05-06T14:00:29.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.708+0000 7f2880de7700 1 -- 172.21.15.123:0/3789930509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c1a0b40 con 0x7f287c0ffbd0 2024-05-06T14:00:29.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.709+0000 7f2880de7700 1 -- 172.21.15.123:0/3789930509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c108060 con 0x7f287c0ffbd0 2024-05-06T14:00:29.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.709+0000 7f286b7fe700 1 -- 172.21.15.123:0/3789930509 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f286c010380 con 0x7f287c0ffbd0 2024-05-06T14:00:29.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.710+0000 7f286b7fe700 1 --2- 172.21.15.123:0/3789930509 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f286406c4e0 0x7f286406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:29.347 INFO:teuthology.orchestra.run.smithi123.stdout:81604378652 2024-05-06T14:00:29.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.710+0000 7f2879d9b700 1 --2- 172.21.15.123:0/3789930509 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f286406c4e0 0x7f286406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:29.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.710+0000 7f286b7fe700 1 -- 172.21.15.123:0/3789930509 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f286c08b050 con 0x7f287c0ffbd0 2024-05-06T14:00:29.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.710+0000 7f2879d9b700 1 --2- 172.21.15.123:0/3789930509 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f286406c4e0 0x7f286406e9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f287c068cc0 tx=0x7f287000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:29.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.714+0000 7f286b7fe700 1 -- 172.21.15.123:0/3789930509 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f286c055ca0 con 0x7f287c0ffbd0 2024-05-06T14:00:29.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.909+0000 7f2880de7700 1 -- 172.21.15.123:0/3789930509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f287c04ea90 con 0x7f287c0ffbd0 2024-05-06T14:00:29.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.910+0000 7f286b7fe700 1 -- 172.21.15.123:0/3789930509 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f286c0592c0 con 0x7f287c0ffbd0 2024-05-06T14:00:29.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.912+0000 7f2880de7700 1 -- 172.21.15.123:0/3789930509 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f286406c4e0 msgr2=0x7f286406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:29.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.912+0000 7f2880de7700 1 --2- 172.21.15.123:0/3789930509 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f286406c4e0 0x7f286406e9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f287c068cc0 tx=0x7f287000b540 comp rx=0 tx=0).stop 2024-05-06T14:00:29.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.912+0000 7f2880de7700 1 -- 172.21.15.123:0/3789930509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0ffbd0 msgr2=0x7f287c197610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:29.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.912+0000 7f2880de7700 1 --2- 172.21.15.123:0/3789930509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0ffbd0 0x7f287c197610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f286c00b4b0 tx=0x7f286c00b870 comp rx=0 tx=0).stop 2024-05-06T14:00:29.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.912+0000 7f2880de7700 1 -- 172.21.15.123:0/3789930509 shutdown_connections 2024-05-06T14:00:29.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.912+0000 7f2880de7700 1 --2- 172.21.15.123:0/3789930509 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f286406c4e0 0x7f286406e9a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:29.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.912+0000 7f2880de7700 1 --2- 172.21.15.123:0/3789930509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f287c0ffbd0 0x7f287c197610 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:29.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.912+0000 7f2880de7700 1 --2- 172.21.15.123:0/3789930509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f287c105a40 0x7f287c197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:29.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.912+0000 7f2880de7700 1 -- 172.21.15.123:0/3789930509 >> 172.21.15.123:0/3789930509 conn(0x7f287c0755a0 msgr2=0x7f287c0fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:29.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.912+0000 7f2880de7700 1 -- 172.21.15.123:0/3789930509 shutdown_connections 2024-05-06T14:00:29.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:28.912+0000 7f2880de7700 1 -- 172.21.15.123:0/3789930509 wait complete. 2024-05-06T14:00:29.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:29 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/3789930509' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-06T14:00:29.587 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:29 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3789930509' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-06T14:00:29.933 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378650 got 81604378652 for osd.2 2024-05-06T14:00:29.933 DEBUG:teuthology.parallel:result is None 2024-05-06T14:00:30.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.122+0000 7fb1b55de700 1 -- 172.21.15.123:0/2401134005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1b0100dd0 msgr2=0x7fb1b01011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:30.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.122+0000 7fb1b55de700 1 --2- 172.21.15.123:0/2401134005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1b0100dd0 0x7fb1b01011b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009910 tx=0x7fb1a0009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:30.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.122+0000 7fb1b55de700 1 -- 172.21.15.123:0/2401134005 shutdown_connections 2024-05-06T14:00:30.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.122+0000 7fb1b55de700 1 --2- 172.21.15.123:0/2401134005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1b0101780 0x7fb1b01057d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:30.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.122+0000 7fb1b55de700 1 --2- 172.21.15.123:0/2401134005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1b0100dd0 0x7fb1b01011b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.122+0000 7fb1b55de700 1 -- 172.21.15.123:0/2401134005 >> 172.21.15.123:0/2401134005 conn(0x7fb1b00fc640 msgr2=0x7fb1b00fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.122+0000 7fb1b55de700 1 -- 172.21.15.123:0/2401134005 shutdown_connections 2024-05-06T14:00:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.122+0000 7fb1b55de700 1 -- 172.21.15.123:0/2401134005 wait complete. 2024-05-06T14:00:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.123+0000 7fb1b55de700 1 Processor -- start 2024-05-06T14:00:30.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.123+0000 7fb1b55de700 1 -- start start 2024-05-06T14:00:30.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.123+0000 7fb1b55de700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1b0100dd0 0x7fb1b0073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:30.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.123+0000 7fb1b55de700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1b0101780 0x7fb1b00735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:30.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.123+0000 7fb1b55de700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0073b10 con 0x7fb1b0101780 2024-05-06T14:00:30.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.123+0000 7fb1b55de700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0073c50 con 0x7fb1b0100dd0 2024-05-06T14:00:30.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.123+0000 7fb1ae7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1b0101780 0x7fb1b00735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:30.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.123+0000 7fb1ae7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1b0101780 0x7fb1b00735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33866/0 (socket says 172.21.15.123:33866) 2024-05-06T14:00:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.123+0000 7fb1ae7fc700 1 -- 172.21.15.123:0/2083627973 learned_addr learned my addr 172.21.15.123:0/2083627973 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.123+0000 7fb1aeffd700 1 --2- 172.21.15.123:0/2083627973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1b0100dd0 0x7fb1b0073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.124+0000 7fb1ae7fc700 1 -- 172.21.15.123:0/2083627973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1b0100dd0 msgr2=0x7fb1b0073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.124+0000 7fb1ae7fc700 1 --2- 172.21.15.123:0/2083627973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1b0100dd0 0x7fb1b0073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.124+0000 7fb1ae7fc700 1 -- 172.21.15.123:0/2083627973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00095f0 con 0x7fb1b0101780 2024-05-06T14:00:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.124+0000 7fb1ae7fc700 1 --2- 172.21.15.123:0/2083627973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1b0101780 0x7fb1b00735d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400b480 tx=0x7fb1a400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.124+0000 7fb197fff700 1 -- 172.21.15.123:0/2083627973 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a4011800 con 0x7fb1b0101780 2024-05-06T14:00:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.124+0000 7fb1b55de700 1 -- 172.21.15.123:0/2083627973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b01a29b0 con 0x7fb1b0101780 2024-05-06T14:00:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.124+0000 7fb197fff700 1 -- 172.21.15.123:0/2083627973 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb1a4011e10 con 0x7fb1b0101780 2024-05-06T14:00:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.124+0000 7fb197fff700 1 -- 172.21.15.123:0/2083627973 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a4010ea0 con 0x7fb1b0101780 2024-05-06T14:00:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.124+0000 7fb1b55de700 1 -- 172.21.15.123:0/2083627973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b01a2dc0 con 0x7fb1b0101780 2024-05-06T14:00:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.125+0000 7fb1b55de700 1 -- 172.21.15.123:0/2083627973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b0109170 con 0x7fb1b0101780 2024-05-06T14:00:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.125+0000 7fb197fff700 1 -- 172.21.15.123:0/2083627973 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fb1a4010380 con 0x7fb1b0101780 2024-05-06T14:00:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.126+0000 7fb197fff700 1 --2- 172.21.15.123:0/2083627973 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb19806c4e0 0x7fb19806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.126+0000 7fb197fff700 1 -- 172.21.15.123:0/2083627973 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb1a408b060 con 0x7fb1b0101780 2024-05-06T14:00:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.126+0000 7fb1aeffd700 1 --2- 172.21.15.123:0/2083627973 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb19806c4e0 0x7fb19806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.126+0000 7fb1aeffd700 1 --2- 172.21.15.123:0/2083627973 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb19806c4e0 0x7fb19806e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0006010 tx=0x7fb1a001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:30.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.130+0000 7fb197fff700 1 -- 172.21.15.123:0/2083627973 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb1a4055b80 con 0x7fb1b0101780 2024-05-06T14:00:30.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.321+0000 7fb1b55de700 1 -- 172.21.15.123:0/2083627973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb1b004ea90 con 0x7fb1b0101780 2024-05-06T14:00:30.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.321+0000 7fb197fff700 1 -- 172.21.15.123:0/2083627973 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1a40591a0 con 0x7fb1b0101780 2024-05-06T14:00:30.322 INFO:teuthology.orchestra.run.smithi123.stdout:167503724556 2024-05-06T14:00:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.323+0000 7fb1b55de700 1 -- 172.21.15.123:0/2083627973 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb19806c4e0 msgr2=0x7fb19806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.323+0000 7fb1b55de700 1 --2- 172.21.15.123:0/2083627973 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb19806c4e0 0x7fb19806e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0006010 tx=0x7fb1a001a040 comp rx=0 tx=0).stop 2024-05-06T14:00:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.323+0000 7fb1b55de700 1 -- 172.21.15.123:0/2083627973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1b0101780 msgr2=0x7fb1b00735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.323+0000 7fb1b55de700 1 --2- 172.21.15.123:0/2083627973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1b0101780 0x7fb1b00735d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400b480 tx=0x7fb1a400b790 comp rx=0 tx=0).stop 2024-05-06T14:00:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.323+0000 7fb1b55de700 1 -- 172.21.15.123:0/2083627973 shutdown_connections 2024-05-06T14:00:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.323+0000 7fb1b55de700 1 --2- 172.21.15.123:0/2083627973 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb19806c4e0 0x7fb19806e9a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.323+0000 7fb1b55de700 1 --2- 172.21.15.123:0/2083627973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1b0100dd0 0x7fb1b0073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.323+0000 7fb1b55de700 1 --2- 172.21.15.123:0/2083627973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1b0101780 0x7fb1b00735d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.323+0000 7fb1b55de700 1 -- 172.21.15.123:0/2083627973 >> 172.21.15.123:0/2083627973 conn(0x7fb1b00fc640 msgr2=0x7fb1b00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.323+0000 7fb1b55de700 1 -- 172.21.15.123:0/2083627973 shutdown_connections 2024-05-06T14:00:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:30.323+0000 7fb1b55de700 1 -- 172.21.15.123:0/2083627973 wait complete. 2024-05-06T14:00:30.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:30 smithi174 ceph-mon[35160]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:30.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:30 smithi123 ceph-mon[27254]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:30.973 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724554 got 167503724556 for osd.5 2024-05-06T14:00:30.973 DEBUG:teuthology.parallel:result is None 2024-05-06T14:00:30.973 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-06T14:00:30.973 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-06T14:00:31.176 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:31.503 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:31 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2083627973' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-06T14:00:31.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:31 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/2083627973' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-06T14:00:32.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:32 smithi174 ceph-mon[35160]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:32.534 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:32 smithi123 ceph-mon[27254]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:32.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.750+0000 7fb2b9474700 1 -- 172.21.15.123:0/4287545879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b4068670 msgr2=0x7fb2b4068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:32.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.750+0000 7fb2b9474700 1 --2- 172.21.15.123:0/4287545879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b4068670 0x7fb2b4068a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009910 tx=0x7fb2a4009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:32.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.750+0000 7fb2b9474700 1 -- 172.21.15.123:0/4287545879 shutdown_connections 2024-05-06T14:00:32.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.750+0000 7fb2b9474700 1 --2- 172.21.15.123:0/4287545879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2b4069020 0x7fb2b4105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:32.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.750+0000 7fb2b9474700 1 --2- 172.21.15.123:0/4287545879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b4068670 0x7fb2b4068a50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:32.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.750+0000 7fb2b9474700 1 -- 172.21.15.123:0/4287545879 >> 172.21.15.123:0/4287545879 conn(0x7fb2b40755a0 msgr2=0x7fb2b40759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:32.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.750+0000 7fb2b9474700 1 -- 172.21.15.123:0/4287545879 shutdown_connections 2024-05-06T14:00:32.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.750+0000 7fb2b9474700 1 -- 172.21.15.123:0/4287545879 wait complete. 2024-05-06T14:00:32.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.750+0000 7fb2b9474700 1 Processor -- start 2024-05-06T14:00:32.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2b9474700 1 -- start start 2024-05-06T14:00:32.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2b9474700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2b4068670 0x7fb2b419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:32.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2b9474700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b4069020 0x7fb2b419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:32.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2b9474700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b419d250 con 0x7fb2b4069020 2024-05-06T14:00:32.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2b9474700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4196700 con 0x7fb2b4068670 2024-05-06T14:00:32.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2aa7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b4069020 0x7fb2b419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:32.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2aa7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b4069020 0x7fb2b419cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33888/0 (socket says 172.21.15.123:33888) 2024-05-06T14:00:32.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2aa7fc700 1 -- 172.21.15.123:0/2706941977 learned_addr learned my addr 172.21.15.123:0/2706941977 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:32.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2aa7fc700 1 -- 172.21.15.123:0/2706941977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2b4068670 msgr2=0x7fb2b419c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:32.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2aa7fc700 1 --2- 172.21.15.123:0/2706941977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2b4068670 0x7fb2b419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:32.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2aa7fc700 1 -- 172.21.15.123:0/2706941977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40095f0 con 0x7fb2b4069020 2024-05-06T14:00:32.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2aa7fc700 1 --2- 172.21.15.123:0/2706941977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b4069020 0x7fb2b419cbc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00b480 tx=0x7fb29c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:32.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.751+0000 7fb2b0ff9700 1 -- 172.21.15.123:0/2706941977 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb29c0118c0 con 0x7fb2b4069020 2024-05-06T14:00:32.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.752+0000 7fb2b0ff9700 1 -- 172.21.15.123:0/2706941977 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb29c010380 con 0x7fb2b4069020 2024-05-06T14:00:32.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.752+0000 7fb2b9474700 1 -- 172.21.15.123:0/2706941977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b41969e0 con 0x7fb2b4069020 2024-05-06T14:00:32.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.752+0000 7fb2b0ff9700 1 -- 172.21.15.123:0/2706941977 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb29c00f4f0 con 0x7fb2b4069020 2024-05-06T14:00:32.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.752+0000 7fb2b9474700 1 -- 172.21.15.123:0/2706941977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b4196f30 con 0x7fb2b4069020 2024-05-06T14:00:32.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.753+0000 7fb2b9474700 1 -- 172.21.15.123:0/2706941977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b4109130 con 0x7fb2b4069020 2024-05-06T14:00:32.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.753+0000 7fb2b0ff9700 1 -- 172.21.15.123:0/2706941977 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fb29c0104f0 con 0x7fb2b4069020 2024-05-06T14:00:32.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.753+0000 7fb2b0ff9700 1 --2- 172.21.15.123:0/2706941977 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb2a006c4e0 0x7fb2a006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:32.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.754+0000 7fb2b0ff9700 1 -- 172.21.15.123:0/2706941977 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb29c08b060 con 0x7fb2b4069020 2024-05-06T14:00:32.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.754+0000 7fb2b2ffd700 1 --2- 172.21.15.123:0/2706941977 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb2a006c4e0 0x7fb2a006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:32.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.754+0000 7fb2b2ffd700 1 --2- 172.21.15.123:0/2706941977 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb2a006c4e0 0x7fb2a006e9a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400b5c0 tx=0x7fb2a4005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:32.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.758+0000 7fb2b0ff9700 1 -- 172.21.15.123:0/2706941977 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb29c059690 con 0x7fb2b4069020 2024-05-06T14:00:32.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.943+0000 7fb2b9474700 1 -- 172.21.15.123:0/2706941977 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2b4197200 con 0x7fb2a006c4e0 2024-05-06T14:00:32.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.944+0000 7fb2b0ff9700 1 -- 172.21.15.123:0/2706941977 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27899 (secure 0 0 0) 0x7fb2b4197200 con 0x7fb2a006c4e0 2024-05-06T14:00:32.946 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T14:00:32.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.947+0000 7fb2b9474700 1 -- 172.21.15.123:0/2706941977 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb2a006c4e0 msgr2=0x7fb2a006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:32.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.947+0000 7fb2b9474700 1 --2- 172.21.15.123:0/2706941977 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb2a006c4e0 0x7fb2a006e9a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400b5c0 tx=0x7fb2a4005960 comp rx=0 tx=0).stop 2024-05-06T14:00:32.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.947+0000 7fb2b9474700 1 -- 172.21.15.123:0/2706941977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b4069020 msgr2=0x7fb2b419cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:32.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.947+0000 7fb2b9474700 1 --2- 172.21.15.123:0/2706941977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b4069020 0x7fb2b419cbc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00b480 tx=0x7fb29c00b840 comp rx=0 tx=0).stop 2024-05-06T14:00:32.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.947+0000 7fb2b9474700 1 -- 172.21.15.123:0/2706941977 shutdown_connections 2024-05-06T14:00:32.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.947+0000 7fb2b9474700 1 --2- 172.21.15.123:0/2706941977 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb2a006c4e0 0x7fb2a006e9a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:32.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.947+0000 7fb2b9474700 1 --2- 172.21.15.123:0/2706941977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2b4068670 0x7fb2b419c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:32.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.947+0000 7fb2b9474700 1 --2- 172.21.15.123:0/2706941977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2b4069020 0x7fb2b419cbc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:32.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.947+0000 7fb2b9474700 1 -- 172.21.15.123:0/2706941977 >> 172.21.15.123:0/2706941977 conn(0x7fb2b40755a0 msgr2=0x7fb2b40fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:32.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.947+0000 7fb2b9474700 1 -- 172.21.15.123:0/2706941977 shutdown_connections 2024-05-06T14:00:32.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:32.947+0000 7fb2b9474700 1 -- 172.21.15.123:0/2706941977 wait complete. 2024-05-06T14:00:32.949 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-05-06T14:00:33.543 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-05-06T14:00:32.837593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001911"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-06T13:59:40.103447+0000","last_change":"2024-05-06T13:59:13.139868+0000","last_active":"2024-05-06T13:59:40.103447+0000","last_peered":"2024-05-06T13:59:40.103447+0000","last_clean":"2024-05-06T13:59:40.103447+0000","last_became_active":"2024-05-06T13:59:13.139551+0000","last_became_peered":"2024-05-06T13:59:13.139551+0000","last_unstale":"2024-05-06T13:59:40.103447+0000","last_undegraded":"2024-05-06T13:59:40.103447+0000","last_fullsized":"2024-05-06T13:59:40.103447+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T13:58:23.163596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T13:58:23.163596+0000","last_clean_scrub_stamp":"2024-05-06T13:58:23.163596+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T21:51:19.339468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 14:00:16 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.51900000000000002}]},{"osd":1,"last update":"Mon May 6 14:00:16 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.56399999999999995}]},{"osd":2,"last update":"Mon May 6 14:00:16 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.503},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.54100000000000004}]},{"osd":3,"last update":"Mon May 6 14:00:16 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.41499999999999998}]},{"osd":1,"last update":"Mon May 6 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.498},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":18.849,"5min":18.849,"15min":18.849},"last":0.443}]},{"osd":2,"last update":"Mon May 6 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.528,"15min":1.528},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":18.827000000000002,"5min":18.827000000000002,"15min":18.827000000000002},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.47699999999999998}]},{"osd":4,"last update":"Mon May 6 14:00:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 14:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35899999999999999,"15min":0.36399999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.47399999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.373,"15min":0.38100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.45400000000000001,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.32300000000000001}]},{"osd":1,"last update":"Mon May 6 14:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.38700000000000001,"15min":0.39300000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54900000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.309},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.39000000000000001,"15min":0.39900000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.53600000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.29699999999999999}]},{"osd":3,"last update":"Mon May 6 13:59:49 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.499},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.50800000000000001}]},{"osd":4,"last update":"Mon May 6 14:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 6 14:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32000000000000001,"15min":0.32100000000000001},"min":{"1min":0.23899999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.432,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33600000000000002,"15min":0.33700000000000002},"min":{"1min":0.25800000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.45500000000000002}]},{"osd":2,"last update":"Mon May 6 14:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35599999999999998,"15min":0.35999999999999999},"min":{"1min":0.245,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.28299999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.48399999999999999}]},{"osd":3,"last update":"Mon May 6 13:59:49 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.497}]},{"osd":4,"last update":"Mon May 6 14:00:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32400000000000001},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.38},{"interface":"front","average":{"1min":0.374,"5min":0.32700000000000001,"15min":0.31900000000000001},"min":{"1min":0.27300000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.33400000000000002}]},{"osd":2,"last update":"Mon May 6 14:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.45800000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.38900000000000001,"15min":0.39900000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.41699999999999998}]},{"osd":3,"last update":"Mon May 6 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.621}]},{"osd":4,"last update":"Mon May 6 14:00:13 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T14:00:33.544 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-06T14:00:33.748 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:34.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:34 smithi174 ceph-mon[35160]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:34.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:34 smithi174 ceph-mon[35160]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T14:00:34.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:34 smithi123 ceph-mon[27254]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:34.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:34 smithi123 ceph-mon[27254]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T14:00:35.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.333+0000 7fabb0810700 1 -- 172.21.15.123:0/3984633841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac1052c0 msgr2=0x7fabac1056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:35.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.333+0000 7fabb0810700 1 --2- 172.21.15.123:0/3984633841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac1052c0 0x7fabac1056a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009910 tx=0x7fab9c009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:35.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.333+0000 7fabb0810700 1 -- 172.21.15.123:0/3984633841 shutdown_connections 2024-05-06T14:00:35.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.333+0000 7fabb0810700 1 --2- 172.21.15.123:0/3984633841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabac0ff2b0 0x7fabac0ff710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.333+0000 7fabb0810700 1 --2- 172.21.15.123:0/3984633841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac1052c0 0x7fabac1056a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.333+0000 7fabb0810700 1 -- 172.21.15.123:0/3984633841 >> 172.21.15.123:0/3984633841 conn(0x7fabac074e00 msgr2=0x7fabac075210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.333+0000 7fabb0810700 1 -- 172.21.15.123:0/3984633841 shutdown_connections 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.333+0000 7fabb0810700 1 -- 172.21.15.123:0/3984633841 wait complete. 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.334+0000 7fabb0810700 1 Processor -- start 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.334+0000 7fabb0810700 1 -- start start 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.334+0000 7fabb0810700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac0ff2b0 0x7fabac100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.334+0000 7fabb0810700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabac1052c0 0x7fabac101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.334+0000 7fabb0810700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac1019b0 con 0x7fabac0ff2b0 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.334+0000 7fabb0810700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac101af0 con 0x7fabac1052c0 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.334+0000 7fabaa59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac0ff2b0 0x7fabac100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.334+0000 7fabaa59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac0ff2b0 0x7fabac100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33896/0 (socket says 172.21.15.123:33896) 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.335+0000 7fabaa59c700 1 -- 172.21.15.123:0/2128632679 learned_addr learned my addr 172.21.15.123:0/2128632679 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.335+0000 7faba9d9b700 1 --2- 172.21.15.123:0/2128632679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabac1052c0 0x7fabac101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:35.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.335+0000 7fabaa59c700 1 -- 172.21.15.123:0/2128632679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabac1052c0 msgr2=0x7fabac101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:35.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.335+0000 7fabaa59c700 1 --2- 172.21.15.123:0/2128632679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabac1052c0 0x7fabac101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:35.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.335+0000 7fabaa59c700 1 -- 172.21.15.123:0/2128632679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c0095f0 con 0x7fabac0ff2b0 2024-05-06T14:00:35.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.335+0000 7fabaa59c700 1 --2- 172.21.15.123:0/2128632679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac0ff2b0 0x7fabac100f30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fab9c006010 tx=0x7fab9c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.335+0000 7fab9b7fe700 1 -- 172.21.15.123:0/2128632679 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9c01d070 con 0x7fabac0ff2b0 2024-05-06T14:00:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.335+0000 7fabb0810700 1 -- 172.21.15.123:0/2128632679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac101d70 con 0x7fabac0ff2b0 2024-05-06T14:00:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.335+0000 7fab9b7fe700 1 -- 172.21.15.123:0/2128632679 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab9c00f460 con 0x7fabac0ff2b0 2024-05-06T14:00:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.335+0000 7fab9b7fe700 1 -- 172.21.15.123:0/2128632679 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9c017630 con 0x7fabac0ff2b0 2024-05-06T14:00:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.335+0000 7fabb0810700 1 -- 172.21.15.123:0/2128632679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac1a2c90 con 0x7fabac0ff2b0 2024-05-06T14:00:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.336+0000 7fabb0810700 1 -- 172.21.15.123:0/2128632679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac1047f0 con 0x7fabac0ff2b0 2024-05-06T14:00:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.337+0000 7fab9b7fe700 1 -- 172.21.15.123:0/2128632679 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fab9c003a60 con 0x7fabac0ff2b0 2024-05-06T14:00:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.337+0000 7fab9b7fe700 1 --2- 172.21.15.123:0/2128632679 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fab9406c4e0 0x7fab9406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.337+0000 7fab9b7fe700 1 -- 172.21.15.123:0/2128632679 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fab9c08c930 con 0x7fabac0ff2b0 2024-05-06T14:00:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.337+0000 7faba9d9b700 1 --2- 172.21.15.123:0/2128632679 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fab9406c4e0 0x7fab9406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.337+0000 7faba9d9b700 1 --2- 172.21.15.123:0/2128632679 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fab9406c4e0 0x7fab9406e9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fabac102720 tx=0x7faba000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.341+0000 7fab9b7fe700 1 -- 172.21.15.123:0/2128632679 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fab9c057450 con 0x7fabac0ff2b0 2024-05-06T14:00:35.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:00:35.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.527+0000 7fabb0810700 1 -- 172.21.15.123:0/2128632679 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabac02cce0 con 0x7fab9406c4e0 2024-05-06T14:00:35.528 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:00:35.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.529+0000 7fab9b7fe700 1 -- 172.21.15.123:0/2128632679 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27884 (secure 0 0 0) 0x7fabac02cce0 con 0x7fab9406c4e0 2024-05-06T14:00:35.532 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T14:00:35.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.531+0000 7fabb0810700 1 -- 172.21.15.123:0/2128632679 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fab9406c4e0 msgr2=0x7fab9406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:35.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.531+0000 7fabb0810700 1 --2- 172.21.15.123:0/2128632679 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fab9406c4e0 0x7fab9406e9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fabac102720 tx=0x7faba000b410 comp rx=0 tx=0).stop 2024-05-06T14:00:35.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.531+0000 7fabb0810700 1 -- 172.21.15.123:0/2128632679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac0ff2b0 msgr2=0x7fabac100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:35.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.531+0000 7fabb0810700 1 --2- 172.21.15.123:0/2128632679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac0ff2b0 0x7fabac100f30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fab9c006010 tx=0x7fab9c00bd70 comp rx=0 tx=0).stop 2024-05-06T14:00:35.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.531+0000 7fabb0810700 1 -- 172.21.15.123:0/2128632679 shutdown_connections 2024-05-06T14:00:35.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.531+0000 7fabb0810700 1 --2- 172.21.15.123:0/2128632679 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fab9406c4e0 0x7fab9406e9a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:35.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.531+0000 7fabb0810700 1 --2- 172.21.15.123:0/2128632679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac0ff2b0 0x7fabac100f30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:35.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.531+0000 7fabb0810700 1 --2- 172.21.15.123:0/2128632679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabac1052c0 0x7fabac101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:35.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.531+0000 7fabb0810700 1 -- 172.21.15.123:0/2128632679 >> 172.21.15.123:0/2128632679 conn(0x7fabac074e00 msgr2=0x7fabac10d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:35.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.531+0000 7fabb0810700 1 -- 172.21.15.123:0/2128632679 shutdown_connections 2024-05-06T14:00:35.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:35.531+0000 7fabb0810700 1 -- 172.21.15.123:0/2128632679 wait complete. 2024-05-06T14:00:35.534 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-05-06T14:00:36.115 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-05-06T14:00:34.837889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001907"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-06T13:59:40.103447+0000","last_change":"2024-05-06T13:59:13.139868+0000","last_active":"2024-05-06T13:59:40.103447+0000","last_peered":"2024-05-06T13:59:40.103447+0000","last_clean":"2024-05-06T13:59:40.103447+0000","last_became_active":"2024-05-06T13:59:13.139551+0000","last_became_peered":"2024-05-06T13:59:13.139551+0000","last_unstale":"2024-05-06T13:59:40.103447+0000","last_undegraded":"2024-05-06T13:59:40.103447+0000","last_fullsized":"2024-05-06T13:59:40.103447+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T13:58:23.163596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T13:58:23.163596+0000","last_clean_scrub_stamp":"2024-05-06T13:58:23.163596+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T21:51:19.339468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 14:00:16 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.60399999999999998}]},{"osd":1,"last update":"Mon May 6 14:00:16 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.58799999999999997}]},{"osd":2,"last update":"Mon May 6 14:00:16 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.64500000000000002}]},{"osd":3,"last update":"Mon May 6 14:00:16 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":3,"up_from":26,"seq":111669149721,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.432}]},{"osd":1,"last update":"Mon May 6 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":18.849,"5min":18.849,"15min":18.849},"last":0.46700000000000003}]},{"osd":2,"last update":"Mon May 6 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.528,"15min":1.528},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":18.827000000000002,"5min":18.827000000000002,"15min":18.827000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44600000000000001}]},{"osd":4,"last update":"Mon May 6 14:00:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.318},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.33700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 14:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35899999999999999,"15min":0.36399999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.47399999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.373,"15min":0.38100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.45400000000000001,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.39000000000000001}]},{"osd":1,"last update":"Mon May 6 14:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.38700000000000001,"15min":0.39300000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54900000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.377},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.39000000000000001,"15min":0.39900000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.53600000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.36599999999999999}]},{"osd":3,"last update":"Mon May 6 13:59:49 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60399999999999998}]},{"osd":4,"last update":"Mon May 6 14:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 6 14:00:01 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32000000000000001,"15min":0.32100000000000001},"min":{"1min":0.23899999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.432,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33600000000000002,"15min":0.33700000000000002},"min":{"1min":0.25800000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.28399999999999997}]},{"osd":2,"last update":"Mon May 6 14:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35599999999999998,"15min":0.35999999999999999},"min":{"1min":0.245,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.28299999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.33100000000000002}]},{"osd":3,"last update":"Mon May 6 13:59:49 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36699999999999999}]},{"osd":4,"last update":"Mon May 6 14:00:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.432},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32400000000000001},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.38},{"interface":"front","average":{"1min":0.374,"5min":0.32700000000000001,"15min":0.31900000000000001},"min":{"1min":0.27300000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.33400000000000002}]},{"osd":2,"last update":"Mon May 6 14:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.45800000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.38900000000000001,"15min":0.39900000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.41699999999999998}]},{"osd":3,"last update":"Mon May 6 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.621}]},{"osd":4,"last update":"Mon May 6 14:00:13 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T14:00:36.117 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-06T14:00:36.117 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-06T14:00:36.117 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-06T14:00:36.117 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-06T14:00:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:36.397 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:36 smithi123 ceph-mon[27254]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:36.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:36 smithi174 ceph-mon[35160]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:37.425 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:37 smithi123 ceph-mon[27254]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T14:00:37.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:37 smithi174 ceph-mon[35160]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T14:00:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.902+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/359122134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b880ffa40 msgr2=0x7f4b880ffec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.902+0000 7f4b8d4f8700 1 --2- 172.21.15.123:0/359122134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b880ffa40 0x7f4b880ffec0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009910 tx=0x7f4b70009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.902+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/359122134 shutdown_connections 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.902+0000 7f4b8d4f8700 1 --2- 172.21.15.123:0/359122134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b880ffa40 0x7f4b880ffec0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.902+0000 7f4b8d4f8700 1 --2- 172.21.15.123:0/359122134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b88105a40 0x7f4b88105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.902+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/359122134 >> 172.21.15.123:0/359122134 conn(0x7f4b880fb570 msgr2=0x7f4b880fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.902+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/359122134 shutdown_connections 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.902+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/359122134 wait complete. 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.902+0000 7f4b8d4f8700 1 Processor -- start 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b8d4f8700 1 -- start start 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b8d4f8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b880ffa40 0x7f4b88197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b8d4f8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b88105a40 0x7f4b88197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b8d4f8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b881980d0 con 0x7f4b880ffa40 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b8d4f8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88198240 con 0x7f4b88105a40 2024-05-06T14:00:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b86ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b880ffa40 0x7f4b88197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b86ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b880ffa40 0x7f4b88197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42562/0 (socket says 172.21.15.123:42562) 2024-05-06T14:00:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b86ffd700 1 -- 172.21.15.123:0/3080260501 learned_addr learned my addr 172.21.15.123:0/3080260501 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b7e7fc700 1 --2- 172.21.15.123:0/3080260501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b88105a40 0x7f4b88197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b86ffd700 1 -- 172.21.15.123:0/3080260501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b88105a40 msgr2=0x7f4b88197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b86ffd700 1 --2- 172.21.15.123:0/3080260501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b88105a40 0x7f4b88197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b86ffd700 1 -- 172.21.15.123:0/3080260501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b700095f0 con 0x7f4b880ffa40 2024-05-06T14:00:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b86ffd700 1 --2- 172.21.15.123:0/3080260501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b880ffa40 0x7f4b88197570 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800d8d0 tx=0x7f4b7800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.903+0000 7f4b84ff9700 1 -- 172.21.15.123:0/3080260501 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b780098a0 con 0x7f4b880ffa40 2024-05-06T14:00:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.904+0000 7f4b84ff9700 1 -- 172.21.15.123:0/3080260501 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b78010460 con 0x7f4b880ffa40 2024-05-06T14:00:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.904+0000 7f4b84ff9700 1 -- 172.21.15.123:0/3080260501 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b7800f5f0 con 0x7f4b880ffa40 2024-05-06T14:00:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.904+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/3080260501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b881a05e0 con 0x7f4b880ffa40 2024-05-06T14:00:37.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.904+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/3080260501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b881a0ad0 con 0x7f4b880ffa40 2024-05-06T14:00:37.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.905+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/3080260501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b88107fd0 con 0x7f4b880ffa40 2024-05-06T14:00:37.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.905+0000 7f4b84ff9700 1 -- 172.21.15.123:0/3080260501 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f4b78009a00 con 0x7f4b880ffa40 2024-05-06T14:00:37.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.906+0000 7f4b84ff9700 1 --2- 172.21.15.123:0/3080260501 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f4b7406c4e0 0x7f4b7406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:37.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.906+0000 7f4b84ff9700 1 -- 172.21.15.123:0/3080260501 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f4b7808b2f0 con 0x7f4b880ffa40 2024-05-06T14:00:37.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.906+0000 7f4b7e7fc700 1 --2- 172.21.15.123:0/3080260501 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f4b7406c4e0 0x7f4b7406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:37.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.906+0000 7f4b7e7fc700 1 --2- 172.21.15.123:0/3080260501 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f4b7406c4e0 0x7f4b7406e9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b88069570 tx=0x7f4b7001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:37.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:37.910+0000 7f4b84ff9700 1 -- 172.21.15.123:0/3080260501 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4b78055e90 con 0x7f4b880ffa40 2024-05-06T14:00:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.141+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/3080260501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4b8804ea90 con 0x7f4b880ffa40 2024-05-06T14:00:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.142+0000 7f4b84ff9700 1 -- 172.21.15.123:0/3080260501 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4b780594b0 con 0x7f4b880ffa40 2024-05-06T14:00:38.143 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T14:00:38.143 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-06T14:00:38.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.144+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/3080260501 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f4b7406c4e0 msgr2=0x7f4b7406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:38.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.144+0000 7f4b8d4f8700 1 --2- 172.21.15.123:0/3080260501 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f4b7406c4e0 0x7f4b7406e9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b88069570 tx=0x7f4b7001a040 comp rx=0 tx=0).stop 2024-05-06T14:00:38.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.144+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/3080260501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b880ffa40 msgr2=0x7f4b88197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:38.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.144+0000 7f4b8d4f8700 1 --2- 172.21.15.123:0/3080260501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b880ffa40 0x7f4b88197570 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800d8d0 tx=0x7f4b7800dbe0 comp rx=0 tx=0).stop 2024-05-06T14:00:38.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.144+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/3080260501 shutdown_connections 2024-05-06T14:00:38.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.144+0000 7f4b8d4f8700 1 --2- 172.21.15.123:0/3080260501 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f4b7406c4e0 0x7f4b7406e9a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:38.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.144+0000 7f4b8d4f8700 1 --2- 172.21.15.123:0/3080260501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b880ffa40 0x7f4b88197570 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:38.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.144+0000 7f4b8d4f8700 1 --2- 172.21.15.123:0/3080260501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b88105a40 0x7f4b88197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:38.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.144+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/3080260501 >> 172.21.15.123:0/3080260501 conn(0x7f4b880fb570 msgr2=0x7f4b880fc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:38.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.144+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/3080260501 shutdown_connections 2024-05-06T14:00:38.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:38.144+0000 7f4b8d4f8700 1 -- 172.21.15.123:0/3080260501 wait complete. 2024-05-06T14:00:38.467 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:38 smithi123 ceph-mon[27254]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:38.467 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:38 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3080260501' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-06T14:00:38.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:38 smithi174 ceph-mon[35160]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:38.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:38 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/3080260501' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-06T14:00:38.782 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-06T14:00:38.782 INFO:tasks.cephadm:Setup complete, yielding 2024-05-06T14:00:38.782 INFO:teuthology.run_tasks:Running task print... 2024-05-06T14:00:38.792 INFO:teuthology.task.print:**** done end installing v18.2.1 cephadm ... 2024-05-06T14:00:38.792 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T14:00:38.824 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-05-06T14:00:38.825 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-05-06T14:00:39.033 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:40.434 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:40 smithi123 ceph-mon[27254]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:40.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:40 smithi174 ceph-mon[35160]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:40.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.730+0000 7ff57d723700 1 -- 172.21.15.123:0/2086125392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff578101db0 msgr2=0x7ff578102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:40.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.730+0000 7ff57d723700 1 --2- 172.21.15.123:0/2086125392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff578101db0 0x7ff578102210 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff560009910 tx=0x7ff560009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:40.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.730+0000 7ff57d723700 1 -- 172.21.15.123:0/2086125392 shutdown_connections 2024-05-06T14:00:40.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.730+0000 7ff57d723700 1 --2- 172.21.15.123:0/2086125392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff578101db0 0x7ff578102210 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:40.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.730+0000 7ff57d723700 1 --2- 172.21.15.123:0/2086125392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff578100bb0 0x7ff578100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:40.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.730+0000 7ff57d723700 1 -- 172.21.15.123:0/2086125392 >> 172.21.15.123:0/2086125392 conn(0x7ff5780fc110 msgr2=0x7ff5780fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:40.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.730+0000 7ff57d723700 1 -- 172.21.15.123:0/2086125392 shutdown_connections 2024-05-06T14:00:40.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.730+0000 7ff57d723700 1 -- 172.21.15.123:0/2086125392 wait complete. 2024-05-06T14:00:40.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff57d723700 1 Processor -- start 2024-05-06T14:00:40.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff57d723700 1 -- start start 2024-05-06T14:00:40.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff57d723700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff578100bb0 0x7ff578196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:40.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff57d723700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff578101db0 0x7ff5781969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:40.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff57d723700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff578196fe0 con 0x7ff578100bb0 2024-05-06T14:00:40.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff57d723700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff578197120 con 0x7ff578101db0 2024-05-06T14:00:40.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff576ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff578100bb0 0x7ff578196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:40.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff576ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff578100bb0 0x7ff578196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42582/0 (socket says 172.21.15.123:42582) 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff576ffd700 1 -- 172.21.15.123:0/3590942146 learned_addr learned my addr 172.21.15.123:0/3590942146 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff56ffff700 1 --2- 172.21.15.123:0/3590942146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff578101db0 0x7ff5781969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff576ffd700 1 -- 172.21.15.123:0/3590942146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff578101db0 msgr2=0x7ff5781969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff576ffd700 1 --2- 172.21.15.123:0/3590942146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff578101db0 0x7ff5781969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff576ffd700 1 -- 172.21.15.123:0/3590942146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5600095f0 con 0x7ff578100bb0 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff56ffff700 1 --2- 172.21.15.123:0/3590942146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff578101db0 0x7ff5781969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff576ffd700 1 --2- 172.21.15.123:0/3590942146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff578100bb0 0x7ff578196480 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff56800b480 tx=0x7ff56800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff574ff9700 1 -- 172.21.15.123:0/3590942146 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5680118c0 con 0x7ff578100bb0 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff574ff9700 1 -- 172.21.15.123:0/3590942146 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff568010380 con 0x7ff578100bb0 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.731+0000 7ff57d723700 1 -- 172.21.15.123:0/3590942146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57819bbd0 con 0x7ff578100bb0 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.732+0000 7ff574ff9700 1 -- 172.21.15.123:0/3590942146 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff56800f4f0 con 0x7ff578100bb0 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.732+0000 7ff57d723700 1 -- 172.21.15.123:0/3590942146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57819c120 con 0x7ff578100bb0 2024-05-06T14:00:40.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.732+0000 7ff57d723700 1 -- 172.21.15.123:0/3590942146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5781097b0 con 0x7ff578100bb0 2024-05-06T14:00:40.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.733+0000 7ff574ff9700 1 -- 172.21.15.123:0/3590942146 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7ff5680104f0 con 0x7ff578100bb0 2024-05-06T14:00:40.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.733+0000 7ff574ff9700 1 --2- 172.21.15.123:0/3590942146 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff56406c4e0 0x7ff56406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:40.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.733+0000 7ff574ff9700 1 -- 172.21.15.123:0/3590942146 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff56808b110 con 0x7ff578100bb0 2024-05-06T14:00:40.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.733+0000 7ff56ffff700 1 --2- 172.21.15.123:0/3590942146 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff56406c4e0 0x7ff56406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:40.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.734+0000 7ff56ffff700 1 --2- 172.21.15.123:0/3590942146 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff56406c4e0 0x7ff56406e9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff560005090 tx=0x7ff56000b560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:40.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.738+0000 7ff574ff9700 1 -- 172.21.15.123:0/3590942146 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff5680596c0 con 0x7ff578100bb0 2024-05-06T14:00:40.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.927+0000 7ff57d723700 1 -- 172.21.15.123:0/3590942146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7ff578109970 con 0x7ff578100bb0 2024-05-06T14:00:40.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.933+0000 7ff574ff9700 1 -- 172.21.15.123:0/3590942146 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7ff568059250 con 0x7ff578100bb0 2024-05-06T14:00:40.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.936+0000 7ff57d723700 1 -- 172.21.15.123:0/3590942146 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff56406c4e0 msgr2=0x7ff56406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:40.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.936+0000 7ff57d723700 1 --2- 172.21.15.123:0/3590942146 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff56406c4e0 0x7ff56406e9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff560005090 tx=0x7ff56000b560 comp rx=0 tx=0).stop 2024-05-06T14:00:40.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.936+0000 7ff57d723700 1 -- 172.21.15.123:0/3590942146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff578100bb0 msgr2=0x7ff578196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:40.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.936+0000 7ff57d723700 1 --2- 172.21.15.123:0/3590942146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff578100bb0 0x7ff578196480 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff56800b480 tx=0x7ff56800b840 comp rx=0 tx=0).stop 2024-05-06T14:00:40.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.936+0000 7ff57d723700 1 -- 172.21.15.123:0/3590942146 shutdown_connections 2024-05-06T14:00:40.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.936+0000 7ff57d723700 1 --2- 172.21.15.123:0/3590942146 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7ff56406c4e0 0x7ff56406e9a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:40.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.936+0000 7ff57d723700 1 --2- 172.21.15.123:0/3590942146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff578100bb0 0x7ff578196480 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:40.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.936+0000 7ff57d723700 1 --2- 172.21.15.123:0/3590942146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff578101db0 0x7ff5781969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:40.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.936+0000 7ff57d723700 1 -- 172.21.15.123:0/3590942146 >> 172.21.15.123:0/3590942146 conn(0x7ff5780fc110 msgr2=0x7ff578104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:40.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.936+0000 7ff57d723700 1 -- 172.21.15.123:0/3590942146 shutdown_connections 2024-05-06T14:00:40.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:40.936+0000 7ff57d723700 1 -- 172.21.15.123:0/3590942146 wait complete. 2024-05-06T14:00:41.668 INFO:teuthology.run_tasks:Running task print... 2024-05-06T14:00:41.678 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-05-06T14:00:41.678 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T14:00:41.718 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-05-06T14:00:41.718 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-06T14:00:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:42.185 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:41 smithi123 ceph-mon[27254]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:42.186 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:41 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3590942146' entity='client.admin' 2024-05-06T14:00:42.186 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T14:00:42.186 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:00:42.186 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T14:00:42.186 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:41 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:00:42.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:41 smithi174 ceph-mon[35160]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:42.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:41 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/3590942146' entity='client.admin' 2024-05-06T14:00:42.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T14:00:42.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:00:42.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T14:00:42.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:41 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:00:43.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.564+0000 7efee1a6a700 1 -- 172.21.15.123:0/4005071324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0feeb0 msgr2=0x7efedc0ff2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:43.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.564+0000 7efee1a6a700 1 --2- 172.21.15.123:0/4005071324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0feeb0 0x7efedc0ff2d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efecc009910 tx=0x7efecc009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:43.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.565+0000 7efee1a6a700 1 -- 172.21.15.123:0/4005071324 shutdown_connections 2024-05-06T14:00:43.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.565+0000 7efee1a6a700 1 --2- 172.21.15.123:0/4005071324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efedc101f30 0x7efedc102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:43.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.565+0000 7efee1a6a700 1 --2- 172.21.15.123:0/4005071324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0feeb0 0x7efedc0ff2d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:43.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.565+0000 7efee1a6a700 1 -- 172.21.15.123:0/4005071324 >> 172.21.15.123:0/4005071324 conn(0x7efedc0fa7f0 msgr2=0x7efedc0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:43.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.565+0000 7efee1a6a700 1 -- 172.21.15.123:0/4005071324 shutdown_connections 2024-05-06T14:00:43.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.565+0000 7efee1a6a700 1 -- 172.21.15.123:0/4005071324 wait complete. 2024-05-06T14:00:43.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.565+0000 7efee1a6a700 1 Processor -- start 2024-05-06T14:00:43.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.565+0000 7efee1a6a700 1 -- start start 2024-05-06T14:00:43.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.565+0000 7efee1a6a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efedc0feeb0 0x7efedc198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:43.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.565+0000 7efee1a6a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc101f30 0x7efedc198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:43.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.565+0000 7efee1a6a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc199080 con 0x7efedc101f30 2024-05-06T14:00:43.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.565+0000 7efee1a6a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc1991c0 con 0x7efedc0feeb0 2024-05-06T14:00:43.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efed3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc101f30 0x7efedc198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:43.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efed3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc101f30 0x7efedc198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42604/0 (socket says 172.21.15.123:42604) 2024-05-06T14:00:43.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efed3fff700 1 -- 172.21.15.123:0/3546518524 learned_addr learned my addr 172.21.15.123:0/3546518524 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:43.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efedb7fe700 1 --2- 172.21.15.123:0/3546518524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efedc0feeb0 0x7efedc198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:43.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efed3fff700 1 -- 172.21.15.123:0/3546518524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efedc0feeb0 msgr2=0x7efedc198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:43.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efed3fff700 1 --2- 172.21.15.123:0/3546518524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efedc0feeb0 0x7efedc198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:43.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efed3fff700 1 -- 172.21.15.123:0/3546518524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0095f0 con 0x7efedc101f30 2024-05-06T14:00:43.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efed3fff700 1 --2- 172.21.15.123:0/3546518524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc101f30 0x7efedc198a60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efec400c8a0 tx=0x7efec400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:43.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efed97fa700 1 -- 172.21.15.123:0/3546518524 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efec400cea0 con 0x7efedc101f30 2024-05-06T14:00:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efee1a6a700 1 -- 172.21.15.123:0/3546518524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efedc19dc70 con 0x7efedc101f30 2024-05-06T14:00:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efed97fa700 1 -- 172.21.15.123:0/3546518524 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efec4004830 con 0x7efedc101f30 2024-05-06T14:00:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efed97fa700 1 -- 172.21.15.123:0/3546518524 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efec40055b0 con 0x7efedc101f30 2024-05-06T14:00:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.566+0000 7efee1a6a700 1 -- 172.21.15.123:0/3546518524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efedc19e1c0 con 0x7efedc101f30 2024-05-06T14:00:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.567+0000 7efee1a6a700 1 -- 172.21.15.123:0/3546518524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efedc106010 con 0x7efedc101f30 2024-05-06T14:00:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.568+0000 7efed97fa700 1 -- 172.21.15.123:0/3546518524 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7efec4007ad0 con 0x7efedc101f30 2024-05-06T14:00:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.568+0000 7efed97fa700 1 --2- 172.21.15.123:0/3546518524 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7efec806c4e0 0x7efec806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.568+0000 7efed97fa700 1 -- 172.21.15.123:0/3546518524 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7efec408b230 con 0x7efedc101f30 2024-05-06T14:00:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.568+0000 7efedb7fe700 1 --2- 172.21.15.123:0/3546518524 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7efec806c4e0 0x7efec806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.568+0000 7efedb7fe700 1 --2- 172.21.15.123:0/3546518524 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7efec806c4e0 0x7efec806e9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efecc006010 tx=0x7efecc005920 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.572+0000 7efed97fa700 1 -- 172.21.15.123:0/3546518524 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7efec40597e0 con 0x7efedc101f30 2024-05-06T14:00:43.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.778+0000 7efee1a6a700 1 -- 172.21.15.123:0/3546518524 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7efedc0611d0 con 0x7efec806c4e0 2024-05-06T14:00:43.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.779+0000 7efed97fa700 1 -- 172.21.15.123:0/3546518524 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7efedc0611d0 con 0x7efec806c4e0 2024-05-06T14:00:43.781 INFO:teuthology.orchestra.run.smithi123.stdout:Backend: cephadm 2024-05-06T14:00:43.781 INFO:teuthology.orchestra.run.smithi123.stdout:Available: Yes 2024-05-06T14:00:43.781 INFO:teuthology.orchestra.run.smithi123.stdout:Paused: No 2024-05-06T14:00:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.781+0000 7efee1a6a700 1 -- 172.21.15.123:0/3546518524 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7efec806c4e0 msgr2=0x7efec806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.781+0000 7efee1a6a700 1 --2- 172.21.15.123:0/3546518524 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7efec806c4e0 0x7efec806e9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efecc006010 tx=0x7efecc005920 comp rx=0 tx=0).stop 2024-05-06T14:00:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.781+0000 7efee1a6a700 1 -- 172.21.15.123:0/3546518524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc101f30 msgr2=0x7efedc198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.781+0000 7efee1a6a700 1 --2- 172.21.15.123:0/3546518524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc101f30 0x7efedc198a60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efec400c8a0 tx=0x7efec400cc60 comp rx=0 tx=0).stop 2024-05-06T14:00:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.781+0000 7efee1a6a700 1 -- 172.21.15.123:0/3546518524 shutdown_connections 2024-05-06T14:00:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.781+0000 7efee1a6a700 1 --2- 172.21.15.123:0/3546518524 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7efec806c4e0 0x7efec806e9a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.781+0000 7efee1a6a700 1 --2- 172.21.15.123:0/3546518524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efedc0feeb0 0x7efedc198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.781+0000 7efee1a6a700 1 --2- 172.21.15.123:0/3546518524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc101f30 0x7efedc198a60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.781+0000 7efee1a6a700 1 -- 172.21.15.123:0/3546518524 >> 172.21.15.123:0/3546518524 conn(0x7efedc0fa7f0 msgr2=0x7efedc103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.781+0000 7efee1a6a700 1 -- 172.21.15.123:0/3546518524 shutdown_connections 2024-05-06T14:00:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:43.781+0000 7efee1a6a700 1 -- 172.21.15.123:0/3546518524 wait complete. 2024-05-06T14:00:44.061 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:43 smithi123 ceph-mon[27254]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:44.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:43 smithi174 ceph-mon[35160]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:44.364 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-06T14:00:44.567 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:44.964 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:44 smithi123 ceph-mon[27254]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:00:45.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:44 smithi174 ceph-mon[35160]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:00:46.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.171+0000 7f794f455700 1 -- 172.21.15.123:0/1051885852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79480ffab0 msgr2=0x7f79480ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.171+0000 7f794f455700 1 --2- 172.21.15.123:0/1051885852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79480ffab0 0x7f79480ffed0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7938009910 tx=0x7f7938009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794f455700 1 -- 172.21.15.123:0/1051885852 shutdown_connections 2024-05-06T14:00:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794f455700 1 --2- 172.21.15.123:0/1051885852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7948100cb0 0x7f7948101110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794f455700 1 --2- 172.21.15.123:0/1051885852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79480ffab0 0x7f79480ffed0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794f455700 1 -- 172.21.15.123:0/1051885852 >> 172.21.15.123:0/1051885852 conn(0x7f79480fb030 msgr2=0x7f79480fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:46.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794f455700 1 -- 172.21.15.123:0/1051885852 shutdown_connections 2024-05-06T14:00:46.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794f455700 1 -- 172.21.15.123:0/1051885852 wait complete. 2024-05-06T14:00:46.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794f455700 1 Processor -- start 2024-05-06T14:00:46.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794f455700 1 -- start start 2024-05-06T14:00:46.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794f455700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79480ffab0 0x7f7948107a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:46.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794f455700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7948100cb0 0x7f79481060b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:46.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794f455700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79481065f0 con 0x7f79480ffab0 2024-05-06T14:00:46.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794f455700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7948106730 con 0x7f7948100cb0 2024-05-06T14:00:46.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794d1f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79480ffab0 0x7f7948107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:46.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794d1f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79480ffab0 0x7f7948107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42624/0 (socket says 172.21.15.123:42624) 2024-05-06T14:00:46.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.172+0000 7f794d1f1700 1 -- 172.21.15.123:0/2866526521 learned_addr learned my addr 172.21.15.123:0/2866526521 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:46.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.173+0000 7f794c9f0700 1 --2- 172.21.15.123:0/2866526521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7948100cb0 0x7f79481060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:46.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.173+0000 7f794d1f1700 1 -- 172.21.15.123:0/2866526521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7948100cb0 msgr2=0x7f79481060b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:46.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.173+0000 7f794d1f1700 1 --2- 172.21.15.123:0/2866526521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7948100cb0 0x7f79481060b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:46.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.173+0000 7f794d1f1700 1 -- 172.21.15.123:0/2866526521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79380095f0 con 0x7f79480ffab0 2024-05-06T14:00:46.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.173+0000 7f794c9f0700 1 --2- 172.21.15.123:0/2866526521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7948100cb0 0x7f79481060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T14:00:46.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.173+0000 7f794d1f1700 1 --2- 172.21.15.123:0/2866526521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79480ffab0 0x7f7948107a60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f793800bda0 tx=0x7f793800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:46.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.173+0000 7f793e7fc700 1 -- 172.21.15.123:0/2866526521 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f793801d070 con 0x7f79480ffab0 2024-05-06T14:00:46.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.173+0000 7f794f455700 1 -- 172.21.15.123:0/2866526521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79481069b0 con 0x7f79480ffab0 2024-05-06T14:00:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.173+0000 7f793e7fc700 1 -- 172.21.15.123:0/2866526521 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7938004c50 con 0x7f79480ffab0 2024-05-06T14:00:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.173+0000 7f793e7fc700 1 -- 172.21.15.123:0/2866526521 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f793800f690 con 0x7f79480ffab0 2024-05-06T14:00:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.173+0000 7f794f455700 1 -- 172.21.15.123:0/2866526521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7948106ea0 con 0x7f79480ffab0 2024-05-06T14:00:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.174+0000 7f7933fff700 1 -- 172.21.15.123:0/2866526521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79280052f0 con 0x7f79480ffab0 2024-05-06T14:00:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.174+0000 7f793e7fc700 1 -- 172.21.15.123:0/2866526521 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f79380229b0 con 0x7f79480ffab0 2024-05-06T14:00:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.175+0000 7f793e7fc700 1 --2- 172.21.15.123:0/2866526521 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f793406c4e0 0x7f793406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.175+0000 7f794c9f0700 1 --2- 172.21.15.123:0/2866526521 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f793406c4e0 0x7f793406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.175+0000 7f793e7fc700 1 -- 172.21.15.123:0/2866526521 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f793808cc00 con 0x7f79480ffab0 2024-05-06T14:00:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.175+0000 7f794c9f0700 1 --2- 172.21.15.123:0/2866526521 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f793406c4e0 0x7f793406e9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7944005950 tx=0x7f7944005f50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:46.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.180+0000 7f793e7fc700 1 -- 172.21.15.123:0/2866526521 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7938092020 con 0x7f79480ffab0 2024-05-06T14:00:46.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:46 smithi174 ceph-mon[35160]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:46.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:45 smithi123 ceph-mon[27254]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:46.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.377+0000 7f7933fff700 1 -- 172.21.15.123:0/2866526521 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7928000bc0 con 0x7f793406c4e0 2024-05-06T14:00:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.386+0000 7f793e7fc700 1 -- 172.21.15.123:0/2866526521 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2840 (secure 0 0 0) 0x7f7928000bc0 con 0x7f793406c4e0 2024-05-06T14:00:46.387 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T14:00:46.387 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager.smithi123 smithi123 *:9093,9094 running (3m) 2m ago 5m 26.5M - 0.25.0 c8568f914cd2 97c8cad02fcf 2024-05-06T14:00:46.387 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-exporter.smithi123 smithi123 running (5m) 2m ago 5m 7029k - 18.2.1 5be31c24972a c63e10cfcb3b 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-exporter.smithi174 smithi174 running (4m) 68s ago 4m 6971k - 18.2.1 5be31c24972a 44bdee9de831 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi123 smithi123 running (5m) 2m ago 5m 6669k - 18.2.1 5be31c24972a 5688028254c8 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:crash.smithi174 smithi174 running (4m) 68s ago 4m 6656k - 18.2.1 5be31c24972a ce2c264b3e8d 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:grafana.smithi123 smithi123 *:3000 running (3m) 2m ago 5m 75.8M - 9.4.7 954c08fa6188 82a2c58ef725 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi123.vjztrj smithi123 *:9283,8765,8443 running (6m) 2m ago 6m 482M - 18.2.1 5be31c24972a 991b84480476 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.smithi174.ybuavj smithi174 *:8443,9283,8765 running (4m) 68s ago 4m 440M - 18.2.1 5be31c24972a 89f56694162e 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi123 smithi123 running (6m) 2m ago 6m 45.5M 2048M 18.2.1 5be31c24972a 0e6293707f75 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:mon.smithi174 smithi174 running (4m) 68s ago 4m 40.2M 2048M 18.2.1 5be31c24972a 24bb2b963f5a 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi123 smithi123 *:9100 running (5m) 2m ago 5m 15.7M - 1.5.0 0da6a335fe13 2ca25b599a7f 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter.smithi174 smithi174 *:9100 running (4m) 68s ago 4m 16.7M - 1.5.0 0da6a335fe13 29a39997a79e 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (3m) 2m ago 3m 40.9M 3946M 18.2.1 5be31c24972a d8762a4b2808 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi123 running (2m) 2m ago 2m 39.6M 3946M 18.2.1 5be31c24972a 984558595cd6 2024-05-06T14:00:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi123 running (2m) 2m ago 2m 41.0M 3946M 18.2.1 5be31c24972a 2aa0a706b75c 2024-05-06T14:00:46.389 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi174 running (2m) 68s ago 2m 42.2M 4970M 18.2.1 5be31c24972a 43da6966185b 2024-05-06T14:00:46.389 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi174 running (100s) 68s ago 99s 38.8M 4970M 18.2.1 5be31c24972a a10cb353bea3 2024-05-06T14:00:46.389 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi174 running (73s) 68s ago 73s 10.8M 4970M 18.2.1 5be31c24972a 5fcdecb0b4e8 2024-05-06T14:00:46.389 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus.smithi123 smithi123 *:9095 running (3m) 2m ago 4m 40.5M - 2.43.0 a07b618ecd1d 859f185c43c5 2024-05-06T14:00:46.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.388+0000 7f7933fff700 1 -- 172.21.15.123:0/2866526521 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f793406c4e0 msgr2=0x7f793406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.388+0000 7f7933fff700 1 --2- 172.21.15.123:0/2866526521 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f793406c4e0 0x7f793406e9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7944005950 tx=0x7f7944005f50 comp rx=0 tx=0).stop 2024-05-06T14:00:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.388+0000 7f7933fff700 1 -- 172.21.15.123:0/2866526521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79480ffab0 msgr2=0x7f7948107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.388+0000 7f7933fff700 1 --2- 172.21.15.123:0/2866526521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79480ffab0 0x7f7948107a60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f793800bda0 tx=0x7f793800be80 comp rx=0 tx=0).stop 2024-05-06T14:00:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.388+0000 7f7933fff700 1 -- 172.21.15.123:0/2866526521 shutdown_connections 2024-05-06T14:00:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.388+0000 7f7933fff700 1 --2- 172.21.15.123:0/2866526521 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f793406c4e0 0x7f793406e9a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.388+0000 7f7933fff700 1 --2- 172.21.15.123:0/2866526521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79480ffab0 0x7f7948107a60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.388+0000 7f7933fff700 1 --2- 172.21.15.123:0/2866526521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7948100cb0 0x7f79481060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.388+0000 7f7933fff700 1 -- 172.21.15.123:0/2866526521 >> 172.21.15.123:0/2866526521 conn(0x7f79480fb030 msgr2=0x7f7948103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.388+0000 7f7933fff700 1 -- 172.21.15.123:0/2866526521 shutdown_connections 2024-05-06T14:00:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:46.388+0000 7f7933fff700 1 -- 172.21.15.123:0/2866526521 wait complete. 2024-05-06T14:00:47.037 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-06T14:00:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:48.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:48 smithi174 ceph-mon[35160]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:00:48.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:48 smithi174 ceph-mon[35160]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:48.280 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:48 smithi123 ceph-mon[27254]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:00:48.280 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:48 smithi123 ceph-mon[27254]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:48.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.801+0000 7fa093eac700 1 -- 172.21.15.123:0/1305335336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa08c100bc0 msgr2=0x7fa08c100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:48.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.801+0000 7fa093eac700 1 --2- 172.21.15.123:0/1305335336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa08c100bc0 0x7fa08c100fe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009910 tx=0x7fa07c009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:48.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.801+0000 7fa093eac700 1 -- 172.21.15.123:0/1305335336 shutdown_connections 2024-05-06T14:00:48.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.801+0000 7fa093eac700 1 --2- 172.21.15.123:0/1305335336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c101dc0 0x7fa08c102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:48.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.801+0000 7fa093eac700 1 --2- 172.21.15.123:0/1305335336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa08c100bc0 0x7fa08c100fe0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:48.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.801+0000 7fa093eac700 1 -- 172.21.15.123:0/1305335336 >> 172.21.15.123:0/1305335336 conn(0x7fa08c0fc140 msgr2=0x7fa08c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:48.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.801+0000 7fa093eac700 1 -- 172.21.15.123:0/1305335336 shutdown_connections 2024-05-06T14:00:48.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.801+0000 7fa093eac700 1 -- 172.21.15.123:0/1305335336 wait complete. 2024-05-06T14:00:48.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa093eac700 1 Processor -- start 2024-05-06T14:00:48.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa093eac700 1 -- start start 2024-05-06T14:00:48.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa093eac700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c100bc0 0x7fa08c1963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa093eac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa08c101dc0 0x7fa08c196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa093eac700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c196f50 con 0x7fa08c101dc0 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa093eac700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c197090 con 0x7fa08c100bc0 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa091447700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa08c101dc0 0x7fa08c196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa091447700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa08c101dc0 0x7fa08c196930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36544/0 (socket says 172.21.15.123:36544) 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa091447700 1 -- 172.21.15.123:0/3381833058 learned_addr learned my addr 172.21.15.123:0/3381833058 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa091447700 1 -- 172.21.15.123:0/3381833058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c100bc0 msgr2=0x7fa08c1963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa091c48700 1 --2- 172.21.15.123:0/3381833058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c100bc0 0x7fa08c1963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa091447700 1 --2- 172.21.15.123:0/3381833058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c100bc0 0x7fa08c1963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa091447700 1 -- 172.21.15.123:0/3381833058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0095f0 con 0x7fa08c101dc0 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa091447700 1 --2- 172.21.15.123:0/3381833058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa08c101dc0 0x7fa08c196930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa08800b4b0 tx=0x7fa08800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.802+0000 7fa082ffd700 1 -- 172.21.15.123:0/3381833058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa088011800 con 0x7fa08c101dc0 2024-05-06T14:00:48.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.803+0000 7fa093eac700 1 -- 172.21.15.123:0/3381833058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c19bb40 con 0x7fa08c101dc0 2024-05-06T14:00:48.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.803+0000 7fa082ffd700 1 -- 172.21.15.123:0/3381833058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa088011e10 con 0x7fa08c101dc0 2024-05-06T14:00:48.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.803+0000 7fa082ffd700 1 -- 172.21.15.123:0/3381833058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa08800f2e0 con 0x7fa08c101dc0 2024-05-06T14:00:48.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.803+0000 7fa093eac700 1 -- 172.21.15.123:0/3381833058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c19c110 con 0x7fa08c101dc0 2024-05-06T14:00:48.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.804+0000 7fa093eac700 1 -- 172.21.15.123:0/3381833058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c1097a0 con 0x7fa08c101dc0 2024-05-06T14:00:48.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.804+0000 7fa082ffd700 1 -- 172.21.15.123:0/3381833058 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fa088010380 con 0x7fa08c101dc0 2024-05-06T14:00:48.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.804+0000 7fa082ffd700 1 --2- 172.21.15.123:0/3381833058 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fa07806c4e0 0x7fa07806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:48.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.805+0000 7fa082ffd700 1 -- 172.21.15.123:0/3381833058 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa08808b130 con 0x7fa08c101dc0 2024-05-06T14:00:48.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.805+0000 7fa091c48700 1 --2- 172.21.15.123:0/3381833058 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fa07806c4e0 0x7fa07806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:48.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.805+0000 7fa091c48700 1 --2- 172.21.15.123:0/3381833058 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fa07806c4e0 0x7fa07806e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0059d0 tx=0x7fa07c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:48.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:48.809+0000 7fa082ffd700 1 -- 172.21.15.123:0/3381833058 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa0880596e0 con 0x7fa08c101dc0 2024-05-06T14:00:49.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.007+0000 7fa093eac700 1 -- 172.21.15.123:0/3381833058 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa08c106710 con 0x7fa07806c4e0 2024-05-06T14:00:49.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.011+0000 7fa082ffd700 1 -- 172.21.15.123:0/3381833058 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1310 (secure 0 0 0) 0x7fa08c106710 con 0x7fa07806c4e0 2024-05-06T14:00:49.012 INFO:teuthology.orchestra.run.smithi123.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-06T14:00:49.013 INFO:teuthology.orchestra.run.smithi123.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-05-06T14:00:49.013 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-exporter 2/2 2m ago 6m * 2024-05-06T14:00:49.013 INFO:teuthology.orchestra.run.smithi123.stdout:crash 2/2 2m ago 6m * 2024-05-06T14:00:49.013 INFO:teuthology.orchestra.run.smithi123.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-05-06T14:00:49.013 INFO:teuthology.orchestra.run.smithi123.stdout:mgr 2/2 2m ago 6m count:2 2024-05-06T14:00:49.013 INFO:teuthology.orchestra.run.smithi123.stdout:mon 2/2 2m ago 5m smithi123:172.21.15.123=smithi123;smithi174:172.21.15.174=smithi174;count:2 2024-05-06T14:00:49.013 INFO:teuthology.orchestra.run.smithi123.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-05-06T14:00:49.013 INFO:teuthology.orchestra.run.smithi123.stdout:osd 6 2m ago - 2024-05-06T14:00:49.013 INFO:teuthology.orchestra.run.smithi123.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-05-06T14:00:49.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.013+0000 7fa093eac700 1 -- 172.21.15.123:0/3381833058 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fa07806c4e0 msgr2=0x7fa07806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:49.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.013+0000 7fa093eac700 1 --2- 172.21.15.123:0/3381833058 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fa07806c4e0 0x7fa07806e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0059d0 tx=0x7fa07c005960 comp rx=0 tx=0).stop 2024-05-06T14:00:49.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.013+0000 7fa093eac700 1 -- 172.21.15.123:0/3381833058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa08c101dc0 msgr2=0x7fa08c196930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:49.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.013+0000 7fa093eac700 1 --2- 172.21.15.123:0/3381833058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa08c101dc0 0x7fa08c196930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa08800b4b0 tx=0x7fa08800b870 comp rx=0 tx=0).stop 2024-05-06T14:00:49.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.014+0000 7fa093eac700 1 -- 172.21.15.123:0/3381833058 shutdown_connections 2024-05-06T14:00:49.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.014+0000 7fa093eac700 1 --2- 172.21.15.123:0/3381833058 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fa07806c4e0 0x7fa07806e9a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:49.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.014+0000 7fa093eac700 1 --2- 172.21.15.123:0/3381833058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c100bc0 0x7fa08c1963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:49.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.014+0000 7fa093eac700 1 --2- 172.21.15.123:0/3381833058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa08c101dc0 0x7fa08c196930 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:49.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.014+0000 7fa093eac700 1 -- 172.21.15.123:0/3381833058 >> 172.21.15.123:0/3381833058 conn(0x7fa08c0fc140 msgr2=0x7fa08c104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:49.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.014+0000 7fa093eac700 1 -- 172.21.15.123:0/3381833058 shutdown_connections 2024-05-06T14:00:49.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:49.014+0000 7fa093eac700 1 -- 172.21.15.123:0/3381833058 wait complete. 2024-05-06T14:00:49.645 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-06T14:00:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:50.231 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:50 smithi123 ceph-mon[27254]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:50.232 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:50 smithi123 ceph-mon[27254]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:00:50.232 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:50 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:00:50.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:50 smithi174 ceph-mon[35160]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:50.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:50 smithi174 ceph-mon[35160]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:00:50.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:50 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:00:51.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.617+0000 7fb42cb54700 1 -- 172.21.15.123:0/3612899038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb428101dc0 msgr2=0x7fb428102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.617+0000 7fb42cb54700 1 --2- 172.21.15.123:0/3612899038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb428101dc0 0x7fb428102220 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb418009910 tx=0x7fb418009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.617+0000 7fb42cb54700 1 -- 172.21.15.123:0/3612899038 shutdown_connections 2024-05-06T14:00:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.617+0000 7fb42cb54700 1 --2- 172.21.15.123:0/3612899038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb428101dc0 0x7fb428102220 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.617+0000 7fb42cb54700 1 --2- 172.21.15.123:0/3612899038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428100bc0 0x7fb428100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.617+0000 7fb42cb54700 1 -- 172.21.15.123:0/3612899038 >> 172.21.15.123:0/3612899038 conn(0x7fb4280fc140 msgr2=0x7fb4280fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.617+0000 7fb42cb54700 1 -- 172.21.15.123:0/3612899038 shutdown_connections 2024-05-06T14:00:51.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.617+0000 7fb42cb54700 1 -- 172.21.15.123:0/3612899038 wait complete. 2024-05-06T14:00:51.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.618+0000 7fb42cb54700 1 Processor -- start 2024-05-06T14:00:51.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.618+0000 7fb42cb54700 1 -- start start 2024-05-06T14:00:51.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42cb54700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb428100bc0 0x7fb428196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:51.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42cb54700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428101dc0 0x7fb4281968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:51.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42cb54700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb428196e40 con 0x7fb428100bc0 2024-05-06T14:00:51.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42cb54700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb428196f80 con 0x7fb428101dc0 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb428100bc0 0x7fb428196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb428100bc0 0x7fb428196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36564/0 (socket says 172.21.15.123:36564) 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42659c700 1 -- 172.21.15.123:0/2908674369 learned_addr learned my addr 172.21.15.123:0/2908674369 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb425d9b700 1 --2- 172.21.15.123:0/2908674369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428101dc0 0x7fb4281968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42659c700 1 -- 172.21.15.123:0/2908674369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428101dc0 msgr2=0x7fb4281968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42659c700 1 --2- 172.21.15.123:0/2908674369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428101dc0 0x7fb4281968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42659c700 1 -- 172.21.15.123:0/2908674369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180095f0 con 0x7fb428100bc0 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42659c700 1 --2- 172.21.15.123:0/2908674369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb428100bc0 0x7fb428196370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00c910 tx=0x7fb41c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb4177fe700 1 -- 172.21.15.123:0/2908674369 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb41c0041f0 con 0x7fb428100bc0 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb4177fe700 1 -- 172.21.15.123:0/2908674369 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb41c00ce60 con 0x7fb428100bc0 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42cb54700 1 -- 172.21.15.123:0/2908674369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42819ba40 con 0x7fb428100bc0 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb4177fe700 1 -- 172.21.15.123:0/2908674369 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb41c003d20 con 0x7fb428100bc0 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.619+0000 7fb42cb54700 1 -- 172.21.15.123:0/2908674369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42819bf60 con 0x7fb428100bc0 2024-05-06T14:00:51.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.620+0000 7fb42cb54700 1 -- 172.21.15.123:0/2908674369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb428109720 con 0x7fb428100bc0 2024-05-06T14:00:51.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.621+0000 7fb4177fe700 1 -- 172.21.15.123:0/2908674369 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fb41c007900 con 0x7fb428100bc0 2024-05-06T14:00:51.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.621+0000 7fb4177fe700 1 --2- 172.21.15.123:0/2908674369 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb41006c4e0 0x7fb41006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:51.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.621+0000 7fb4177fe700 1 -- 172.21.15.123:0/2908674369 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb41c08b120 con 0x7fb428100bc0 2024-05-06T14:00:51.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.621+0000 7fb425d9b700 1 --2- 172.21.15.123:0/2908674369 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb41006c4e0 0x7fb41006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:51.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.622+0000 7fb425d9b700 1 --2- 172.21.15.123:0/2908674369 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb41006c4e0 0x7fb41006e9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb418006010 tx=0x7fb41800b560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:51.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.626+0000 7fb4177fe700 1 -- 172.21.15.123:0/2908674369 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb41c059750 con 0x7fb428100bc0 2024-05-06T14:00:51.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.821+0000 7fb42cb54700 1 -- 172.21.15.123:0/2908674369 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb428106710 con 0x7fb41006c4e0 2024-05-06T14:00:51.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.822+0000 7fb4177fe700 1 -- 172.21.15.123:0/2908674369 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fb428106710 con 0x7fb41006c4e0 2024-05-06T14:00:51.823 INFO:teuthology.orchestra.run.smithi123.stdout:HOST ADDR LABELS STATUS 2024-05-06T14:00:51.823 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123 172.21.15.123 2024-05-06T14:00:51.823 INFO:teuthology.orchestra.run.smithi123.stdout:smithi174 172.21.15.174 2024-05-06T14:00:51.823 INFO:teuthology.orchestra.run.smithi123.stdout:2 hosts in cluster 2024-05-06T14:00:51.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.824+0000 7fb42cb54700 1 -- 172.21.15.123:0/2908674369 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb41006c4e0 msgr2=0x7fb41006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:51.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.824+0000 7fb42cb54700 1 --2- 172.21.15.123:0/2908674369 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb41006c4e0 0x7fb41006e9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb418006010 tx=0x7fb41800b560 comp rx=0 tx=0).stop 2024-05-06T14:00:51.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.824+0000 7fb42cb54700 1 -- 172.21.15.123:0/2908674369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb428100bc0 msgr2=0x7fb428196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:51.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.824+0000 7fb42cb54700 1 --2- 172.21.15.123:0/2908674369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb428100bc0 0x7fb428196370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00c910 tx=0x7fb41c00cc20 comp rx=0 tx=0).stop 2024-05-06T14:00:51.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.824+0000 7fb42cb54700 1 -- 172.21.15.123:0/2908674369 shutdown_connections 2024-05-06T14:00:51.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.824+0000 7fb42cb54700 1 --2- 172.21.15.123:0/2908674369 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb41006c4e0 0x7fb41006e9a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:51.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.824+0000 7fb42cb54700 1 --2- 172.21.15.123:0/2908674369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb428100bc0 0x7fb428196370 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:51.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.824+0000 7fb42cb54700 1 --2- 172.21.15.123:0/2908674369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428101dc0 0x7fb4281968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:51.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.824+0000 7fb42cb54700 1 -- 172.21.15.123:0/2908674369 >> 172.21.15.123:0/2908674369 conn(0x7fb4280fc140 msgr2=0x7fb428104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:51.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.824+0000 7fb42cb54700 1 -- 172.21.15.123:0/2908674369 shutdown_connections 2024-05-06T14:00:51.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:51.824+0000 7fb42cb54700 1 -- 172.21.15.123:0/2908674369 wait complete. 2024-05-06T14:00:52.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:52 smithi123 ceph-mon[27254]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:52.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:52 smithi174 ceph-mon[35160]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:52.405 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-06T14:00:52.608 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:53.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:53 smithi174 ceph-mon[35160]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:00:53.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:53 smithi123 ceph-mon[27254]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:00:54.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.225+0000 7f6f7d354700 1 -- 172.21.15.123:0/1558787484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f78100be0 msgr2=0x7f6f78101000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:54.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.225+0000 7f6f7d354700 1 --2- 172.21.15.123:0/1558787484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f78100be0 0x7f6f78101000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009910 tx=0x7f6f68009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:54.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.225+0000 7f6f7d354700 1 -- 172.21.15.123:0/1558787484 shutdown_connections 2024-05-06T14:00:54.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.225+0000 7f6f7d354700 1 --2- 172.21.15.123:0/1558787484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f78101de0 0x7f6f78102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:54.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.225+0000 7f6f7d354700 1 --2- 172.21.15.123:0/1558787484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f78100be0 0x7f6f78101000 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:54.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.225+0000 7f6f7d354700 1 -- 172.21.15.123:0/1558787484 >> 172.21.15.123:0/1558787484 conn(0x7f6f780fc140 msgr2=0x7f6f780fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:54.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.225+0000 7f6f7d354700 1 -- 172.21.15.123:0/1558787484 shutdown_connections 2024-05-06T14:00:54.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.225+0000 7f6f7d354700 1 -- 172.21.15.123:0/1558787484 wait complete. 2024-05-06T14:00:54.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.226+0000 7f6f7d354700 1 Processor -- start 2024-05-06T14:00:54.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.226+0000 7f6f7d354700 1 -- start start 2024-05-06T14:00:54.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.226+0000 7f6f7d354700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f78100be0 0x7f6f78196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:54.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.226+0000 7f6f7d354700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f78101de0 0x7f6f781968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:54.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.226+0000 7f6f7d354700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78196ef0 con 0x7f6f78100be0 2024-05-06T14:00:54.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.226+0000 7f6f7d354700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78197030 con 0x7f6f78101de0 2024-05-06T14:00:54.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f76ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f78100be0 0x7f6f78196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:54.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f76ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f78100be0 0x7f6f78196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36586/0 (socket says 172.21.15.123:36586) 2024-05-06T14:00:54.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f76ffd700 1 -- 172.21.15.123:0/2702685514 learned_addr learned my addr 172.21.15.123:0/2702685514 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:54.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f767fc700 1 --2- 172.21.15.123:0/2702685514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f78101de0 0x7f6f781968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:54.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f76ffd700 1 -- 172.21.15.123:0/2702685514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f78101de0 msgr2=0x7f6f781968d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:54.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f76ffd700 1 --2- 172.21.15.123:0/2702685514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f78101de0 0x7f6f781968d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:54.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f76ffd700 1 -- 172.21.15.123:0/2702685514 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680095f0 con 0x7f6f78100be0 2024-05-06T14:00:54.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f76ffd700 1 --2- 172.21.15.123:0/2702685514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f78100be0 0x7f6f78196390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800bda0 tx=0x7f6f6800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:54.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f5ffff700 1 -- 172.21.15.123:0/2702685514 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f6801d070 con 0x7f6f78100be0 2024-05-06T14:00:54.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f5ffff700 1 -- 172.21.15.123:0/2702685514 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6f6800f460 con 0x7f6f78100be0 2024-05-06T14:00:54.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f7d354700 1 -- 172.21.15.123:0/2702685514 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7819ba80 con 0x7f6f78100be0 2024-05-06T14:00:54.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f5ffff700 1 -- 172.21.15.123:0/2702685514 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f68021620 con 0x7f6f78100be0 2024-05-06T14:00:54.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.227+0000 7f6f7d354700 1 -- 172.21.15.123:0/2702685514 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7819bf70 con 0x7f6f78100be0 2024-05-06T14:00:54.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.228+0000 7f6f7d354700 1 -- 172.21.15.123:0/2702685514 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f78109740 con 0x7f6f78100be0 2024-05-06T14:00:54.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.229+0000 7f6f5ffff700 1 -- 172.21.15.123:0/2702685514 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f6f6800f5d0 con 0x7f6f78100be0 2024-05-06T14:00:54.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.229+0000 7f6f5ffff700 1 --2- 172.21.15.123:0/2702685514 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f6f6006c4e0 0x7f6f6006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:54.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.229+0000 7f6f767fc700 1 --2- 172.21.15.123:0/2702685514 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f6f6006c4e0 0x7f6f6006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:54.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.229+0000 7f6f5ffff700 1 -- 172.21.15.123:0/2702685514 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6f6808c7c0 con 0x7f6f78100be0 2024-05-06T14:00:54.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.229+0000 7f6f767fc700 1 --2- 172.21.15.123:0/2702685514 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f6f6006c4e0 0x7f6f6006e9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c005950 tx=0x7f6f6c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:54.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.233+0000 7f6f5ffff700 1 -- 172.21.15.123:0/2702685514 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6f6805ad70 con 0x7f6f78100be0 2024-05-06T14:00:54.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:54 smithi174 ceph-mon[35160]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:54.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:54 smithi123 ceph-mon[27254]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:54.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.454+0000 7f6f7d354700 1 -- 172.21.15.123:0/2702685514 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f7819c640 con 0x7f6f6006c4e0 2024-05-06T14:00:54.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.455+0000 7f6f5ffff700 1 -- 172.21.15.123:0/2702685514 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f6f7819c640 con 0x7f6f6006c4e0 2024-05-06T14:00:54.456 INFO:teuthology.orchestra.run.smithi123.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-06T14:00:54.456 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400YK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-05-06T14:00:54.456 INFO:teuthology.orchestra.run.smithi123.stdout:smithi174 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62050074400BGN 372G No 73s ago Has a FileSystem, LVM detected 2024-05-06T14:00:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.457+0000 7f6f7d354700 1 -- 172.21.15.123:0/2702685514 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f6f6006c4e0 msgr2=0x7f6f6006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.457+0000 7f6f7d354700 1 --2- 172.21.15.123:0/2702685514 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f6f6006c4e0 0x7f6f6006e9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c005950 tx=0x7f6f6c00b410 comp rx=0 tx=0).stop 2024-05-06T14:00:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.457+0000 7f6f7d354700 1 -- 172.21.15.123:0/2702685514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f78100be0 msgr2=0x7f6f78196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.457+0000 7f6f7d354700 1 --2- 172.21.15.123:0/2702685514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f78100be0 0x7f6f78196390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800bda0 tx=0x7f6f6800bdd0 comp rx=0 tx=0).stop 2024-05-06T14:00:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.457+0000 7f6f7d354700 1 -- 172.21.15.123:0/2702685514 shutdown_connections 2024-05-06T14:00:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.457+0000 7f6f7d354700 1 --2- 172.21.15.123:0/2702685514 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f6f6006c4e0 0x7f6f6006e9a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.457+0000 7f6f7d354700 1 --2- 172.21.15.123:0/2702685514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f78100be0 0x7f6f78196390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.457+0000 7f6f7d354700 1 --2- 172.21.15.123:0/2702685514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f78101de0 0x7f6f781968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.457+0000 7f6f7d354700 1 -- 172.21.15.123:0/2702685514 >> 172.21.15.123:0/2702685514 conn(0x7f6f780fc140 msgr2=0x7f6f78105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.458+0000 7f6f7d354700 1 -- 172.21.15.123:0/2702685514 shutdown_connections 2024-05-06T14:00:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:54.458+0000 7f6f7d354700 1 -- 172.21.15.123:0/2702685514 wait complete. 2024-05-06T14:00:55.165 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T14:00:55.177 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-05-06T14:00:55.178 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-05-06T14:00:55.396 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:00:56.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:56 smithi123 ceph-mon[27254]: from='client.14476 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:00:56.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:56 smithi123 ceph-mon[27254]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:56.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:56 smithi174 ceph-mon[35160]: from='client.14476 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:00:56.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:56 smithi174 ceph-mon[35160]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.087+0000 7f0058780700 1 -- 172.21.15.123:0/281370028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050100cd0 msgr2=0x7f0050101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.087+0000 7f0058780700 1 --2- 172.21.15.123:0/281370028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050100cd0 0x7f0050101130 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f004c009910 tx=0x7f004c009c20 comp rx=0 tx=0).stop 2024-05-06T14:00:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.087+0000 7f0058780700 1 -- 172.21.15.123:0/281370028 shutdown_connections 2024-05-06T14:00:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.087+0000 7f0058780700 1 --2- 172.21.15.123:0/281370028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050100cd0 0x7f0050101130 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.087+0000 7f0058780700 1 --2- 172.21.15.123:0/281370028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00500ffad0 0x7f00500ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.087+0000 7f0058780700 1 -- 172.21.15.123:0/281370028 >> 172.21.15.123:0/281370028 conn(0x7f00500fb050 msgr2=0x7f00500fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.087+0000 7f0058780700 1 -- 172.21.15.123:0/281370028 shutdown_connections 2024-05-06T14:00:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.087+0000 7f0058780700 1 -- 172.21.15.123:0/281370028 wait complete. 2024-05-06T14:00:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.088+0000 7f0058780700 1 Processor -- start 2024-05-06T14:00:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.088+0000 7f0058780700 1 -- start start 2024-05-06T14:00:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.088+0000 7f0058780700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00500ffad0 0x7f00501952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.088+0000 7f0058780700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050100cd0 0x7f0050195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.088+0000 7f0058780700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0050195e50 con 0x7f0050100cd0 2024-05-06T14:00:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.088+0000 7f0058780700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0050195f90 con 0x7f00500ffad0 2024-05-06T14:00:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.088+0000 7f0055d1b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050100cd0 0x7f0050195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.088+0000 7f0055d1b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050100cd0 0x7f0050195830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36600/0 (socket says 172.21.15.123:36600) 2024-05-06T14:00:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.088+0000 7f0055d1b700 1 -- 172.21.15.123:0/277741766 learned_addr learned my addr 172.21.15.123:0/277741766 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:00:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.088+0000 7f005651c700 1 --2- 172.21.15.123:0/277741766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00500ffad0 0x7f00501952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.089+0000 7f0055d1b700 1 -- 172.21.15.123:0/277741766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00500ffad0 msgr2=0x7f00501952f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.089+0000 7f0055d1b700 1 --2- 172.21.15.123:0/277741766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00500ffad0 0x7f00501952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.089+0000 7f0055d1b700 1 -- 172.21.15.123:0/277741766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0095f0 con 0x7f0050100cd0 2024-05-06T14:00:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.089+0000 7f0055d1b700 1 --2- 172.21.15.123:0/277741766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050100cd0 0x7f0050195830 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f004c006010 tx=0x7f004c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.089+0000 7f00477fe700 1 -- 172.21.15.123:0/277741766 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f004c01d070 con 0x7f0050100cd0 2024-05-06T14:00:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.089+0000 7f0058780700 1 -- 172.21.15.123:0/277741766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005019a9e0 con 0x7f0050100cd0 2024-05-06T14:00:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.089+0000 7f00477fe700 1 -- 172.21.15.123:0/277741766 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f004c00f460 con 0x7f0050100cd0 2024-05-06T14:00:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.089+0000 7f00477fe700 1 -- 172.21.15.123:0/277741766 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f004c021640 con 0x7f0050100cd0 2024-05-06T14:00:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.089+0000 7f0058780700 1 -- 172.21.15.123:0/277741766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005019af50 con 0x7f0050100cd0 2024-05-06T14:00:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.090+0000 7f0058780700 1 -- 172.21.15.123:0/277741766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00501086d0 con 0x7f0050100cd0 2024-05-06T14:00:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.091+0000 7f00477fe700 1 -- 172.21.15.123:0/277741766 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f004c00fab0 con 0x7f0050100cd0 2024-05-06T14:00:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.091+0000 7f00477fe700 1 --2- 172.21.15.123:0/277741766 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f003c06c4e0 0x7f003c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:00:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.091+0000 7f005651c700 1 --2- 172.21.15.123:0/277741766 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f003c06c4e0 0x7f003c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:00:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.091+0000 7f00477fe700 1 -- 172.21.15.123:0/277741766 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f004c08c8f0 con 0x7f0050100cd0 2024-05-06T14:00:57.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.091+0000 7f005651c700 1 --2- 172.21.15.123:0/277741766 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f003c06c4e0 0x7f003c06e9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0040006fd0 tx=0x7f0040008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:00:57.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.096+0000 7f00477fe700 1 -- 172.21.15.123:0/277741766 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f004c05b040 con 0x7f0050100cd0 2024-05-06T14:00:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:57.309+0000 7f0058780700 1 -- 172.21.15.123:0/277741766 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0050105620 con 0x7f003c06c4e0 2024-05-06T14:00:58.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:58 smithi174 ceph-mon[35160]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:58.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:58 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-05-06T14:00:58.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:58 smithi123 ceph-mon[27254]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:00:58.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:58 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-05-06T14:00:59.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:59.052+0000 7f00477fe700 1 -- 172.21.15.123:0/277741766 <== mgr.14217 v2:172.21.15.123:6800/3135616195 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0050105620 con 0x7f003c06c4e0 2024-05-06T14:00:59.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:59.056+0000 7f0058780700 1 -- 172.21.15.123:0/277741766 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f003c06c4e0 msgr2=0x7f003c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:59.056+0000 7f0058780700 1 --2- 172.21.15.123:0/277741766 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f003c06c4e0 0x7f003c06e9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0040006fd0 tx=0x7f0040008040 comp rx=0 tx=0).stop 2024-05-06T14:00:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:59.056+0000 7f0058780700 1 -- 172.21.15.123:0/277741766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050100cd0 msgr2=0x7f0050195830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:00:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:59.056+0000 7f0058780700 1 --2- 172.21.15.123:0/277741766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050100cd0 0x7f0050195830 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f004c006010 tx=0x7f004c00be20 comp rx=0 tx=0).stop 2024-05-06T14:00:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:59.057+0000 7f0058780700 1 -- 172.21.15.123:0/277741766 shutdown_connections 2024-05-06T14:00:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:59.057+0000 7f0058780700 1 --2- 172.21.15.123:0/277741766 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f003c06c4e0 0x7f003c06e9a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:59.057+0000 7f0058780700 1 --2- 172.21.15.123:0/277741766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00500ffad0 0x7f00501952f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:59.057+0000 7f0058780700 1 --2- 172.21.15.123:0/277741766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050100cd0 0x7f0050195830 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:00:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:59.057+0000 7f0058780700 1 -- 172.21.15.123:0/277741766 >> 172.21.15.123:0/277741766 conn(0x7f00500fb050 msgr2=0x7f0050103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:00:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:59.057+0000 7f0058780700 1 -- 172.21.15.123:0/277741766 shutdown_connections 2024-05-06T14:00:59.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:00:59.057+0000 7f0058780700 1 -- 172.21.15.123:0/277741766 wait complete. 2024-05-06T14:00:59.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123[27250]: 2024-05-06T14:00:59.030+0000 7f61529b7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-06T14:00:59.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='client.14480 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:00:59.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-05-06T14:00:59.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: osdmap e41: 6 total, 6 up, 6 in 2024-05-06T14:00:59.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-05-06T14:00:59.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-05-06T14:00:59.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: osdmap e42: 6 total, 6 up, 6 in 2024-05-06T14:00:59.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-05-06T14:00:59.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-06T14:00:59.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-06T14:00:59.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: osdmap e43: 6 total, 6 up, 6 in 2024-05-06T14:00:59.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-05-06T14:00:59.356 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: fsmap cephfs:0 2024-05-06T14:00:59.356 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:00:59.356 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T14:00:59.356 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:00:59.356 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T14:00:59.356 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:00:59.356 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.wnupgd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T14:00:59.356 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.wnupgd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T14:00:59.356 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:00:59 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:00:59.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='client.14480 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:00:59.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-05-06T14:00:59.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: osdmap e41: 6 total, 6 up, 6 in 2024-05-06T14:00:59.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-05-06T14:00:59.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-05-06T14:00:59.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: osdmap e42: 6 total, 6 up, 6 in 2024-05-06T14:00:59.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-05-06T14:00:59.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-06T14:00:59.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-06T14:00:59.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: osdmap e43: 6 total, 6 up, 6 in 2024-05-06T14:00:59.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-05-06T14:00:59.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: fsmap cephfs:0 2024-05-06T14:00:59.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:00:59.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T14:00:59.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:00:59.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T14:00:59.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:00:59.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.wnupgd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T14:00:59.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.wnupgd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T14:00:59.524 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:00:59 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:00:59.658 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-06T14:01:00.504 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:00.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:00 smithi174 ceph-mon[35160]: pgmap v176: 33 pgs: 11 creating+peering, 1 active+clean, 21 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:01:00.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:00 smithi174 ceph-mon[35160]: Saving service mds.cephfs spec with placement count:4 2024-05-06T14:01:00.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:00 smithi174 ceph-mon[35160]: Deploying daemon mds.cephfs.smithi123.wnupgd on smithi123 2024-05-06T14:01:00.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:00 smithi174 ceph-mon[35160]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-06T14:01:00.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:00 smithi174 ceph-mon[35160]: osdmap e44: 6 total, 6 up, 6 in 2024-05-06T14:01:00.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:00 smithi123 ceph-mon[27254]: pgmap v176: 33 pgs: 11 creating+peering, 1 active+clean, 21 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:01:00.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:00 smithi123 ceph-mon[27254]: Saving service mds.cephfs spec with placement count:4 2024-05-06T14:01:00.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:00 smithi123 ceph-mon[27254]: Deploying daemon mds.cephfs.smithi123.wnupgd on smithi123 2024-05-06T14:01:00.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:00 smithi123 ceph-mon[27254]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-06T14:01:00.604 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:00 smithi123 ceph-mon[27254]: osdmap e44: 6 total, 6 up, 6 in 2024-05-06T14:01:02.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:02 smithi123 ceph-mon[27254]: pgmap v180: 65 pgs: 11 creating+peering, 1 active+clean, 53 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:01:02.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:02 smithi123 ceph-mon[27254]: osdmap e45: 6 total, 6 up, 6 in 2024-05-06T14:01:02.301 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:02 smithi123 ceph-mon[27254]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-06T14:01:02.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:02 smithi174 ceph-mon[35160]: pgmap v180: 65 pgs: 11 creating+peering, 1 active+clean, 53 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:01:02.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:02 smithi174 ceph-mon[35160]: osdmap e45: 6 total, 6 up, 6 in 2024-05-06T14:01:02.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:02 smithi174 ceph-mon[35160]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-06T14:01:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.506+0000 7fee957fd700 1 -- 172.21.15.123:0/3610989218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee90101640 msgr2=0x7fee90103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.506+0000 7fee957fd700 1 --2- 172.21.15.123:0/3610989218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee90101640 0x7fee90103a30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fee88009910 tx=0x7fee88009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.506+0000 7fee957fd700 1 -- 172.21.15.123:0/3610989218 shutdown_connections 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.506+0000 7fee957fd700 1 --2- 172.21.15.123:0/3610989218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee90103f70 0x7fee90106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.506+0000 7fee957fd700 1 --2- 172.21.15.123:0/3610989218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee90101640 0x7fee90103a30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.506+0000 7fee957fd700 1 -- 172.21.15.123:0/3610989218 >> 172.21.15.123:0/3610989218 conn(0x7fee900fb030 msgr2=0x7fee900fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.506+0000 7fee957fd700 1 -- 172.21.15.123:0/3610989218 shutdown_connections 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.506+0000 7fee957fd700 1 -- 172.21.15.123:0/3610989218 wait complete. 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.506+0000 7fee957fd700 1 Processor -- start 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee957fd700 1 -- start start 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee957fd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee90101640 0x7fee90196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee957fd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee90103f70 0x7fee901968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee957fd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee90196ee0 con 0x7fee90103f70 2024-05-06T14:01:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee957fd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee90197020 con 0x7fee90101640 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee8e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee90103f70 0x7fee901968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee8e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee90103f70 0x7fee901968c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54232/0 (socket says 172.21.15.123:54232) 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee8e7fc700 1 -- 172.21.15.123:0/4243533229 learned_addr learned my addr 172.21.15.123:0/4243533229 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee8effd700 1 --2- 172.21.15.123:0/4243533229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee90101640 0x7fee90196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee8e7fc700 1 -- 172.21.15.123:0/4243533229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee90101640 msgr2=0x7fee90196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee8e7fc700 1 --2- 172.21.15.123:0/4243533229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee90101640 0x7fee90196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee8e7fc700 1 -- 172.21.15.123:0/4243533229 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee880095f0 con 0x7fee90103f70 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee8effd700 1 --2- 172.21.15.123:0/4243533229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee90101640 0x7fee90196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee8e7fc700 1 --2- 172.21.15.123:0/4243533229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee90103f70 0x7fee901968c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fee8400b4b0 tx=0x7fee8400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.507+0000 7fee77fff700 1 -- 172.21.15.123:0/4243533229 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee84011800 con 0x7fee90103f70 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.508+0000 7fee957fd700 1 -- 172.21.15.123:0/4243533229 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9019bad0 con 0x7fee90103f70 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.508+0000 7fee77fff700 1 -- 172.21.15.123:0/4243533229 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fee84011e10 con 0x7fee90103f70 2024-05-06T14:01:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.508+0000 7fee77fff700 1 -- 172.21.15.123:0/4243533229 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee8400f2e0 con 0x7fee90103f70 2024-05-06T14:01:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.508+0000 7fee957fd700 1 -- 172.21.15.123:0/4243533229 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9019c0a0 con 0x7fee90103f70 2024-05-06T14:01:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.509+0000 7fee957fd700 1 -- 172.21.15.123:0/4243533229 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee901905a0 con 0x7fee90103f70 2024-05-06T14:01:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.509+0000 7fee77fff700 1 -- 172.21.15.123:0/4243533229 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fee84010380 con 0x7fee90103f70 2024-05-06T14:01:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.509+0000 7fee77fff700 1 --2- 172.21.15.123:0/4243533229 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fee7806c4e0 0x7fee7806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.509+0000 7fee77fff700 1 -- 172.21.15.123:0/4243533229 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fee8408b470 con 0x7fee90103f70 2024-05-06T14:01:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.509+0000 7fee8effd700 1 --2- 172.21.15.123:0/4243533229 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fee7806c4e0 0x7fee7806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.510+0000 7fee8effd700 1 --2- 172.21.15.123:0/4243533229 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fee7806c4e0 0x7fee7806e9a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fee8800b5c0 tx=0x7fee88005e20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.514+0000 7fee77fff700 1 -- 172.21.15.123:0/4243533229 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fee840596e0 con 0x7fee90103f70 2024-05-06T14:01:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.762+0000 7fee957fd700 1 -- 172.21.15.123:0/4243533229 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fee9002cc70 con 0x7fee90103f70 2024-05-06T14:01:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.763+0000 7fee77fff700 1 -- 172.21.15.123:0/4243533229 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7fee84059270 con 0x7fee90103f70 2024-05-06T14:01:02.764 INFO:teuthology.orchestra.run.smithi123.stdout:e2 2024-05-06T14:01:02.764 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T14:01:02.764 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T14:01:02.764 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-05-06T14:01:02.764 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T14:01:02.764 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-05-06T14:01:02.764 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-05-06T14:01:02.764 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 2 2024-05-06T14:01:02.764 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T14:01:02.764 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-05-06T14:00:59.031457+0000 2024-05-06T14:01:02.764 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-05-06T14:00:59.031562+0000 2024-05-06T14:01:02.764 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-05-06T14:01:02.765 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-05-06T14:01:02.765 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-05-06T14:01:02.765 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-05-06T14:01:02.765 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-05-06T14:01:02.765 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-05-06T14:01:02.765 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-05-06T14:01:02.765 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 0 2024-05-06T14:01:02.765 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T14:01:02.765 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 1 2024-05-06T14:01:02.765 INFO:teuthology.orchestra.run.smithi123.stdout:in 2024-05-06T14:01:02.765 INFO:teuthology.orchestra.run.smithi123.stdout:up {} 2024-05-06T14:01:02.765 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-05-06T14:01:02.766 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-05-06T14:01:02.766 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-05-06T14:01:02.766 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-05-06T14:01:02.766 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-05-06T14:01:02.766 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data disabled 2024-05-06T14:01:02.766 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-05-06T14:01:02.766 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-05-06T14:01:02.766 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 0 2024-05-06T14:01:02.766 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T14:01:02.766 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T14:01:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.765+0000 7fee957fd700 1 -- 172.21.15.123:0/4243533229 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fee7806c4e0 msgr2=0x7fee7806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.765+0000 7fee957fd700 1 --2- 172.21.15.123:0/4243533229 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fee7806c4e0 0x7fee7806e9a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fee8800b5c0 tx=0x7fee88005e20 comp rx=0 tx=0).stop 2024-05-06T14:01:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.765+0000 7fee957fd700 1 -- 172.21.15.123:0/4243533229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee90103f70 msgr2=0x7fee901968c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.765+0000 7fee957fd700 1 --2- 172.21.15.123:0/4243533229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee90103f70 0x7fee901968c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fee8400b4b0 tx=0x7fee8400b870 comp rx=0 tx=0).stop 2024-05-06T14:01:02.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.765+0000 7fee957fd700 1 -- 172.21.15.123:0/4243533229 shutdown_connections 2024-05-06T14:01:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.765+0000 7fee957fd700 1 --2- 172.21.15.123:0/4243533229 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fee7806c4e0 0x7fee7806e9a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.765+0000 7fee957fd700 1 --2- 172.21.15.123:0/4243533229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee90101640 0x7fee90196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.765+0000 7fee957fd700 1 --2- 172.21.15.123:0/4243533229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee90103f70 0x7fee901968c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.765+0000 7fee957fd700 1 -- 172.21.15.123:0/4243533229 >> 172.21.15.123:0/4243533229 conn(0x7fee900fb030 msgr2=0x7fee900fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.765+0000 7fee957fd700 1 -- 172.21.15.123:0/4243533229 shutdown_connections 2024-05-06T14:01:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:02.765+0000 7fee957fd700 1 -- 172.21.15.123:0/4243533229 wait complete. 2024-05-06T14:01:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 2 2024-05-06T14:01:03.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:03 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/4243533229' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T14:01:03.424 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T14:01:03.435 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-05-06T14:01:03.435 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-05-06T14:01:03.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:03 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/4243533229' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T14:01:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:04.057 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:04 smithi123 ceph-mon[27254]: pgmap v182: 65 pgs: 11 creating+peering, 26 active+clean, 28 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:01:04.057 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:04.057 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:04.057 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:04.057 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi174.rqlodw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T14:01:04.057 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi174.rqlodw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T14:01:04.057 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:04 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:01:04.423 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:04 smithi174 ceph-mon[35160]: pgmap v182: 65 pgs: 11 creating+peering, 26 active+clean, 28 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:01:04.424 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:04 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:04.424 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:04 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:04.424 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:04 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:04.424 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:04 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi174.rqlodw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T14:01:04.424 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:04 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi174.rqlodw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T14:01:04.424 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:04 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:01:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:05 smithi123 ceph-mon[27254]: Deploying daemon mds.cephfs.smithi174.rqlodw on smithi174 2024-05-06T14:01:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:05 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.123:6826/4097360326,v1:172.21.15.123:6827/4097360326] up:boot 2024-05-06T14:01:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:05 smithi123 ceph-mon[27254]: daemon mds.cephfs.smithi123.wnupgd assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-05-06T14:01:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:05 smithi123 ceph-mon[27254]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-06T14:01:05.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:05 smithi123 ceph-mon[27254]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-06T14:01:05.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:05 smithi123 ceph-mon[27254]: Cluster is now healthy 2024-05-06T14:01:05.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:05 smithi123 ceph-mon[27254]: fsmap cephfs:0 1 up:standby 2024-05-06T14:01:05.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:05 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.wnupgd"}]: dispatch 2024-05-06T14:01:05.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:05 smithi123 ceph-mon[27254]: fsmap cephfs:1 {0=cephfs.smithi123.wnupgd=up:creating} 2024-05-06T14:01:05.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:05 smithi123 ceph-mon[27254]: daemon mds.cephfs.smithi123.wnupgd is now active in filesystem cephfs as rank 0 2024-05-06T14:01:05.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:05 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:01:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.361+0000 7fabffefa700 1 -- 172.21.15.123:0/2304013271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80ff290 msgr2=0x7fabf80ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.361+0000 7fabffefa700 1 --2- 172.21.15.123:0/2304013271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80ff290 0x7fabf80ff6b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fabe800aa20 tx=0x7fabe800ad30 comp rx=0 tx=0).stop 2024-05-06T14:01:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.361+0000 7fabffefa700 1 -- 172.21.15.123:0/2304013271 shutdown_connections 2024-05-06T14:01:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.361+0000 7fabffefa700 1 --2- 172.21.15.123:0/2304013271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabf8100490 0x7fabf81008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.361+0000 7fabffefa700 1 --2- 172.21.15.123:0/2304013271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80ff290 0x7fabf80ff6b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.361+0000 7fabffefa700 1 -- 172.21.15.123:0/2304013271 >> 172.21.15.123:0/2304013271 conn(0x7fabf80fa810 msgr2=0x7fabf80fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.361+0000 7fabffefa700 1 -- 172.21.15.123:0/2304013271 shutdown_connections 2024-05-06T14:01:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.361+0000 7fabffefa700 1 -- 172.21.15.123:0/2304013271 wait complete. 2024-05-06T14:01:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabffefa700 1 Processor -- start 2024-05-06T14:01:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabffefa700 1 -- start start 2024-05-06T14:01:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabffefa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80ff290 0x7fabf8196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabffefa700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabf8100490 0x7fabf8196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabffefa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf8196f70 con 0x7fabf80ff290 2024-05-06T14:01:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabffefa700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf81970b0 con 0x7fabf8100490 2024-05-06T14:01:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabfdc96700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80ff290 0x7fabf8196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabfdc96700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80ff290 0x7fabf8196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54274/0 (socket says 172.21.15.123:54274) 2024-05-06T14:01:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabfdc96700 1 -- 172.21.15.123:0/3876229726 learned_addr learned my addr 172.21.15.123:0/3876229726 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabfd495700 1 --2- 172.21.15.123:0/3876229726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabf8100490 0x7fabf8196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabfdc96700 1 -- 172.21.15.123:0/3876229726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabf8100490 msgr2=0x7fabf8196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabfdc96700 1 --2- 172.21.15.123:0/3876229726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabf8100490 0x7fabf8196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.362+0000 7fabfdc96700 1 -- 172.21.15.123:0/3876229726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe800a700 con 0x7fabf80ff290 2024-05-06T14:01:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.363+0000 7fabfdc96700 1 --2- 172.21.15.123:0/3876229726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80ff290 0x7fabf8196410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fabe800a3f0 tx=0x7fabe800fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.363+0000 7fabeeffd700 1 -- 172.21.15.123:0/3876229726 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabe800ccc0 con 0x7fabf80ff290 2024-05-06T14:01:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.363+0000 7fabeeffd700 1 -- 172.21.15.123:0/3876229726 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fabe8005070 con 0x7fabf80ff290 2024-05-06T14:01:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.363+0000 7fabffefa700 1 -- 172.21.15.123:0/3876229726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf819bb00 con 0x7fabf80ff290 2024-05-06T14:01:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.363+0000 7fabeeffd700 1 -- 172.21.15.123:0/3876229726 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabe8016780 con 0x7fabf80ff290 2024-05-06T14:01:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.363+0000 7fabffefa700 1 -- 172.21.15.123:0/3876229726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf819bff0 con 0x7fabf80ff290 2024-05-06T14:01:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.364+0000 7fabffefa700 1 -- 172.21.15.123:0/3876229726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf8107560 con 0x7fabf80ff290 2024-05-06T14:01:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.364+0000 7fabeeffd700 1 -- 172.21.15.123:0/3876229726 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fabe8003bc0 con 0x7fabf80ff290 2024-05-06T14:01:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.365+0000 7fabeeffd700 1 --2- 172.21.15.123:0/3876229726 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fabe406c4e0 0x7fabe406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.365+0000 7fabfd495700 1 --2- 172.21.15.123:0/3876229726 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fabe406c4e0 0x7fabe406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.365+0000 7fabeeffd700 1 -- 172.21.15.123:0/3876229726 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fabe8012070 con 0x7fabf80ff290 2024-05-06T14:01:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.365+0000 7fabfd495700 1 --2- 172.21.15.123:0/3876229726 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fabe406c4e0 0x7fabe406e9a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009c60 tx=0x7fabf4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:05.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.369+0000 7fabeeffd700 1 -- 172.21.15.123:0/3876229726 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fabe805b740 con 0x7fabf80ff290 2024-05-06T14:01:05.412 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:05 smithi174 ceph-mon[35160]: Deploying daemon mds.cephfs.smithi174.rqlodw on smithi174 2024-05-06T14:01:05.412 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:05 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.123:6826/4097360326,v1:172.21.15.123:6827/4097360326] up:boot 2024-05-06T14:01:05.412 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:05 smithi174 ceph-mon[35160]: daemon mds.cephfs.smithi123.wnupgd assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-05-06T14:01:05.412 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:05 smithi174 ceph-mon[35160]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-06T14:01:05.413 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:05 smithi174 ceph-mon[35160]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-06T14:01:05.413 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:05 smithi174 ceph-mon[35160]: Cluster is now healthy 2024-05-06T14:01:05.413 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:05 smithi174 ceph-mon[35160]: fsmap cephfs:0 1 up:standby 2024-05-06T14:01:05.413 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:05 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.wnupgd"}]: dispatch 2024-05-06T14:01:05.413 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:05 smithi174 ceph-mon[35160]: fsmap cephfs:1 {0=cephfs.smithi123.wnupgd=up:creating} 2024-05-06T14:01:05.413 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:05 smithi174 ceph-mon[35160]: daemon mds.cephfs.smithi123.wnupgd is now active in filesystem cephfs as rank 0 2024-05-06T14:01:05.413 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:05 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:01:05.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:05.601+0000 7fabffefa700 1 -- 172.21.15.123:0/3876229726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fabf819c660 con 0x7fabf80ff290 2024-05-06T14:01:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:06.058+0000 7fabeeffd700 1 -- 172.21.15.123:0/3876229726 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fabe805b2d0 con 0x7fabf80ff290 2024-05-06T14:01:06.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:06.060+0000 7fabffefa700 1 -- 172.21.15.123:0/3876229726 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fabe406c4e0 msgr2=0x7fabe406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:06.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:06.060+0000 7fabffefa700 1 --2- 172.21.15.123:0/3876229726 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fabe406c4e0 0x7fabe406e9a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009c60 tx=0x7fabf4009260 comp rx=0 tx=0).stop 2024-05-06T14:01:06.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:06.060+0000 7fabffefa700 1 -- 172.21.15.123:0/3876229726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80ff290 msgr2=0x7fabf8196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:06.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:06.060+0000 7fabffefa700 1 --2- 172.21.15.123:0/3876229726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80ff290 0x7fabf8196410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fabe800a3f0 tx=0x7fabe800fd70 comp rx=0 tx=0).stop 2024-05-06T14:01:06.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:06.060+0000 7fabffefa700 1 -- 172.21.15.123:0/3876229726 shutdown_connections 2024-05-06T14:01:06.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:06.060+0000 7fabffefa700 1 --2- 172.21.15.123:0/3876229726 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fabe406c4e0 0x7fabe406e9a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:06.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:06.060+0000 7fabffefa700 1 --2- 172.21.15.123:0/3876229726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80ff290 0x7fabf8196410 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:06.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:06.060+0000 7fabffefa700 1 --2- 172.21.15.123:0/3876229726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabf8100490 0x7fabf8196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:06.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:06.060+0000 7fabffefa700 1 -- 172.21.15.123:0/3876229726 >> 172.21.15.123:0/3876229726 conn(0x7fabf80fa810 msgr2=0x7fabf80fc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:06.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:06.061+0000 7fabffefa700 1 -- 172.21.15.123:0/3876229726 shutdown_connections 2024-05-06T14:01:06.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:06.061+0000 7fabffefa700 1 -- 172.21.15.123:0/3876229726 wait complete. 2024-05-06T14:01:06.333 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:06 smithi174 ceph-mon[35160]: pgmap v183: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:01:06.333 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:06 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.123:6826/4097360326,v1:172.21.15.123:6827/4097360326] up:active 2024-05-06T14:01:06.334 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:06 smithi174 ceph-mon[35160]: fsmap cephfs:1 {0=cephfs.smithi123.wnupgd=up:active} 2024-05-06T14:01:06.334 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:06 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/3876229726' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-05-06T14:01:06.342 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:06 smithi123 ceph-mon[27254]: pgmap v183: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:01:06.342 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:06 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.123:6826/4097360326,v1:172.21.15.123:6827/4097360326] up:active 2024-05-06T14:01:06.342 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:06 smithi123 ceph-mon[27254]: fsmap cephfs:1 {0=cephfs.smithi123.wnupgd=up:active} 2024-05-06T14:01:06.342 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:06 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3876229726' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-05-06T14:01:06.642 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T14:01:06.652 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-05-06T14:01:06.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-05-06T14:01:06.879 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:07.254 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:07 smithi123 ceph-mon[27254]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-06T14:01:07.254 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:07 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3876229726' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-05-06T14:01:07.254 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:07 smithi123 ceph-mon[27254]: fsmap cephfs:1 {0=cephfs.smithi123.wnupgd=up:active} 2024-05-06T14:01:07.254 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:07.254 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:07.254 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:07.254 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.cuurje", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T14:01:07.254 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.cuurje", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T14:01:07.254 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:07 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:01:07.493 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:07 smithi174 ceph-mon[35160]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-06T14:01:07.494 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:07 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/3876229726' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-05-06T14:01:07.494 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:07 smithi174 ceph-mon[35160]: fsmap cephfs:1 {0=cephfs.smithi123.wnupgd=up:active} 2024-05-06T14:01:07.494 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:07.494 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:07.494 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:07.494 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.cuurje", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T14:01:07.494 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi123.cuurje", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T14:01:07.494 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:07 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:01:08.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:08 smithi123 ceph-mon[27254]: Deploying daemon mds.cephfs.smithi123.cuurje on smithi123 2024-05-06T14:01:08.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:08 smithi123 ceph-mon[27254]: pgmap v184: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 262 B/s wr, 0 op/s 2024-05-06T14:01:08.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:08 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.174:6824/1977628229,v1:172.21.15.174:6825/1977628229] up:boot 2024-05-06T14:01:08.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:08 smithi123 ceph-mon[27254]: daemon mds.cephfs.smithi174.rqlodw assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-06T14:01:08.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:08 smithi123 ceph-mon[27254]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-05-06T14:01:08.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:08 smithi123 ceph-mon[27254]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-06T14:01:08.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:08 smithi123 ceph-mon[27254]: fsmap cephfs:1 {0=cephfs.smithi123.wnupgd=up:active} 1 up:standby 2024-05-06T14:01:08.302 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:08 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi174.rqlodw"}]: dispatch 2024-05-06T14:01:08.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:08 smithi123 ceph-mon[27254]: fsmap cephfs:2 {0=cephfs.smithi123.wnupgd=up:active,1=cephfs.smithi174.rqlodw=up:creating} 2024-05-06T14:01:08.303 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:08 smithi123 ceph-mon[27254]: daemon mds.cephfs.smithi174.rqlodw is now active in filesystem cephfs as rank 1 2024-05-06T14:01:08.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:08 smithi174 ceph-mon[35160]: Deploying daemon mds.cephfs.smithi123.cuurje on smithi123 2024-05-06T14:01:08.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:08 smithi174 ceph-mon[35160]: pgmap v184: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 262 B/s wr, 0 op/s 2024-05-06T14:01:08.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:08 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.174:6824/1977628229,v1:172.21.15.174:6825/1977628229] up:boot 2024-05-06T14:01:08.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:08 smithi174 ceph-mon[35160]: daemon mds.cephfs.smithi174.rqlodw assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-06T14:01:08.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:08 smithi174 ceph-mon[35160]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-05-06T14:01:08.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:08 smithi174 ceph-mon[35160]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-06T14:01:08.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:08 smithi174 ceph-mon[35160]: fsmap cephfs:1 {0=cephfs.smithi123.wnupgd=up:active} 1 up:standby 2024-05-06T14:01:08.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:08 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi174.rqlodw"}]: dispatch 2024-05-06T14:01:08.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:08 smithi174 ceph-mon[35160]: fsmap cephfs:2 {0=cephfs.smithi123.wnupgd=up:active,1=cephfs.smithi174.rqlodw=up:creating} 2024-05-06T14:01:08.523 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:08 smithi174 ceph-mon[35160]: daemon mds.cephfs.smithi174.rqlodw is now active in filesystem cephfs as rank 1 2024-05-06T14:01:09.332 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:09 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.174:6824/1977628229,v1:172.21.15.174:6825/1977628229] up:active 2024-05-06T14:01:09.332 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:09 smithi123 ceph-mon[27254]: fsmap cephfs:2 {0=cephfs.smithi123.wnupgd=up:active,1=cephfs.smithi174.rqlodw=up:active} 2024-05-06T14:01:09.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:09 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.174:6824/1977628229,v1:172.21.15.174:6825/1977628229] up:active 2024-05-06T14:01:09.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:09 smithi174 ceph-mon[35160]: fsmap cephfs:2 {0=cephfs.smithi123.wnupgd=up:active,1=cephfs.smithi174.rqlodw=up:active} 2024-05-06T14:01:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.572+0000 7f254d216700 1 -- 172.21.15.123:0/4230486399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25481016a0 msgr2=0x7f2548103a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.572+0000 7f254d216700 1 --2- 172.21.15.123:0/4230486399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25481016a0 0x7f2548103a90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f253c009910 tx=0x7f253c009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.572+0000 7f254d216700 1 -- 172.21.15.123:0/4230486399 shutdown_connections 2024-05-06T14:01:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.572+0000 7f254d216700 1 --2- 172.21.15.123:0/4230486399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2548103fd0 0x7f25481063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.572+0000 7f254d216700 1 --2- 172.21.15.123:0/4230486399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25481016a0 0x7f2548103a90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.572+0000 7f254d216700 1 -- 172.21.15.123:0/4230486399 >> 172.21.15.123:0/4230486399 conn(0x7f25480fb030 msgr2=0x7f25480fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.572+0000 7f254d216700 1 -- 172.21.15.123:0/4230486399 shutdown_connections 2024-05-06T14:01:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.572+0000 7f254d216700 1 -- 172.21.15.123:0/4230486399 wait complete. 2024-05-06T14:01:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.573+0000 7f254d216700 1 Processor -- start 2024-05-06T14:01:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.573+0000 7f254d216700 1 -- start start 2024-05-06T14:01:09.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.573+0000 7f254d216700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25481016a0 0x7f2548101000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:09.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.573+0000 7f254d216700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2548103fd0 0x7f25480ff650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:09.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.573+0000 7f254d216700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25480ffb90 con 0x7f2548103fd0 2024-05-06T14:01:09.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.573+0000 7f254d216700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25480ffcd0 con 0x7f25481016a0 2024-05-06T14:01:09.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.573+0000 7f254659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2548103fd0 0x7f25480ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:09.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.573+0000 7f254659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2548103fd0 0x7f25480ff650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37786/0 (socket says 172.21.15.123:37786) 2024-05-06T14:01:09.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.573+0000 7f254659c700 1 -- 172.21.15.123:0/2676714576 learned_addr learned my addr 172.21.15.123:0/2676714576 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:09.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.573+0000 7f2546d9d700 1 --2- 172.21.15.123:0/2676714576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25481016a0 0x7f2548101000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:09.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.574+0000 7f254659c700 1 -- 172.21.15.123:0/2676714576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25481016a0 msgr2=0x7f2548101000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:09.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.574+0000 7f254659c700 1 --2- 172.21.15.123:0/2676714576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25481016a0 0x7f2548101000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:09.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.574+0000 7f254659c700 1 -- 172.21.15.123:0/2676714576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c0095f0 con 0x7f2548103fd0 2024-05-06T14:01:09.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.574+0000 7f254659c700 1 --2- 172.21.15.123:0/2676714576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2548103fd0 0x7f25480ff650 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f253800d900 tx=0x7f253800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:09.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.574+0000 7f252ffff700 1 -- 172.21.15.123:0/2676714576 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2538004a00 con 0x7f2548103fd0 2024-05-06T14:01:09.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.574+0000 7f252ffff700 1 -- 172.21.15.123:0/2676714576 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f25380054d0 con 0x7f2548103fd0 2024-05-06T14:01:09.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.574+0000 7f254d216700 1 -- 172.21.15.123:0/2676714576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25480fffb0 con 0x7f2548103fd0 2024-05-06T14:01:09.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.574+0000 7f252ffff700 1 -- 172.21.15.123:0/2676714576 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2538009d00 con 0x7f2548103fd0 2024-05-06T14:01:09.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.574+0000 7f254d216700 1 -- 172.21.15.123:0/2676714576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254819e360 con 0x7f2548103fd0 2024-05-06T14:01:09.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.575+0000 7f254d216700 1 -- 172.21.15.123:0/2676714576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2548190540 con 0x7f2548103fd0 2024-05-06T14:01:09.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.576+0000 7f252ffff700 1 -- 172.21.15.123:0/2676714576 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f2538005020 con 0x7f2548103fd0 2024-05-06T14:01:09.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.576+0000 7f252ffff700 1 --2- 172.21.15.123:0/2676714576 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f253006c4e0 0x7f253006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:09.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.577+0000 7f252ffff700 1 -- 172.21.15.123:0/2676714576 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f253808b780 con 0x7f2548103fd0 2024-05-06T14:01:09.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.577+0000 7f2546d9d700 1 --2- 172.21.15.123:0/2676714576 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f253006c4e0 0x7f253006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:09.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.577+0000 7f2546d9d700 1 --2- 172.21.15.123:0/2676714576 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f253006c4e0 0x7f253006e9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f253c00b5c0 tx=0x7f253c005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:09.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.581+0000 7f252ffff700 1 -- 172.21.15.123:0/2676714576 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f25380599f0 con 0x7f2548103fd0 2024-05-06T14:01:09.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:09.824+0000 7f254d216700 1 -- 172.21.15.123:0/2676714576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f25480619a0 con 0x7f2548103fd0 2024-05-06T14:01:10.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:10.078+0000 7f252ffff700 1 -- 172.21.15.123:0/2676714576 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2538009e60 con 0x7f2548103fd0 2024-05-06T14:01:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:10.080+0000 7f254d216700 1 -- 172.21.15.123:0/2676714576 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f253006c4e0 msgr2=0x7f253006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:10.080+0000 7f254d216700 1 --2- 172.21.15.123:0/2676714576 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f253006c4e0 0x7f253006e9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f253c00b5c0 tx=0x7f253c005ee0 comp rx=0 tx=0).stop 2024-05-06T14:01:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:10.080+0000 7f254d216700 1 -- 172.21.15.123:0/2676714576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2548103fd0 msgr2=0x7f25480ff650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:10.080+0000 7f254d216700 1 --2- 172.21.15.123:0/2676714576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2548103fd0 0x7f25480ff650 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f253800d900 tx=0x7f253800dc10 comp rx=0 tx=0).stop 2024-05-06T14:01:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:10.080+0000 7f254d216700 1 -- 172.21.15.123:0/2676714576 shutdown_connections 2024-05-06T14:01:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:10.080+0000 7f254d216700 1 --2- 172.21.15.123:0/2676714576 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f253006c4e0 0x7f253006e9a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:10.080+0000 7f254d216700 1 --2- 172.21.15.123:0/2676714576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25481016a0 0x7f2548101000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:10.080+0000 7f254d216700 1 --2- 172.21.15.123:0/2676714576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2548103fd0 0x7f25480ff650 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:10.080+0000 7f254d216700 1 -- 172.21.15.123:0/2676714576 >> 172.21.15.123:0/2676714576 conn(0x7f25480fb030 msgr2=0x7f25480fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:10.080+0000 7f254d216700 1 -- 172.21.15.123:0/2676714576 shutdown_connections 2024-05-06T14:01:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:10.080+0000 7f254d216700 1 -- 172.21.15.123:0/2676714576 wait complete. 2024-05-06T14:01:10.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:10 smithi123 ceph-mon[27254]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 7 op/s 2024-05-06T14:01:10.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:10 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2676714576' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-05-06T14:01:10.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:10 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:10.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:10 smithi174 ceph-mon[35160]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 7 op/s 2024-05-06T14:01:10.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:10 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/2676714576' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-05-06T14:01:10.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:10 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:10.662 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T14:01:10.673 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-05-06T14:01:10.674 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-05-06T14:01:10.881 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:11.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-05-06T14:01:11.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: Cluster is now healthy 2024-05-06T14:01:11.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/2676714576' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-05-06T14:01:11.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] up:boot 2024-05-06T14:01:11.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: fsmap cephfs:2 {0=cephfs.smithi123.wnupgd=up:active,1=cephfs.smithi174.rqlodw=up:active} 1 up:standby 2024-05-06T14:01:11.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.cuurje"}]: dispatch 2024-05-06T14:01:11.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:11.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:11.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:11.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi174.hwhiyg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T14:01:11.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi174.hwhiyg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T14:01:11.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:01:11.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:11 smithi174 ceph-mon[35160]: Deploying daemon mds.cephfs.smithi174.hwhiyg on smithi174 2024-05-06T14:01:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-05-06T14:01:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: Cluster is now healthy 2024-05-06T14:01:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2676714576' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-05-06T14:01:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] up:boot 2024-05-06T14:01:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: fsmap cephfs:2 {0=cephfs.smithi123.wnupgd=up:active,1=cephfs.smithi174.rqlodw=up:active} 1 up:standby 2024-05-06T14:01:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.cuurje"}]: dispatch 2024-05-06T14:01:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:11.354 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:11.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:11.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi174.hwhiyg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T14:01:11.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi174.hwhiyg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T14:01:11.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:01:11.355 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:11 smithi123 ceph-mon[27254]: Deploying daemon mds.cephfs.smithi174.hwhiyg on smithi174 2024-05-06T14:01:12.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:12 smithi174 ceph-mon[35160]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 6 op/s 2024-05-06T14:01:12.415 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:12 smithi123 ceph-mon[27254]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 6 op/s 2024-05-06T14:01:12.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.633+0000 7f06ebf2b700 1 -- 172.21.15.123:0/3245566805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e4100bc0 msgr2=0x7f06e4100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:12.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.633+0000 7f06ebf2b700 1 --2- 172.21.15.123:0/3245566805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e4100bc0 0x7f06e4100fe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009910 tx=0x7f06d4009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:12.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.633+0000 7f06ebf2b700 1 -- 172.21.15.123:0/3245566805 shutdown_connections 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.633+0000 7f06ebf2b700 1 --2- 172.21.15.123:0/3245566805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06e4101dc0 0x7f06e4102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.633+0000 7f06ebf2b700 1 --2- 172.21.15.123:0/3245566805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e4100bc0 0x7f06e4100fe0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.633+0000 7f06ebf2b700 1 -- 172.21.15.123:0/3245566805 >> 172.21.15.123:0/3245566805 conn(0x7f06e40fc140 msgr2=0x7f06e40fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.633+0000 7f06ebf2b700 1 -- 172.21.15.123:0/3245566805 shutdown_connections 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.633+0000 7f06ebf2b700 1 -- 172.21.15.123:0/3245566805 wait complete. 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06ebf2b700 1 Processor -- start 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06ebf2b700 1 -- start start 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06ebf2b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06e4100bc0 0x7f06e4196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06ebf2b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e4101dc0 0x7f06e41968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06ebf2b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4196ed0 con 0x7f06e4101dc0 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06ebf2b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4197010 con 0x7f06e4100bc0 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06e94c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e4101dc0 0x7f06e41968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06e94c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e4101dc0 0x7f06e41968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37816/0 (socket says 172.21.15.123:37816) 2024-05-06T14:01:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06e94c6700 1 -- 172.21.15.123:0/2904873224 learned_addr learned my addr 172.21.15.123:0/2904873224 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06e9cc7700 1 --2- 172.21.15.123:0/2904873224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06e4100bc0 0x7f06e4196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06e94c6700 1 -- 172.21.15.123:0/2904873224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06e4100bc0 msgr2=0x7f06e4196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06e94c6700 1 --2- 172.21.15.123:0/2904873224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06e4100bc0 0x7f06e4196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.634+0000 7f06e94c6700 1 -- 172.21.15.123:0/2904873224 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d40095f0 con 0x7f06e4101dc0 2024-05-06T14:01:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.635+0000 7f06e94c6700 1 --2- 172.21.15.123:0/2904873224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e4101dc0 0x7f06e41968b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f06e000c8a0 tx=0x7f06e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.635+0000 7f06daffd700 1 -- 172.21.15.123:0/2904873224 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06e000cea0 con 0x7f06e4101dc0 2024-05-06T14:01:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.635+0000 7f06daffd700 1 -- 172.21.15.123:0/2904873224 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06e0004830 con 0x7f06e4101dc0 2024-05-06T14:01:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.635+0000 7f06ebf2b700 1 -- 172.21.15.123:0/2904873224 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e419bac0 con 0x7f06e4101dc0 2024-05-06T14:01:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.635+0000 7f06daffd700 1 -- 172.21.15.123:0/2904873224 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06e00055b0 con 0x7f06e4101dc0 2024-05-06T14:01:12.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.635+0000 7f06ebf2b700 1 -- 172.21.15.123:0/2904873224 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e419c010 con 0x7f06e4101dc0 2024-05-06T14:01:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.636+0000 7f06ebf2b700 1 -- 172.21.15.123:0/2904873224 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e4109720 con 0x7f06e4101dc0 2024-05-06T14:01:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.636+0000 7f06daffd700 1 -- 172.21.15.123:0/2904873224 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f06e0007ad0 con 0x7f06e4101dc0 2024-05-06T14:01:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.637+0000 7f06daffd700 1 --2- 172.21.15.123:0/2904873224 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f06d006c4e0 0x7f06d006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.637+0000 7f06e9cc7700 1 --2- 172.21.15.123:0/2904873224 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f06d006c4e0 0x7f06d006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.637+0000 7f06daffd700 1 -- 172.21.15.123:0/2904873224 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f06e008b570 con 0x7f06e4101dc0 2024-05-06T14:01:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.637+0000 7f06e9cc7700 1 --2- 172.21.15.123:0/2904873224 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f06d006c4e0 0x7f06d006e9a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f06d4006010 tx=0x7f06d4005920 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:12.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.641+0000 7f06daffd700 1 -- 172.21.15.123:0/2904873224 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f06e00597e0 con 0x7f06e4101dc0 2024-05-06T14:01:12.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:12.879+0000 7f06ebf2b700 1 -- 172.21.15.123:0/2904873224 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f06e4109910 con 0x7f06e4101dc0 2024-05-06T14:01:13.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:13.153+0000 7f06daffd700 1 -- 172.21.15.123:0/2904873224 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v11) v1 ==== 133+0+0 (secure 0 0 0) 0x7f06e0059370 con 0x7f06e4101dc0 2024-05-06T14:01:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:13.156+0000 7f06ebf2b700 1 -- 172.21.15.123:0/2904873224 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f06d006c4e0 msgr2=0x7f06d006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:13.156+0000 7f06ebf2b700 1 --2- 172.21.15.123:0/2904873224 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f06d006c4e0 0x7f06d006e9a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f06d4006010 tx=0x7f06d4005920 comp rx=0 tx=0).stop 2024-05-06T14:01:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:13.156+0000 7f06ebf2b700 1 -- 172.21.15.123:0/2904873224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e4101dc0 msgr2=0x7f06e41968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:13.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:13.156+0000 7f06ebf2b700 1 --2- 172.21.15.123:0/2904873224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e4101dc0 0x7f06e41968b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f06e000c8a0 tx=0x7f06e000cc60 comp rx=0 tx=0).stop 2024-05-06T14:01:13.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:13.156+0000 7f06ebf2b700 1 -- 172.21.15.123:0/2904873224 shutdown_connections 2024-05-06T14:01:13.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:13.156+0000 7f06ebf2b700 1 --2- 172.21.15.123:0/2904873224 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f06d006c4e0 0x7f06d006e9a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:13.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:13.156+0000 7f06ebf2b700 1 --2- 172.21.15.123:0/2904873224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06e4100bc0 0x7f06e4196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:13.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:13.156+0000 7f06ebf2b700 1 --2- 172.21.15.123:0/2904873224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e4101dc0 0x7f06e41968b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:13.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:13.156+0000 7f06ebf2b700 1 -- 172.21.15.123:0/2904873224 >> 172.21.15.123:0/2904873224 conn(0x7f06e40fc140 msgr2=0x7f06e4104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:13.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:13.156+0000 7f06ebf2b700 1 -- 172.21.15.123:0/2904873224 shutdown_connections 2024-05-06T14:01:13.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:13.156+0000 7f06ebf2b700 1 -- 172.21.15.123:0/2904873224 wait complete. 2024-05-06T14:01:13.157 INFO:teuthology.orchestra.run.smithi123.stderr:inline data disabled 2024-05-06T14:01:13.827 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T14:01:13.839 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-05-06T14:01:13.839 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-06T14:01:14.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:13 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:14.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:13 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:14.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:13 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:14.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:13 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:14.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:13 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:14.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:13 smithi123 ceph-mon[27254]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 7 op/s 2024-05-06T14:01:14.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:13 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2904873224' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-05-06T14:01:14.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:13 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T14:01:14.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:13 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.174:6826/2512679992,v1:172.21.15.174:6827/2512679992] up:boot 2024-05-06T14:01:14.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:13 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2904873224' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-05-06T14:01:14.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:13 smithi123 ceph-mon[27254]: fsmap cephfs:2 {0=cephfs.smithi123.wnupgd=up:active,1=cephfs.smithi174.rqlodw=up:active} 2 up:standby 2024-05-06T14:01:14.105 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:13 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi174.hwhiyg"}]: dispatch 2024-05-06T14:01:14.261 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:13 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:14.261 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:13 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:14.261 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:13 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:14.261 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:13 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:14.262 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:13 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:14.262 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:13 smithi174 ceph-mon[35160]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 7 op/s 2024-05-06T14:01:14.262 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:13 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/2904873224' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-05-06T14:01:14.262 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:13 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T14:01:14.262 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:13 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.174:6826/2512679992,v1:172.21.15.174:6827/2512679992] up:boot 2024-05-06T14:01:14.262 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:13 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/2904873224' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-05-06T14:01:14.262 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:13 smithi174 ceph-mon[35160]: fsmap cephfs:2 {0=cephfs.smithi123.wnupgd=up:active,1=cephfs.smithi174.rqlodw=up:active} 2 up:standby 2024-05-06T14:01:14.262 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:13 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi174.hwhiyg"}]: dispatch 2024-05-06T14:01:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:16.085 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:15 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] up:standby 2024-05-06T14:01:16.085 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:15 smithi123 ceph-mon[27254]: Dropping low affinity active daemon mds.cephfs.smithi123.wnupgd in favor of higher affinity standby. 2024-05-06T14:01:16.085 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:15 smithi123 ceph-mon[27254]: Replacing daemon mds.cephfs.smithi123.wnupgd as rank 0 with standby daemon mds.cephfs.smithi123.cuurje 2024-05-06T14:01:16.085 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:15 smithi123 ceph-mon[27254]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-06T14:01:16.086 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:15 smithi123 ceph-mon[27254]: fsmap cephfs:2 {0=cephfs.smithi123.wnupgd=up:active,1=cephfs.smithi174.rqlodw=up:active} 2 up:standby 2024-05-06T14:01:16.086 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:15 smithi123 ceph-mon[27254]: osdmap e46: 6 total, 6 up, 6 in 2024-05-06T14:01:16.086 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:15 smithi123 ceph-mon[27254]: fsmap cephfs:2/2 {0=cephfs.smithi123.cuurje=up:replay,1=cephfs.smithi174.rqlodw=up:active} 1 up:standby 2024-05-06T14:01:16.086 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:15 smithi123 ceph-mon[27254]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-05-06T14:01:16.086 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:15 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:16.087 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:15 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:16.087 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:15 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:16.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:15 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] up:standby 2024-05-06T14:01:16.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:15 smithi174 ceph-mon[35160]: Dropping low affinity active daemon mds.cephfs.smithi123.wnupgd in favor of higher affinity standby. 2024-05-06T14:01:16.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:15 smithi174 ceph-mon[35160]: Replacing daemon mds.cephfs.smithi123.wnupgd as rank 0 with standby daemon mds.cephfs.smithi123.cuurje 2024-05-06T14:01:16.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:15 smithi174 ceph-mon[35160]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-06T14:01:16.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:15 smithi174 ceph-mon[35160]: fsmap cephfs:2 {0=cephfs.smithi123.wnupgd=up:active,1=cephfs.smithi174.rqlodw=up:active} 2 up:standby 2024-05-06T14:01:16.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:15 smithi174 ceph-mon[35160]: osdmap e46: 6 total, 6 up, 6 in 2024-05-06T14:01:16.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:15 smithi174 ceph-mon[35160]: fsmap cephfs:2/2 {0=cephfs.smithi123.cuurje=up:replay,1=cephfs.smithi174.rqlodw=up:active} 1 up:standby 2024-05-06T14:01:16.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:15 smithi174 ceph-mon[35160]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-05-06T14:01:16.273 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:15 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:16.274 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:15 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:16.274 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:15 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.885+0000 7f4b4f763700 1 -- 172.21.15.123:0/3572889707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b48103f70 msgr2=0x7f4b48106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.885+0000 7f4b4f763700 1 --2- 172.21.15.123:0/3572889707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b48103f70 0x7f4b48106360 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009910 tx=0x7f4b38009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.885+0000 7f4b4f763700 1 -- 172.21.15.123:0/3572889707 shutdown_connections 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.885+0000 7f4b4f763700 1 --2- 172.21.15.123:0/3572889707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b48103f70 0x7f4b48106360 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.885+0000 7f4b4f763700 1 --2- 172.21.15.123:0/3572889707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b48101640 0x7f4b48103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.885+0000 7f4b4f763700 1 -- 172.21.15.123:0/3572889707 >> 172.21.15.123:0/3572889707 conn(0x7f4b480fb030 msgr2=0x7f4b480fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.886+0000 7f4b4f763700 1 -- 172.21.15.123:0/3572889707 shutdown_connections 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.886+0000 7f4b4f763700 1 -- 172.21.15.123:0/3572889707 wait complete. 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.886+0000 7f4b4f763700 1 Processor -- start 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.886+0000 7f4b4f763700 1 -- start start 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.886+0000 7f4b4f763700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b48101640 0x7f4b48100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.886+0000 7f4b4f763700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b48103f70 0x7f4b480ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.886+0000 7f4b4f763700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480ffb30 con 0x7f4b48103f70 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.886+0000 7f4b4f763700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480ffc70 con 0x7f4b48101640 2024-05-06T14:01:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.886+0000 7f4b4ccfe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b48103f70 0x7f4b480ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.886+0000 7f4b4ccfe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b48103f70 0x7f4b480ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37866/0 (socket says 172.21.15.123:37866) 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.886+0000 7f4b4ccfe700 1 -- 172.21.15.123:0/2534482300 learned_addr learned my addr 172.21.15.123:0/2534482300 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.887+0000 7f4b4d4ff700 1 --2- 172.21.15.123:0/2534482300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b48101640 0x7f4b48100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.887+0000 7f4b4ccfe700 1 -- 172.21.15.123:0/2534482300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b48101640 msgr2=0x7f4b48100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.887+0000 7f4b4ccfe700 1 --2- 172.21.15.123:0/2534482300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b48101640 0x7f4b48100fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.887+0000 7f4b4ccfe700 1 -- 172.21.15.123:0/2534482300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b380095f0 con 0x7f4b48103f70 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.887+0000 7f4b4d4ff700 1 --2- 172.21.15.123:0/2534482300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b48101640 0x7f4b48100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.887+0000 7f4b4ccfe700 1 --2- 172.21.15.123:0/2534482300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b48103f70 0x7f4b480ff5f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4b38006010 tx=0x7f4b3800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.887+0000 7f4b3e7fc700 1 -- 172.21.15.123:0/2534482300 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b3801d070 con 0x7f4b48103f70 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.887+0000 7f4b4f763700 1 -- 172.21.15.123:0/2534482300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b480ffef0 con 0x7f4b48103f70 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.887+0000 7f4b3e7fc700 1 -- 172.21.15.123:0/2534482300 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b3800f460 con 0x7f4b48103f70 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.887+0000 7f4b3e7fc700 1 -- 172.21.15.123:0/2534482300 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b38021640 con 0x7f4b48103f70 2024-05-06T14:01:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.887+0000 7f4b4f763700 1 -- 172.21.15.123:0/2534482300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b481003e0 con 0x7f4b48103f70 2024-05-06T14:01:16.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.888+0000 7f4b4f763700 1 -- 172.21.15.123:0/2534482300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b48190520 con 0x7f4b48103f70 2024-05-06T14:01:16.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.888+0000 7f4b3e7fc700 1 -- 172.21.15.123:0/2534482300 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f4b3800fab0 con 0x7f4b48103f70 2024-05-06T14:01:16.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.889+0000 7f4b3e7fc700 1 --2- 172.21.15.123:0/2534482300 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f4b3406c4e0 0x7f4b3406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:16.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.889+0000 7f4b3e7fc700 1 -- 172.21.15.123:0/2534482300 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4b3808cd10 con 0x7f4b48103f70 2024-05-06T14:01:16.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.889+0000 7f4b4d4ff700 1 --2- 172.21.15.123:0/2534482300 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f4b3406c4e0 0x7f4b3406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:16.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.889+0000 7f4b4d4ff700 1 --2- 172.21.15.123:0/2534482300 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f4b3406c4e0 0x7f4b3406e9a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4b44005950 tx=0x7f4b44005f50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:16.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:16.894+0000 7f4b3e7fc700 1 -- 172.21.15.123:0/2534482300 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4b3805b040 con 0x7f4b48103f70 2024-05-06T14:01:17.058 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:16 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] up:resolve 2024-05-06T14:01:17.059 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:16 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.123:6826/1358202366,v1:172.21.15.123:6827/1358202366] up:boot 2024-05-06T14:01:17.059 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:16 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.174:6824/1977628229,v1:172.21.15.174:6825/1977628229] up:active 2024-05-06T14:01:17.059 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:16 smithi123 ceph-mon[27254]: fsmap cephfs:2/2 {0=cephfs.smithi123.cuurje=up:resolve,1=cephfs.smithi174.rqlodw=up:active} 2 up:standby 2024-05-06T14:01:17.059 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:16 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.wnupgd"}]: dispatch 2024-05-06T14:01:17.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.134+0000 7f4b4f763700 1 -- 172.21.15.123:0/2534482300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4b480619a0 con 0x7f4b48103f70 2024-05-06T14:01:17.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.134+0000 7f4b3e7fc700 1 -- 172.21.15.123:0/2534482300 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1844 (secure 0 0 0) 0x7f4b38026750 con 0x7f4b48103f70 2024-05-06T14:01:17.135 INFO:teuthology.orchestra.run.smithi123.stdout:e15 2024-05-06T14:01:17.135 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T14:01:17.135 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T14:01:17.135 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-05-06T14:01:17.135 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T14:01:17.135 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-05-06T14:01:17.135 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-05-06T14:01:17.135 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 15 2024-05-06T14:01:17.135 INFO:teuthology.orchestra.run.smithi123.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T14:01:17.135 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-05-06T14:00:59.031457+0000 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-05-06T14:01:16.846750+0000 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 60 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 46 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 2 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:in 0,1 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=14504,1=24263} 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-05-06T14:01:17.136 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data disabled 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 1 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.cuurje{0:14504} state up:reconnect seq 4 join_fscid=1 addr [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi174.rqlodw{1:24263} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.174:6824/1977628229,v1:172.21.15.174:6825/1977628229] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-05-06T14:01:17.137 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T14:01:17.138 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi123.wnupgd{-1:14516} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.123:6826/1358202366,v1:172.21.15.123:6827/1358202366] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T14:01:17.138 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.cephfs.smithi174.hwhiyg{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.174:6826/2512679992,v1:172.21.15.174:6827/2512679992] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T14:01:17.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.136+0000 7f4b4f763700 1 -- 172.21.15.123:0/2534482300 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f4b3406c4e0 msgr2=0x7f4b3406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:17.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.136+0000 7f4b4f763700 1 --2- 172.21.15.123:0/2534482300 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f4b3406c4e0 0x7f4b3406e9a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4b44005950 tx=0x7f4b44005f50 comp rx=0 tx=0).stop 2024-05-06T14:01:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.136+0000 7f4b4f763700 1 -- 172.21.15.123:0/2534482300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b48103f70 msgr2=0x7f4b480ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.136+0000 7f4b4f763700 1 --2- 172.21.15.123:0/2534482300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b48103f70 0x7f4b480ff5f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4b38006010 tx=0x7f4b3800be20 comp rx=0 tx=0).stop 2024-05-06T14:01:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.136+0000 7f4b4f763700 1 -- 172.21.15.123:0/2534482300 shutdown_connections 2024-05-06T14:01:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.136+0000 7f4b4f763700 1 --2- 172.21.15.123:0/2534482300 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f4b3406c4e0 0x7f4b3406e9a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.136+0000 7f4b4f763700 1 --2- 172.21.15.123:0/2534482300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b48101640 0x7f4b48100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.136+0000 7f4b4f763700 1 --2- 172.21.15.123:0/2534482300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b48103f70 0x7f4b480ff5f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.136+0000 7f4b4f763700 1 -- 172.21.15.123:0/2534482300 >> 172.21.15.123:0/2534482300 conn(0x7f4b480fb030 msgr2=0x7f4b480fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.136+0000 7f4b4f763700 1 -- 172.21.15.123:0/2534482300 shutdown_connections 2024-05-06T14:01:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:17.136+0000 7f4b4f763700 1 -- 172.21.15.123:0/2534482300 wait complete. 2024-05-06T14:01:17.139 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-05-06T14:01:17.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:16 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] up:resolve 2024-05-06T14:01:17.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:16 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.123:6826/1358202366,v1:172.21.15.123:6827/1358202366] up:boot 2024-05-06T14:01:17.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:16 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.174:6824/1977628229,v1:172.21.15.174:6825/1977628229] up:active 2024-05-06T14:01:17.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:16 smithi174 ceph-mon[35160]: fsmap cephfs:2/2 {0=cephfs.smithi123.cuurje=up:resolve,1=cephfs.smithi174.rqlodw=up:active} 2 up:standby 2024-05-06T14:01:17.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:16 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi123.wnupgd"}]: dispatch 2024-05-06T14:01:17.750 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-05-06T14:01:18.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:17 smithi123 ceph-mon[27254]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 409 B/s rd, 2.4 KiB/s wr, 8 op/s 2024-05-06T14:01:18.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:17 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] up:reconnect 2024-05-06T14:01:18.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:17 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.174:6826/2512679992,v1:172.21.15.174:6827/2512679992] up:standby 2024-05-06T14:01:18.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:17 smithi123 ceph-mon[27254]: fsmap cephfs:2/2 {0=cephfs.smithi123.cuurje=up:reconnect,1=cephfs.smithi174.rqlodw=up:active} 2 up:standby 2024-05-06T14:01:18.104 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:17 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2534482300' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T14:01:18.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:17 smithi174 ceph-mon[35160]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 409 B/s rd, 2.4 KiB/s wr, 8 op/s 2024-05-06T14:01:18.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:17 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] up:reconnect 2024-05-06T14:01:18.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:17 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.174:6826/2512679992,v1:172.21.15.174:6827/2512679992] up:standby 2024-05-06T14:01:18.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:17 smithi174 ceph-mon[35160]: fsmap cephfs:2/2 {0=cephfs.smithi123.cuurje=up:reconnect,1=cephfs.smithi174.rqlodw=up:active} 2 up:standby 2024-05-06T14:01:18.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:17 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/2534482300' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T14:01:18.484 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:19.090 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:18 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] up:rejoin 2024-05-06T14:01:19.091 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:18 smithi123 ceph-mon[27254]: fsmap cephfs:2/2 {0=cephfs.smithi123.cuurje=up:rejoin,1=cephfs.smithi174.rqlodw=up:active} 2 up:standby 2024-05-06T14:01:19.091 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:18 smithi123 ceph-mon[27254]: daemon mds.cephfs.smithi123.cuurje is now active in filesystem cephfs as rank 0 2024-05-06T14:01:19.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:18 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] up:rejoin 2024-05-06T14:01:19.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:18 smithi174 ceph-mon[35160]: fsmap cephfs:2/2 {0=cephfs.smithi123.cuurje=up:rejoin,1=cephfs.smithi174.rqlodw=up:active} 2 up:standby 2024-05-06T14:01:19.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:18 smithi174 ceph-mon[35160]: daemon mds.cephfs.smithi123.cuurje is now active in filesystem cephfs as rank 0 2024-05-06T14:01:20.083 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:19 smithi123 ceph-mon[27254]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-05-06T14:01:20.083 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:19 smithi123 ceph-mon[27254]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-06T14:01:20.083 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:19 smithi123 ceph-mon[27254]: Cluster is now healthy 2024-05-06T14:01:20.083 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:19 smithi123 ceph-mon[27254]: mds.? [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] up:active 2024-05-06T14:01:20.083 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:19 smithi123 ceph-mon[27254]: fsmap cephfs:2 {0=cephfs.smithi123.cuurje=up:active,1=cephfs.smithi174.rqlodw=up:active} 2 up:standby 2024-05-06T14:01:20.083 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:19 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:01:20.189 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:19 smithi174 ceph-mon[35160]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-05-06T14:01:20.189 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:19 smithi174 ceph-mon[35160]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-06T14:01:20.189 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:19 smithi174 ceph-mon[35160]: Cluster is now healthy 2024-05-06T14:01:20.189 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:19 smithi174 ceph-mon[35160]: mds.? [v2:172.21.15.123:6828/1799598930,v1:172.21.15.123:6829/1799598930] up:active 2024-05-06T14:01:20.189 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:19 smithi174 ceph-mon[35160]: fsmap cephfs:2 {0=cephfs.smithi123.cuurje=up:active,1=cephfs.smithi174.rqlodw=up:active} 2 up:standby 2024-05-06T14:01:20.189 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:19 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:01:20.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.334+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2877066305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf80ffab0 msgr2=0x7f0cf80ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:20.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.334+0000 7f0cff5d5700 1 --2- 172.21.15.123:0/2877066305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf80ffab0 0x7f0cf80ffed0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009910 tx=0x7f0cf4009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:20.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.334+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2877066305 shutdown_connections 2024-05-06T14:01:20.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.334+0000 7f0cff5d5700 1 --2- 172.21.15.123:0/2877066305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cf8100cb0 0x7f0cf8101110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:20.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.334+0000 7f0cff5d5700 1 --2- 172.21.15.123:0/2877066305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf80ffab0 0x7f0cf80ffed0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:20.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.334+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2877066305 >> 172.21.15.123:0/2877066305 conn(0x7f0cf80fb010 msgr2=0x7f0cf80fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.334+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2877066305 shutdown_connections 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.334+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2877066305 wait complete. 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cff5d5700 1 Processor -- start 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cff5d5700 1 -- start start 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cff5d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf80ffab0 0x7f0cf8196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cff5d5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cf8100cb0 0x7f0cf81968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cff5d5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8196ef0 con 0x7f0cf80ffab0 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cff5d5700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8197030 con 0x7f0cf8100cb0 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cfd371700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf80ffab0 0x7f0cf8196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cfd371700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf80ffab0 0x7f0cf8196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40598/0 (socket says 172.21.15.123:40598) 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cfd371700 1 -- 172.21.15.123:0/2360477026 learned_addr learned my addr 172.21.15.123:0/2360477026 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cfcb70700 1 --2- 172.21.15.123:0/2360477026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cf8100cb0 0x7f0cf81968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cfd371700 1 -- 172.21.15.123:0/2360477026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cf8100cb0 msgr2=0x7f0cf81968d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cfd371700 1 --2- 172.21.15.123:0/2360477026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cf8100cb0 0x7f0cf81968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cfd371700 1 -- 172.21.15.123:0/2360477026 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40095f0 con 0x7f0cf80ffab0 2024-05-06T14:01:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.335+0000 7f0cfd371700 1 --2- 172.21.15.123:0/2360477026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf80ffab0 0x7f0cf8196390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400bda0 tx=0x7f0cf400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.336+0000 7f0cee7fc700 1 -- 172.21.15.123:0/2360477026 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf401d070 con 0x7f0cf80ffab0 2024-05-06T14:01:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.336+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2360477026 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf819ba80 con 0x7f0cf80ffab0 2024-05-06T14:01:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.336+0000 7f0cee7fc700 1 -- 172.21.15.123:0/2360477026 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0cf400f460 con 0x7f0cf80ffab0 2024-05-06T14:01:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.336+0000 7f0cee7fc700 1 -- 172.21.15.123:0/2360477026 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf4021640 con 0x7f0cf80ffab0 2024-05-06T14:01:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.336+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2360477026 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf819bf70 con 0x7f0cf80ffab0 2024-05-06T14:01:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.337+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2360477026 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf8108610 con 0x7f0cf80ffab0 2024-05-06T14:01:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.337+0000 7f0cee7fc700 1 -- 172.21.15.123:0/2360477026 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f0cf400fa00 con 0x7f0cf80ffab0 2024-05-06T14:01:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.338+0000 7f0cee7fc700 1 --2- 172.21.15.123:0/2360477026 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f0ce406c4e0 0x7f0ce406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.338+0000 7f0cee7fc700 1 -- 172.21.15.123:0/2360477026 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0cf408cb20 con 0x7f0cf80ffab0 2024-05-06T14:01:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.338+0000 7f0cfcb70700 1 --2- 172.21.15.123:0/2360477026 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f0ce406c4e0 0x7f0ce406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.338+0000 7f0cfcb70700 1 --2- 172.21.15.123:0/2360477026 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f0ce406c4e0 0x7f0ce406e9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8005950 tx=0x7f0ce80058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:20.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.342+0000 7f0cee7fc700 1 -- 172.21.15.123:0/2360477026 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0cf405ad30 con 0x7f0cf80ffab0 2024-05-06T14:01:20.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.580+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2360477026 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cf819c640 con 0x7f0cf80ffab0 2024-05-06T14:01:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.580+0000 7f0cee7fc700 1 -- 172.21.15.123:0/2360477026 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4766 (secure 0 0 0) 0x7f0cf405a8c0 con 0x7f0cf80ffab0 2024-05-06T14:01:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.582+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2360477026 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f0ce406c4e0 msgr2=0x7f0ce406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.582+0000 7f0cff5d5700 1 --2- 172.21.15.123:0/2360477026 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f0ce406c4e0 0x7f0ce406e9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8005950 tx=0x7f0ce80058e0 comp rx=0 tx=0).stop 2024-05-06T14:01:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.582+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2360477026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf80ffab0 msgr2=0x7f0cf8196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.582+0000 7f0cff5d5700 1 --2- 172.21.15.123:0/2360477026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf80ffab0 0x7f0cf8196390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400bda0 tx=0x7f0cf400be80 comp rx=0 tx=0).stop 2024-05-06T14:01:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.583+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2360477026 shutdown_connections 2024-05-06T14:01:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.583+0000 7f0cff5d5700 1 --2- 172.21.15.123:0/2360477026 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f0ce406c4e0 0x7f0ce406e9a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.583+0000 7f0cff5d5700 1 --2- 172.21.15.123:0/2360477026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cf80ffab0 0x7f0cf8196390 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.583+0000 7f0cff5d5700 1 --2- 172.21.15.123:0/2360477026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cf8100cb0 0x7f0cf81968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.583+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2360477026 >> 172.21.15.123:0/2360477026 conn(0x7f0cf80fb010 msgr2=0x7f0cf8068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.583+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2360477026 shutdown_connections 2024-05-06T14:01:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:20.583+0000 7f0cff5d5700 1 -- 172.21.15.123:0/2360477026 wait complete. 2024-05-06T14:01:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-05-06T14:01:20.594 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-05-06T14:01:21.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:21 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/2360477026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-06T14:01:21.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:21 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/2360477026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-06T14:01:21.658 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-05-06T14:01:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:22.265 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:22 smithi123 ceph-mon[27254]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-05-06T14:01:22.265 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:22.265 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:22.265 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:01:22.265 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T14:01:22.265 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:22 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:22.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:22 smithi174 ceph-mon[35160]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-05-06T14:01:22.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:22.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:22.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:01:22.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T14:01:22.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:22 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:23.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:23 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T14:01:23.344 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:23 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T14:01:23.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.687+0000 7fccb19f4700 1 -- 172.21.15.123:0/3274139267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccac100bc0 msgr2=0x7fccac100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:23.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.687+0000 7fccb19f4700 1 --2- 172.21.15.123:0/3274139267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccac100bc0 0x7fccac100fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009910 tx=0x7fcc9c009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:23.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.687+0000 7fccb19f4700 1 -- 172.21.15.123:0/3274139267 shutdown_connections 2024-05-06T14:01:23.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.687+0000 7fccb19f4700 1 --2- 172.21.15.123:0/3274139267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccac101dc0 0x7fccac102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:23.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.687+0000 7fccb19f4700 1 --2- 172.21.15.123:0/3274139267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccac100bc0 0x7fccac100fe0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:23.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.687+0000 7fccb19f4700 1 -- 172.21.15.123:0/3274139267 >> 172.21.15.123:0/3274139267 conn(0x7fccac0fc140 msgr2=0x7fccac0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:23.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.687+0000 7fccb19f4700 1 -- 172.21.15.123:0/3274139267 shutdown_connections 2024-05-06T14:01:23.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.687+0000 7fccb19f4700 1 -- 172.21.15.123:0/3274139267 wait complete. 2024-05-06T14:01:23.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccb19f4700 1 Processor -- start 2024-05-06T14:01:23.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccb19f4700 1 -- start start 2024-05-06T14:01:23.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccb19f4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccac100bc0 0x7fccac074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:23.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccb19f4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccac101dc0 0x7fccac073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:23.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccb19f4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0736c0 con 0x7fccac101dc0 2024-05-06T14:01:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccb19f4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac073800 con 0x7fccac100bc0 2024-05-06T14:01:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccaa7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccac101dc0 0x7fccac073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccaa7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccac101dc0 0x7fccac073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40616/0 (socket says 172.21.15.123:40616) 2024-05-06T14:01:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccaa7fc700 1 -- 172.21.15.123:0/899505938 learned_addr learned my addr 172.21.15.123:0/899505938 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccaaffd700 1 --2- 172.21.15.123:0/899505938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccac100bc0 0x7fccac074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccaa7fc700 1 -- 172.21.15.123:0/899505938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccac100bc0 msgr2=0x7fccac074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccaa7fc700 1 --2- 172.21.15.123:0/899505938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccac100bc0 0x7fccac074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccaa7fc700 1 -- 172.21.15.123:0/899505938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c0095f0 con 0x7fccac101dc0 2024-05-06T14:01:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccaaffd700 1 --2- 172.21.15.123:0/899505938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccac100bc0 0x7fccac074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T14:01:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.688+0000 7fccaa7fc700 1 --2- 172.21.15.123:0/899505938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccac101dc0 0x7fccac073180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c8a0 tx=0x7fcc9400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.689+0000 7fccb09f2700 1 -- 172.21.15.123:0/899505938 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc9400cea0 con 0x7fccac101dc0 2024-05-06T14:01:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.689+0000 7fccb19f4700 1 -- 172.21.15.123:0/899505938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccac073ae0 con 0x7fccac101dc0 2024-05-06T14:01:23.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.689+0000 7fccb09f2700 1 -- 172.21.15.123:0/899505938 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc94004830 con 0x7fccac101dc0 2024-05-06T14:01:23.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.689+0000 7fccb09f2700 1 -- 172.21.15.123:0/899505938 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc940055b0 con 0x7fccac101dc0 2024-05-06T14:01:23.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.689+0000 7fccb19f4700 1 -- 172.21.15.123:0/899505938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac19e3f0 con 0x7fccac101dc0 2024-05-06T14:01:23.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.690+0000 7fccb19f4700 1 -- 172.21.15.123:0/899505938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccac109720 con 0x7fccac101dc0 2024-05-06T14:01:23.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.690+0000 7fccb09f2700 1 -- 172.21.15.123:0/899505938 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fcc94007ad0 con 0x7fccac101dc0 2024-05-06T14:01:23.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.690+0000 7fccb09f2700 1 --2- 172.21.15.123:0/899505938 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fcc9806c4e0 0x7fcc9806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:23.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.691+0000 7fccb09f2700 1 -- 172.21.15.123:0/899505938 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fcc9408b5e0 con 0x7fccac101dc0 2024-05-06T14:01:23.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.691+0000 7fccaaffd700 1 --2- 172.21.15.123:0/899505938 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fcc9806c4e0 0x7fcc9806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:23.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.691+0000 7fccaaffd700 1 --2- 172.21.15.123:0/899505938 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fcc9806c4e0 0x7fcc9806e9a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c006010 tx=0x7fcc9c005c00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:23.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.695+0000 7fccb09f2700 1 -- 172.21.15.123:0/899505938 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcc940597f0 con 0x7fccac101dc0 2024-05-06T14:01:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.976+0000 7fccb19f4700 1 -- 172.21.15.123:0/899505938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fccac19e9a0 con 0x7fccac101dc0 2024-05-06T14:01:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.976+0000 7fccb09f2700 1 -- 172.21.15.123:0/899505938 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v17) v1 ==== 78+0+83 (secure 0 0 0) 0x7fcc94059380 con 0x7fccac101dc0 2024-05-06T14:01:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.978+0000 7fccb19f4700 1 -- 172.21.15.123:0/899505938 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fcc9806c4e0 msgr2=0x7fcc9806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.978+0000 7fccb19f4700 1 --2- 172.21.15.123:0/899505938 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fcc9806c4e0 0x7fcc9806e9a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c006010 tx=0x7fcc9c005c00 comp rx=0 tx=0).stop 2024-05-06T14:01:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.978+0000 7fccb19f4700 1 -- 172.21.15.123:0/899505938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccac101dc0 msgr2=0x7fccac073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.978+0000 7fccb19f4700 1 --2- 172.21.15.123:0/899505938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccac101dc0 0x7fccac073180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c8a0 tx=0x7fcc9400cc60 comp rx=0 tx=0).stop 2024-05-06T14:01:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.978+0000 7fccb19f4700 1 -- 172.21.15.123:0/899505938 shutdown_connections 2024-05-06T14:01:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.978+0000 7fccb19f4700 1 --2- 172.21.15.123:0/899505938 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fcc9806c4e0 0x7fcc9806e9a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.978+0000 7fccb19f4700 1 --2- 172.21.15.123:0/899505938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccac100bc0 0x7fccac074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.978+0000 7fccb19f4700 1 --2- 172.21.15.123:0/899505938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccac101dc0 0x7fccac073180 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.978+0000 7fccb19f4700 1 -- 172.21.15.123:0/899505938 >> 172.21.15.123:0/899505938 conn(0x7fccac0fc140 msgr2=0x7fccac104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.978+0000 7fccb19f4700 1 -- 172.21.15.123:0/899505938 shutdown_connections 2024-05-06T14:01:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:23.978+0000 7fccb19f4700 1 -- 172.21.15.123:0/899505938 wait complete. 2024-05-06T14:01:23.989 INFO:teuthology.orchestra.run.smithi123.stdout:true 2024-05-06T14:01:24.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:24 smithi174 ceph-mon[35160]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-06T14:01:24.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:24 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/899505938' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-05-06T14:01:24.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:24 smithi123 ceph-mon[27254]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-06T14:01:24.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:24 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/899505938' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-05-06T14:01:25.033 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-05-06T14:01:25.096 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-06T14:01:25.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:25 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:25.522 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:25 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:25.599 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:25 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:25.599 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:25 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:25.951 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:26.603 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:26 smithi123 ceph-mon[27254]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-06T14:01:26.772 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:26 smithi174 ceph-mon[35160]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-06T14:01:27.603 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:27 smithi123 ceph-mon[27254]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-06T14:01:27.772 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:27 smithi174 ceph-mon[35160]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-06T14:01:28.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.796+0000 7f06c1469700 1 -- 172.21.15.123:0/2666615980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06bc105a40 msgr2=0x7f06bc105e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:28.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.796+0000 7f06c1469700 1 --2- 172.21.15.123:0/2666615980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06bc105a40 0x7f06bc105e20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009910 tx=0x7f06ac009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:28.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.796+0000 7f06c1469700 1 -- 172.21.15.123:0/2666615980 shutdown_connections 2024-05-06T14:01:28.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.796+0000 7f06c1469700 1 --2- 172.21.15.123:0/2666615980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06bc0ffa40 0x7f06bc0ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:28.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.796+0000 7f06c1469700 1 --2- 172.21.15.123:0/2666615980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06bc105a40 0x7f06bc105e20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:28.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.796+0000 7f06c1469700 1 -- 172.21.15.123:0/2666615980 >> 172.21.15.123:0/2666615980 conn(0x7f06bc0fb570 msgr2=0x7f06bc0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:28.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.796+0000 7f06c1469700 1 -- 172.21.15.123:0/2666615980 shutdown_connections 2024-05-06T14:01:28.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.796+0000 7f06c1469700 1 -- 172.21.15.123:0/2666615980 wait complete. 2024-05-06T14:01:28.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.796+0000 7f06c1469700 1 Processor -- start 2024-05-06T14:01:28.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.796+0000 7f06c1469700 1 -- start start 2024-05-06T14:01:28.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06c1469700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06bc0ffa40 0x7f06bc0fbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:28.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06c1469700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06bc105a40 0x7f06bc0fc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:28.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06c1469700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc0fc900 con 0x7f06bc0ffa40 2024-05-06T14:01:28.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06c1469700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc0fca70 con 0x7f06bc105a40 2024-05-06T14:01:28.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06baffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06bc0ffa40 0x7f06bc0fbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:28.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06baffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06bc0ffa40 0x7f06bc0fbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34078/0 (socket says 172.21.15.123:34078) 2024-05-06T14:01:28.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06baffd700 1 -- 172.21.15.123:0/1012556398 learned_addr learned my addr 172.21.15.123:0/1012556398 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:28.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06ba7fc700 1 --2- 172.21.15.123:0/1012556398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06bc105a40 0x7f06bc0fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:28.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06baffd700 1 -- 172.21.15.123:0/1012556398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06bc105a40 msgr2=0x7f06bc0fc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:28.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06baffd700 1 --2- 172.21.15.123:0/1012556398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06bc105a40 0x7f06bc0fc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:28.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06baffd700 1 -- 172.21.15.123:0/1012556398 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0095f0 con 0x7f06bc0ffa40 2024-05-06T14:01:28.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06baffd700 1 --2- 172.21.15.123:0/1012556398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06bc0ffa40 0x7f06bc0fbdf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f06ac006010 tx=0x7f06ac00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:28.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06a3fff700 1 -- 172.21.15.123:0/1012556398 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06ac01d070 con 0x7f06bc0ffa40 2024-05-06T14:01:28.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06a3fff700 1 -- 172.21.15.123:0/1012556398 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06ac00f460 con 0x7f06bc0ffa40 2024-05-06T14:01:28.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06c1469700 1 -- 172.21.15.123:0/1012556398 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06bc1a28e0 con 0x7f06bc0ffa40 2024-05-06T14:01:28.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06a3fff700 1 -- 172.21.15.123:0/1012556398 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06ac017630 con 0x7f06bc0ffa40 2024-05-06T14:01:28.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.797+0000 7f06c1469700 1 -- 172.21.15.123:0/1012556398 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06bc1a2c90 con 0x7f06bc0ffa40 2024-05-06T14:01:28.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.798+0000 7f06c1469700 1 -- 172.21.15.123:0/1012556398 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06bc109050 con 0x7f06bc0ffa40 2024-05-06T14:01:28.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.799+0000 7f06a3fff700 1 -- 172.21.15.123:0/1012556398 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f06ac00f5d0 con 0x7f06bc0ffa40 2024-05-06T14:01:28.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.799+0000 7f06a3fff700 1 --2- 172.21.15.123:0/1012556398 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f06a406c4e0 0x7f06a406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:28.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.799+0000 7f06ba7fc700 1 --2- 172.21.15.123:0/1012556398 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f06a406c4e0 0x7f06a406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:28.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.799+0000 7f06a3fff700 1 -- 172.21.15.123:0/1012556398 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f06ac08cc50 con 0x7f06bc0ffa40 2024-05-06T14:01:28.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.800+0000 7f06ba7fc700 1 --2- 172.21.15.123:0/1012556398 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f06a406c4e0 0x7f06a406e9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0fd5e0 tx=0x7f06b00073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:28.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:28.804+0000 7f06a3fff700 1 -- 172.21.15.123:0/1012556398 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f06ac0573d0 con 0x7f06bc0ffa40 2024-05-06T14:01:29.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.041+0000 7f06c1469700 1 -- 172.21.15.123:0/1012556398 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06bc04ea90 con 0x7f06bc0ffa40 2024-05-06T14:01:29.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.041+0000 7f06a3fff700 1 -- 172.21.15.123:0/1012556398 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4766 (secure 0 0 0) 0x7f06ac05a9f0 con 0x7f06bc0ffa40 2024-05-06T14:01:29.042 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-05-06T14:01:29.042 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14516,"name":"cephfs.smithi123.wnupgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6827/1358202366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1358202366},{"type":"v1","addr":"172.21.15.123:6827","nonce":1358202366}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24277,"name":"cephfs.smithi174.hwhiyg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6827/2512679992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2512679992},{"type":"v1","addr":"172.21.15.174:6827","nonce":2512679992}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T14:00:59.031457+0000","modified":"2024-05-06T14:01:18.864887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14504,"mds_1":24263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14504":{"gid":14504,"name":"cephfs.smithi123.cuurje","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.123:6829/1799598930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1799598930},{"type":"v1","addr":"172.21.15.123:6829","nonce":1799598930}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24263":{"gid":24263,"name":"cephfs.smithi174.rqlodw","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.174:6825/1977628229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1977628229},{"type":"v1","addr":"172.21.15.174:6825","nonce":1977628229}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-06T14:01:29.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.043+0000 7f06c1469700 1 -- 172.21.15.123:0/1012556398 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f06a406c4e0 msgr2=0x7f06a406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:29.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.043+0000 7f06c1469700 1 --2- 172.21.15.123:0/1012556398 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f06a406c4e0 0x7f06a406e9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0fd5e0 tx=0x7f06b00073d0 comp rx=0 tx=0).stop 2024-05-06T14:01:29.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.043+0000 7f06c1469700 1 -- 172.21.15.123:0/1012556398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06bc0ffa40 msgr2=0x7f06bc0fbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:29.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.043+0000 7f06c1469700 1 --2- 172.21.15.123:0/1012556398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06bc0ffa40 0x7f06bc0fbdf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f06ac006010 tx=0x7f06ac00bd70 comp rx=0 tx=0).stop 2024-05-06T14:01:29.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.043+0000 7f06c1469700 1 -- 172.21.15.123:0/1012556398 shutdown_connections 2024-05-06T14:01:29.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.043+0000 7f06c1469700 1 --2- 172.21.15.123:0/1012556398 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f06a406c4e0 0x7f06a406e9a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:29.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.043+0000 7f06c1469700 1 --2- 172.21.15.123:0/1012556398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06bc0ffa40 0x7f06bc0fbdf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:29.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.043+0000 7f06c1469700 1 --2- 172.21.15.123:0/1012556398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06bc105a40 0x7f06bc0fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:29.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.043+0000 7f06c1469700 1 -- 172.21.15.123:0/1012556398 >> 172.21.15.123:0/1012556398 conn(0x7f06bc0fb570 msgr2=0x7f06bc068fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:29.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.044+0000 7f06c1469700 1 -- 172.21.15.123:0/1012556398 shutdown_connections 2024-05-06T14:01:29.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:29.044+0000 7f06c1469700 1 -- 172.21.15.123:0/1012556398 wait complete. 2024-05-06T14:01:29.045 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-05-06T14:01:29.683 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 17, 'max_mds': 2, 'flags': 18} 2024-05-06T14:01:29.683 INFO:teuthology.run_tasks:Running task kclient... 2024-05-06T14:01:29.780 INFO:tasks.kclient:Mounting kernel clients... 2024-05-06T14:01:29.780 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-05-06T14:01:29.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:29.781 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-05-06T14:01:29.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:29.797 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-05-06T14:01:29.866 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-05-06T14:01:29.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T14:01:29.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:29.869 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-06T14:01:29.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:29.888 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-05-06T14:01:29.960 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2024-05-06T14:01:29.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:29 smithi123 ceph-mon[27254]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-06T14:01:29.961 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:29 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1012556398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-06T14:01:29.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T14:01:29.962 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-06T14:01:29.963 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-06T14:01:29.963 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-06T14:01:29.963 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-06T14:01:30.253 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:30.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:29 smithi174 ceph-mon[35160]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-06T14:01:30.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:29 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/1012556398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-06T14:01:31.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.822+0000 7f41ac5e1700 1 -- 172.21.15.123:0/3678393575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a4101770 msgr2=0x7f41a41057c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:31.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.822+0000 7f41ac5e1700 1 --2- 172.21.15.123:0/3678393575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a4101770 0x7f41a41057c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4194009910 tx=0x7f4194009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:31.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.822+0000 7f41ac5e1700 1 -- 172.21.15.123:0/3678393575 shutdown_connections 2024-05-06T14:01:31.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.822+0000 7f41ac5e1700 1 --2- 172.21.15.123:0/3678393575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a4101770 0x7f41a41057c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:31.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.822+0000 7f41ac5e1700 1 --2- 172.21.15.123:0/3678393575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41a4100dc0 0x7f41a41011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.822+0000 7f41ac5e1700 1 -- 172.21.15.123:0/3678393575 >> 172.21.15.123:0/3678393575 conn(0x7f41a40fc650 msgr2=0x7f41a40fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.822+0000 7f41ac5e1700 1 -- 172.21.15.123:0/3678393575 shutdown_connections 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.822+0000 7f41ac5e1700 1 -- 172.21.15.123:0/3678393575 wait complete. 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41ac5e1700 1 Processor -- start 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41ac5e1700 1 -- start start 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41ac5e1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a4100dc0 0x7f41a419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41ac5e1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41a4101770 0x7f41a419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41ac5e1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a419d1b0 con 0x7f41a4100dc0 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41ac5e1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a4196660 con 0x7f41a4101770 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41aa37d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a4100dc0 0x7f41a419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41aa37d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a4100dc0 0x7f41a419c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34102/0 (socket says 172.21.15.123:34102) 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41aa37d700 1 -- 172.21.15.123:0/806581611 learned_addr learned my addr 172.21.15.123:0/806581611 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41a9b7c700 1 --2- 172.21.15.123:0/806581611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41a4101770 0x7f41a419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41aa37d700 1 -- 172.21.15.123:0/806581611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41a4101770 msgr2=0x7f41a419cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41aa37d700 1 --2- 172.21.15.123:0/806581611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41a4101770 0x7f41a419cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.823+0000 7f41aa37d700 1 -- 172.21.15.123:0/806581611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41940095f0 con 0x7f41a4100dc0 2024-05-06T14:01:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.824+0000 7f41aa37d700 1 --2- 172.21.15.123:0/806581611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a4100dc0 0x7f41a419c5e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f419c00ba50 tx=0x7f419c00be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.824+0000 7f419b7fe700 1 -- 172.21.15.123:0/806581611 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f419c00ca00 con 0x7f41a4100dc0 2024-05-06T14:01:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.824+0000 7f41ac5e1700 1 -- 172.21.15.123:0/806581611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a4196940 con 0x7f41a4100dc0 2024-05-06T14:01:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.824+0000 7f419b7fe700 1 -- 172.21.15.123:0/806581611 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f419c00cb60 con 0x7f41a4100dc0 2024-05-06T14:01:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.824+0000 7f419b7fe700 1 -- 172.21.15.123:0/806581611 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f419c007580 con 0x7f41a4100dc0 2024-05-06T14:01:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.824+0000 7f41ac5e1700 1 -- 172.21.15.123:0/806581611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a4196e90 con 0x7f41a4100dc0 2024-05-06T14:01:31.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.825+0000 7f41ac5e1700 1 -- 172.21.15.123:0/806581611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a4109110 con 0x7f41a4100dc0 2024-05-06T14:01:31.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.825+0000 7f419b7fe700 1 -- 172.21.15.123:0/806581611 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f419c00ccd0 con 0x7f41a4100dc0 2024-05-06T14:01:31.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.826+0000 7f419b7fe700 1 --2- 172.21.15.123:0/806581611 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f419006c4e0 0x7f419006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:31.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.826+0000 7f41a9b7c700 1 --2- 172.21.15.123:0/806581611 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f419006c4e0 0x7f419006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:31.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.826+0000 7f419b7fe700 1 -- 172.21.15.123:0/806581611 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f419c006e40 con 0x7f41a4100dc0 2024-05-06T14:01:31.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.826+0000 7f41a9b7c700 1 --2- 172.21.15.123:0/806581611 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f419006c4e0 0x7f419006e9a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f41a40fcf50 tx=0x7f419401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:31.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:31.830+0000 7f419b7fe700 1 -- 172.21.15.123:0/806581611 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f419c059050 con 0x7f41a4100dc0 2024-05-06T14:01:32.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.081+0000 7f41ac5e1700 1 -- 172.21.15.123:0/806581611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f41a404ea90 con 0x7f41a4100dc0 2024-05-06T14:01:32.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.081+0000 7f419b7fe700 1 -- 172.21.15.123:0/806581611 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+83 (secure 0 0 0) 0x7f419c058e70 con 0x7f41a4100dc0 2024-05-06T14:01:32.081 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-05-06T14:01:32.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.083+0000 7f41ac5e1700 1 -- 172.21.15.123:0/806581611 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f419006c4e0 msgr2=0x7f419006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:32.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.083+0000 7f41ac5e1700 1 --2- 172.21.15.123:0/806581611 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f419006c4e0 0x7f419006e9a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f41a40fcf50 tx=0x7f419401a040 comp rx=0 tx=0).stop 2024-05-06T14:01:32.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.083+0000 7f41ac5e1700 1 -- 172.21.15.123:0/806581611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a4100dc0 msgr2=0x7f41a419c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:32.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.083+0000 7f41ac5e1700 1 --2- 172.21.15.123:0/806581611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a4100dc0 0x7f41a419c5e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f419c00ba50 tx=0x7f419c00be10 comp rx=0 tx=0).stop 2024-05-06T14:01:32.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.083+0000 7f41ac5e1700 1 -- 172.21.15.123:0/806581611 shutdown_connections 2024-05-06T14:01:32.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.083+0000 7f41ac5e1700 1 --2- 172.21.15.123:0/806581611 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f419006c4e0 0x7f419006e9a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:32.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.083+0000 7f41ac5e1700 1 --2- 172.21.15.123:0/806581611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a4100dc0 0x7f41a419c5e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:32.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.083+0000 7f41ac5e1700 1 --2- 172.21.15.123:0/806581611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41a4101770 0x7f41a419cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:32.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.083+0000 7f41ac5e1700 1 -- 172.21.15.123:0/806581611 >> 172.21.15.123:0/806581611 conn(0x7f41a40fc650 msgr2=0x7f41a40fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:32.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.083+0000 7f41ac5e1700 1 -- 172.21.15.123:0/806581611 shutdown_connections 2024-05-06T14:01:32.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32.083+0000 7f41ac5e1700 1 -- 172.21.15.123:0/806581611 wait complete. 2024-05-06T14:01:32.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:32 smithi174 ceph-mon[35160]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-06T14:01:32.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:32 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:32.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:32 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:32.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:32 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:01:32.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:32 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T14:01:32.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:32 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:32.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:32 smithi123 ceph-mon[27254]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-06T14:01:32.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:32 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:32.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:32 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:32.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:32 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:01:32.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:32 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T14:01:32.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:32 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:01:32.807 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-06T14:01:32.807 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-06T14:01:32.807 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-05-06T14:01:32.807 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-06T14:01:32.807 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-06T14:01:32.807 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-06T14:01:32.807 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-06T14:01:32.807 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-06T14:01:32.807 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-06T14:01:32.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:32.808 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-05-06T14:01:32.824 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-06T14:01:32.824 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-06T14:01:32.824 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-05-06T14:01:32.824 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-05-06T14:01:32.824 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-05-06T14:01:32.824 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-05-06T14:01:32.824 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-06T14:01:32.824 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-05-06T14:01:32.824 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-05-06T14:01:32.825 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-06T14:01:32.825 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-05-06T14:01:32.825 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-05-06T14:01:32.825 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-06T14:01:32.825 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-05-06T14:01:32.825 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-06T14:01:32.825 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-05-06T14:01:32.825 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-06T14:01:32.825 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42267sec preferred_lft 42267sec 2024-05-06T14:01:32.825 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::dec2:843b:154a:21fd/64 scope link noprefixroute 2024-05-06T14:01:32.825 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-05-06T14:01:32.826 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-06T14:01:32.826 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T14:01:32.826 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-05-06T14:01:32.826 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2024-05-06T14:01:32.826 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2024-05-06T14:01:32.826 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2024-05-06T14:01:32.826 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-06T14:01:32.826 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-05-06T14:01:32.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T14:01:33.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:33.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:33.007 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-06T14:01:33.030 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-05-06T14:01:33.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:33.032 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-05-06T14:01:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-05-06T14:01:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-06T14:01:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-06T14:01:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-06T14:01:33.102 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-06T14:01:33.102 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T14:01:33.103 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-05-06T14:01:33.103 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-06T14:01:33.103 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-06T14:01:33.103 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-06T14:01:33.103 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-05-06T14:01:33.103 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:33 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/806581611' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-06T14:01:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T14:01:33.271 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:33 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/806581611' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-06T14:01:33.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:33.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:33.330 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-05-06T14:01:33.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:33.345 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-05-06T14:01:33.399 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T14:01:33.399 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-05-06T14:01:33.399 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-06T14:01:33.399 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-06T14:01:33.400 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-05-06T14:01:33.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T14:01:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:33.515 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-06T14:01:33.516 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T14:01:33.516 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-05-06T14:01:33.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-06T14:01:33.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-06T14:01:33.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-06T14:01:33.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-06T14:01:33.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-06T14:01:33.516 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-05-06T14:01:33.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T14:01:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:33.636 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T14:01:33.636 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-05-06T14:01:33.636 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-05-06T14:01:33.636 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2024-05-06T14:01:33.636 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-05-06T14:01:33.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T14:01:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:33.710 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-06T14:01:33.710 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-06T14:01:33.724 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-06T14:01:33.724 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-06T14:01:33.724 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-06T14:01:33.779 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-06T14:01:33.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:33.779 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-06T14:01:33.868 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-06T14:01:33.869 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-06T14:01:33.869 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-05-06T14:01:33.968 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-06T14:01:33.968 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-06T14:01:33.968 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-05-06T14:01:33.968 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.174:3300" 2024-05-06T14:01:33.968 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-06T14:01:33.978 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-06T14:01:33.978 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-06T14:01:33.978 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-05-06T14:01:33.978 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.174:3300" 2024-05-06T14:01:33.978 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-06T14:01:33.979 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.174:6789" 2024-05-06T14:01:33.979 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.174:6789:/ 2024-05-06T14:01:33.979 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f22edd3c-0baf-11ef-bc97-c7b262605968" will pass to kernel 2024-05-06T14:01:33.979 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-06T14:01:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-05-06T14:01:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-06T14:01:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-05-06T14:01:33.981 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-06T14:01:33.982 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-06T14:01:33.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:33.983 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-06T14:01:34.010 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-06T14:01:34.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-06T14:01:34.103 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:34 smithi123 ceph-mon[27254]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-06T14:01:34.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:34.110 INFO:teuthology.orchestra.run.smithi123.stdout:client14538 2024-05-06T14:01:34.111 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T14:01:34.111 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-06T14:01:34.127 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-06T14:01:34.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-06T14:01:34.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:34.227 INFO:teuthology.orchestra.run.smithi123.stdout:client14538 2024-05-06T14:01:34.228 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-06T14:01:34.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:34 smithi174 ceph-mon[35160]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-06T14:01:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-06T14:01:34.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:34.287 INFO:teuthology.orchestra.run.smithi123.stdout:client14538 2024-05-06T14:01:34.287 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968.client14538/status') 2024-05-06T14:01:34.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T14:01:34.348 INFO:teuthology.orchestra.run.smithi123.stdout:instance: client.14538 (3)192.168.0.1:0/3190249209 2024-05-06T14:01:34.348 INFO:teuthology.orchestra.run.smithi123.stdout:blocklisted: false 2024-05-06T14:01:34.348 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records in 2024-05-06T14:01:34.348 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records out 2024-05-06T14:01:34.348 INFO:teuthology.orchestra.run.smithi123.stderr:70 bytes copied, 2.2018e-05 s, 3.2 MB/s 2024-05-06T14:01:34.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:34.355 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-06T14:01:34.355 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-06T14:01:34.355 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-06T14:01:34.356 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-06T14:01:34.560 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:35.271 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:01:35.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:01:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.151+0000 7feaf9f35700 1 -- 172.21.15.123:0/2625629857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf4068670 msgr2=0x7feaf4068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.151+0000 7feaf9f35700 1 --2- 172.21.15.123:0/2625629857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf4068670 0x7feaf4068a50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7feae4009910 tx=0x7feae4009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.151+0000 7feaf9f35700 1 -- 172.21.15.123:0/2625629857 shutdown_connections 2024-05-06T14:01:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.151+0000 7feaf9f35700 1 --2- 172.21.15.123:0/2625629857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feaf4069020 0x7feaf4105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.151+0000 7feaf9f35700 1 --2- 172.21.15.123:0/2625629857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf4068670 0x7feaf4068a50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.151+0000 7feaf9f35700 1 -- 172.21.15.123:0/2625629857 >> 172.21.15.123:0/2625629857 conn(0x7feaf40755a0 msgr2=0x7feaf40759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.151+0000 7feaf9f35700 1 -- 172.21.15.123:0/2625629857 shutdown_connections 2024-05-06T14:01:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.151+0000 7feaf9f35700 1 -- 172.21.15.123:0/2625629857 wait complete. 2024-05-06T14:01:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.152+0000 7feaf9f35700 1 Processor -- start 2024-05-06T14:01:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.152+0000 7feaf9f35700 1 -- start start 2024-05-06T14:01:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.152+0000 7feaf9f35700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feaf4068670 0x7feaf419c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.152+0000 7feaf9f35700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf4069020 0x7feaf419ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.152+0000 7feaf9f35700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf419d050 con 0x7feaf4069020 2024-05-06T14:01:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.152+0000 7feaf9f35700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf4196590 con 0x7feaf4068670 2024-05-06T14:01:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.152+0000 7feaf2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf4069020 0x7feaf419ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.152+0000 7feaf2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf4069020 0x7feaf419ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34120/0 (socket says 172.21.15.123:34120) 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.152+0000 7feaf2ffd700 1 -- 172.21.15.123:0/1041335239 learned_addr learned my addr 172.21.15.123:0/1041335239 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.153+0000 7feaf37fe700 1 --2- 172.21.15.123:0/1041335239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feaf4068670 0x7feaf419c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.153+0000 7feaf2ffd700 1 -- 172.21.15.123:0/1041335239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feaf4068670 msgr2=0x7feaf419c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.153+0000 7feaf2ffd700 1 --2- 172.21.15.123:0/1041335239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feaf4068670 0x7feaf419c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.153+0000 7feaf2ffd700 1 -- 172.21.15.123:0/1041335239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40095f0 con 0x7feaf4069020 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.153+0000 7feaf37fe700 1 --2- 172.21.15.123:0/1041335239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feaf4068670 0x7feaf419c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.153+0000 7feaf2ffd700 1 --2- 172.21.15.123:0/1041335239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf4069020 0x7feaf419ca50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feae800c960 tx=0x7feae800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.153+0000 7feaf0ff9700 1 -- 172.21.15.123:0/1041335239 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feae8007a70 con 0x7feaf4069020 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.153+0000 7feaf0ff9700 1 -- 172.21.15.123:0/1041335239 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feae8007bd0 con 0x7feaf4069020 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.153+0000 7feaf9f35700 1 -- 172.21.15.123:0/1041335239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf4196870 con 0x7feaf4069020 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.153+0000 7feaf0ff9700 1 -- 172.21.15.123:0/1041335239 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feae8018630 con 0x7feaf4069020 2024-05-06T14:01:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.153+0000 7feaf9f35700 1 -- 172.21.15.123:0/1041335239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf4196dc0 con 0x7feaf4069020 2024-05-06T14:01:36.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.154+0000 7feada7fc700 1 -- 172.21.15.123:0/1041335239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead40052f0 con 0x7feaf4069020 2024-05-06T14:01:36.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.155+0000 7feaf0ff9700 1 -- 172.21.15.123:0/1041335239 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7feae800f450 con 0x7feaf4069020 2024-05-06T14:01:36.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.155+0000 7feaf0ff9700 1 --2- 172.21.15.123:0/1041335239 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7feadc06c4e0 0x7feadc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:36.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.155+0000 7feaf0ff9700 1 -- 172.21.15.123:0/1041335239 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7feae808b8b0 con 0x7feaf4069020 2024-05-06T14:01:36.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.155+0000 7feaf37fe700 1 --2- 172.21.15.123:0/1041335239 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7feadc06c4e0 0x7feadc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:36.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.155+0000 7feaf37fe700 1 --2- 172.21.15.123:0/1041335239 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7feadc06c4e0 0x7feadc06e9a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feae4005b40 tx=0x7feae401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:36.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.160+0000 7feaf0ff9700 1 -- 172.21.15.123:0/1041335239 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7feae8059830 con 0x7feaf4069020 2024-05-06T14:01:36.272 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:36 smithi174 ceph-mon[35160]: pgmap v199: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.8 KiB/s rd, 3 op/s 2024-05-06T14:01:36.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:36 smithi123 ceph-mon[27254]: pgmap v199: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.8 KiB/s rd, 3 op/s 2024-05-06T14:01:36.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.392+0000 7feada7fc700 1 -- 172.21.15.123:0/1041335239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fead40061d0 con 0x7feaf4069020 2024-05-06T14:01:36.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.392+0000 7feaf0ff9700 1 -- 172.21.15.123:0/1041335239 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+83 (secure 0 0 0) 0x7feae8059650 con 0x7feaf4069020 2024-05-06T14:01:36.393 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-05-06T14:01:36.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.394+0000 7feada7fc700 1 -- 172.21.15.123:0/1041335239 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7feadc06c4e0 msgr2=0x7feadc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:36.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.394+0000 7feada7fc700 1 --2- 172.21.15.123:0/1041335239 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7feadc06c4e0 0x7feadc06e9a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feae4005b40 tx=0x7feae401a040 comp rx=0 tx=0).stop 2024-05-06T14:01:36.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.394+0000 7feada7fc700 1 -- 172.21.15.123:0/1041335239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf4069020 msgr2=0x7feaf419ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:36.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.394+0000 7feada7fc700 1 --2- 172.21.15.123:0/1041335239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf4069020 0x7feaf419ca50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feae800c960 tx=0x7feae800cd20 comp rx=0 tx=0).stop 2024-05-06T14:01:36.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.394+0000 7feada7fc700 1 -- 172.21.15.123:0/1041335239 shutdown_connections 2024-05-06T14:01:36.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.395+0000 7feada7fc700 1 --2- 172.21.15.123:0/1041335239 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7feadc06c4e0 0x7feadc06e9a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:36.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.395+0000 7feada7fc700 1 --2- 172.21.15.123:0/1041335239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feaf4068670 0x7feaf419c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:36.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.395+0000 7feada7fc700 1 --2- 172.21.15.123:0/1041335239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf4069020 0x7feaf419ca50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:36.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.395+0000 7feada7fc700 1 -- 172.21.15.123:0/1041335239 >> 172.21.15.123:0/1041335239 conn(0x7feaf40755a0 msgr2=0x7feaf40fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:36.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.395+0000 7feada7fc700 1 -- 172.21.15.123:0/1041335239 shutdown_connections 2024-05-06T14:01:36.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:36.395+0000 7feada7fc700 1 -- 172.21.15.123:0/1041335239 wait complete. 2024-05-06T14:01:37.002 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-06T14:01:37.002 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-06T14:01:37.002 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2024-05-06T14:01:37.002 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-06T14:01:37.002 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-06T14:01:37.002 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-06T14:01:37.002 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-06T14:01:37.002 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-06T14:01:37.002 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-06T14:01:37.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:37.003 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2024-05-06T14:01:37.023 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-06T14:01:37.023 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-06T14:01:37.023 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-05-06T14:01:37.023 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-06T14:01:37.023 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-05-06T14:01:37.023 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-06T14:01:37.023 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-06T14:01:37.023 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2024-05-06T14:01:37.023 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f0 2024-05-06T14:01:37.024 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-06T14:01:37.024 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2024-05-06T14:01:37.024 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f1 2024-05-06T14:01:37.024 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-06T14:01:37.024 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2024-05-06T14:01:37.024 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-06T14:01:37.024 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2024-05-06T14:01:37.024 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-06T14:01:37.024 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42264sec preferred_lft 42264sec 2024-05-06T14:01:37.024 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::25e:ded2:3b3b:cda9/64 scope link noprefixroute 2024-05-06T14:01:37.024 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-06T14:01:37.024 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-06T14:01:37.025 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T14:01:37.025 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-06T14:01:37.025 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add name ceph-brx type bridge 2024-05-06T14:01:37.025 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr flush dev ceph-brx 2024-05-06T14:01:37.025 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set ceph-brx up 2024-05-06T14:01:37.025 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-06T14:01:37.025 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-06T14:01:37.118 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T14:01:37.217 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:37.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:37.224 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-06T14:01:37.250 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-05-06T14:01:37.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:37.251 DEBUG:teuthology.orchestra.run.smithi174:> route 2024-05-06T14:01:37.318 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2024-05-06T14:01:37.318 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-06T14:01:37.318 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-06T14:01:37.318 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-06T14:01:37.318 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-06T14:01:37.318 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T14:01:37.319 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-06T14:01:37.319 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-06T14:01:37.319 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-06T14:01:37.319 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-06T14:01:37.319 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-06T14:01:37.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:37 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/1041335239' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-06T14:01:37.406 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T14:01:37.414 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:37 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/1041335239' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-06T14:01:37.600 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:37.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:37.607 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-06T14:01:37.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:37.621 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2024-05-06T14:01:37.676 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T14:01:37.676 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-06T14:01:37.676 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-06T14:01:37.676 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-06T14:01:37.676 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-06T14:01:37.764 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T14:01:37.786 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:37.792 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-06T14:01:37.792 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T14:01:37.792 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-06T14:01:37.792 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-06T14:01:37.793 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-06T14:01:37.793 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-06T14:01:37.793 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-06T14:01:37.793 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-06T14:01:37.793 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-06T14:01:37.840 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T14:01:37.908 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:37.914 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T14:01:37.914 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-06T14:01:37.914 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2024-05-06T14:01:37.914 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.0 master ceph-brx 2024-05-06T14:01:37.914 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-06T14:01:37.961 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T14:01:37.982 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:37.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-06T14:01:37.988 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-06T14:01:38.003 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-06T14:01:38.003 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-06T14:01:38.003 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-06T14:01:38.054 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-06T14:01:38.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:38.054 DEBUG:teuthology.orchestra.run.smithi174:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-06T14:01:38.149 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-06T14:01:38.150 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-06T14:01:38.150 INFO:teuthology.orchestra.run.smithi174.stdout:invalid new device string format 2024-05-06T14:01:38.247 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-06T14:01:38.248 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-06T14:01:38.248 INFO:teuthology.orchestra.run.smithi174.stdout:invalid new device string format 2024-05-06T14:01:38.248 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.174:3300" 2024-05-06T14:01:38.248 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-06T14:01:38.252 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-06T14:01:38.252 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-06T14:01:38.252 INFO:teuthology.orchestra.run.smithi174.stdout:invalid new device string format 2024-05-06T14:01:38.252 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.174:3300" 2024-05-06T14:01:38.252 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-06T14:01:38.252 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.174:6789" 2024-05-06T14:01:38.252 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.174:6789:/ 2024-05-06T14:01:38.252 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f22edd3c-0baf-11ef-bc97-c7b262605968" will pass to kernel 2024-05-06T14:01:38.253 INFO:teuthology.orchestra.run.smithi174.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-06T14:01:38.253 INFO:teuthology.orchestra.run.smithi174.stdout: You just mounted a file system that supports labels which does not 2024-05-06T14:01:38.253 INFO:teuthology.orchestra.run.smithi174.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-06T14:01:38.253 INFO:teuthology.orchestra.run.smithi174.stdout: applications will generate AVC messages and not be allowed access to 2024-05-06T14:01:38.253 INFO:teuthology.orchestra.run.smithi174.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-06T14:01:38.255 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-06T14:01:38.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:01:38.255 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-06T14:01:38.276 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:38 smithi174 ceph-mon[35160]: pgmap v200: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T14:01:38.278 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-06T14:01:38.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:38 smithi123 ceph-mon[27254]: pgmap v200: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T14:01:38.367 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-06T14:01:38.368 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:38.374 INFO:teuthology.orchestra.run.smithi174.stdout:client24295 2024-05-06T14:01:38.374 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T14:01:38.374 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-06T14:01:38.391 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-06T14:01:38.478 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-06T14:01:38.479 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:38.485 INFO:teuthology.orchestra.run.smithi174.stdout:client24295 2024-05-06T14:01:38.486 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-06T14:01:38.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-06T14:01:38.534 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:38.539 INFO:teuthology.orchestra.run.smithi174.stdout:client24295 2024-05-06T14:01:38.539 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968.client24295/status') 2024-05-06T14:01:38.586 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T14:01:38.596 INFO:teuthology.orchestra.run.smithi174.stdout:instance: client.24295 (3)192.168.0.1:0/1465675088 2024-05-06T14:01:38.596 INFO:teuthology.orchestra.run.smithi174.stdout:blocklisted: false 2024-05-06T14:01:38.596 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records in 2024-05-06T14:01:38.596 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records out 2024-05-06T14:01:38.596 INFO:teuthology.orchestra.run.smithi174.stderr:70 bytes copied, 3.9762e-05 s, 1.8 MB/s 2024-05-06T14:01:38.597 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-06T14:01:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T14:01:38.603 INFO:teuthology.run_tasks:Running task print... 2024-05-06T14:01:38.613 INFO:teuthology.task.print:**** done client 2024-05-06T14:01:38.613 INFO:teuthology.run_tasks:Running task parallel... 2024-05-06T14:01:38.633 INFO:teuthology.task.parallel:starting parallel... 2024-05-06T14:01:38.634 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-06T14:01:38.634 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-06T14:01:38.635 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi123.front.sepia.ceph.com 2024-05-06T14:01:38.635 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -e sha1=04416f48efe02891b265c07b4f38b46e422bbef9 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-05-06T14:01:38.635 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-06T14:01:38.635 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-05-06T14:01:38.653 INFO:tasks.workunit:Pulling workunits from ref 04416f48efe02891b265c07b4f38b46e422bbef9 2024-05-06T14:01:38.653 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-06T14:01:38.653 INFO:tasks.workunit:timeout=3h 2024-05-06T14:01:38.653 INFO:tasks.workunit:cleanup=True 2024-05-06T14:01:38.654 DEBUG:teuthology.orchestra.run.smithi123:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-06T14:01:38.675 INFO:teuthology.orchestra.run.smithi123.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-06T14:01:38.675 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-06T14:01:38.675 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 7dh/125d Inode: 1 Links: 2 2024-05-06T14:01:38.675 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T14:01:38.675 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-06T14:01:38.675 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-06T14:01:38.675 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-05-06 14:01:04.050127900 +0000 2024-05-06T14:01:38.675 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-05-06 14:01:34.004814598 +0000 2024-05-06T14:01:38.675 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-05-06 14:01:04.050127900 +0000 2024-05-06T14:01:38.675 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-06T14:01:38.675 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-06T14:01:38.746 DEBUG:teuthology.orchestra.run.smithi174:> stat -- /home/ubuntu/cephtest/mnt.1 2024-05-06T14:01:38.763 INFO:teuthology.orchestra.run.smithi174.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-05-06T14:01:38.763 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-05-06T14:01:38.763 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 7bh/123d Inode: 1 Links: 3 2024-05-06T14:01:38.763 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T14:01:38.763 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-06T14:01:38.763 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-06T14:01:38.763 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-06 14:01:38.741703826 +0000 2024-05-06T14:01:38.763 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-06 14:01:38.741703826 +0000 2024-05-06T14:01:38.763 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-06 14:01:04.050127900 +0000 2024-05-06T14:01:38.763 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-05-06T14:01:38.763 DEBUG:teuthology.orchestra.run.smithi174:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-05-06T14:01:38.833 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 04416f48efe02891b265c07b4f38b46e422bbef9 2024-05-06T14:01:38.833 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 04416f48efe02891b265c07b4f38b46e422bbef9 2024-05-06T14:01:38.849 INFO:tasks.workunit.client.0.smithi123.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-06T14:01:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:38.888 INFO:tasks.workunit.client.1.smithi174.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-05-06T14:01:40.214 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:40 smithi123 ceph-mon[27254]: pgmap v201: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T14:01:40.393 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:40 smithi174 ceph-mon[35160]: pgmap v201: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T14:01:40.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.430+0000 7f27a3833700 1 -- 172.21.15.123:0/1195437806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279c100cc0 msgr2=0x7f279c101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:40.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.430+0000 7f27a3833700 1 --2- 172.21.15.123:0/1195437806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279c100cc0 0x7f279c101120 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f278c009910 tx=0x7f278c009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.430+0000 7f27a3833700 1 -- 172.21.15.123:0/1195437806 shutdown_connections 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.430+0000 7f27a3833700 1 --2- 172.21.15.123:0/1195437806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279c100cc0 0x7f279c101120 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.430+0000 7f27a3833700 1 --2- 172.21.15.123:0/1195437806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f279c0ffac0 0x7f279c0ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.430+0000 7f27a3833700 1 -- 172.21.15.123:0/1195437806 >> 172.21.15.123:0/1195437806 conn(0x7f279c0fb060 msgr2=0x7f279c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.430+0000 7f27a3833700 1 -- 172.21.15.123:0/1195437806 shutdown_connections 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.430+0000 7f27a3833700 1 -- 172.21.15.123:0/1195437806 wait complete. 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.430+0000 7f27a3833700 1 Processor -- start 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.430+0000 7f27a3833700 1 -- start start 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a3833700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279c0ffac0 0x7f279c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a3833700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f279c100cc0 0x7f279c19b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a3833700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c19b680 con 0x7f279c0ffac0 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a3833700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c19b7f0 con 0x7f279c100cc0 2024-05-06T14:01:40.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a15cf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279c0ffac0 0x7f279c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a15cf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279c0ffac0 0x7f279c069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57946/0 (socket says 172.21.15.123:57946) 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a15cf700 1 -- 172.21.15.123:0/22978951 learned_addr learned my addr 172.21.15.123:0/22978951 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a0dce700 1 --2- 172.21.15.123:0/22978951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f279c100cc0 0x7f279c19b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a15cf700 1 -- 172.21.15.123:0/22978951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f279c100cc0 msgr2=0x7f279c19b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a15cf700 1 --2- 172.21.15.123:0/22978951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f279c100cc0 0x7f279c19b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a15cf700 1 -- 172.21.15.123:0/22978951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c0095f0 con 0x7f279c0ffac0 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a0dce700 1 --2- 172.21.15.123:0/22978951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f279c100cc0 0x7f279c19b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a15cf700 1 --2- 172.21.15.123:0/22978951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279c0ffac0 0x7f279c069930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f279800d900 tx=0x7f279800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27927fc700 1 -- 172.21.15.123:0/22978951 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27980041f0 con 0x7f279c0ffac0 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a3833700 1 -- 172.21.15.123:0/22978951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c19bad0 con 0x7f279c0ffac0 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27927fc700 1 -- 172.21.15.123:0/22978951 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2798004350 con 0x7f279c0ffac0 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27927fc700 1 -- 172.21.15.123:0/22978951 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2798003da0 con 0x7f279c0ffac0 2024-05-06T14:01:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.431+0000 7f27a3833700 1 -- 172.21.15.123:0/22978951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c19c020 con 0x7f279c0ffac0 2024-05-06T14:01:40.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.432+0000 7f27a3833700 1 -- 172.21.15.123:0/22978951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c108620 con 0x7f279c0ffac0 2024-05-06T14:01:40.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.433+0000 7f27927fc700 1 -- 172.21.15.123:0/22978951 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f2798009730 con 0x7f279c0ffac0 2024-05-06T14:01:40.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.433+0000 7f27927fc700 1 --2- 172.21.15.123:0/22978951 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f278806c4e0 0x7f278806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:40.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.434+0000 7f27a0dce700 1 --2- 172.21.15.123:0/22978951 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f278806c4e0 0x7f278806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:40.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.434+0000 7f27927fc700 1 -- 172.21.15.123:0/22978951 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f279808b9f0 con 0x7f279c0ffac0 2024-05-06T14:01:40.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.434+0000 7f27a0dce700 1 --2- 172.21.15.123:0/22978951 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f278806c4e0 0x7f278806e9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f279c069e90 tx=0x7f278c005ab0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:40.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.438+0000 7f27927fc700 1 -- 172.21.15.123:0/22978951 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f279808de60 con 0x7f279c0ffac0 2024-05-06T14:01:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.625+0000 7f27a3833700 1 -- 172.21.15.123:0/22978951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f279c108810 con 0x7f279c0ffac0 2024-05-06T14:01:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.626+0000 7f27927fc700 1 -- 172.21.15.123:0/22978951 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f2798059c00 con 0x7f279c0ffac0 2024-05-06T14:01:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.627+0000 7f27a3833700 1 -- 172.21.15.123:0/22978951 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f278806c4e0 msgr2=0x7f278806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.627+0000 7f27a3833700 1 --2- 172.21.15.123:0/22978951 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f278806c4e0 0x7f278806e9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f279c069e90 tx=0x7f278c005ab0 comp rx=0 tx=0).stop 2024-05-06T14:01:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.627+0000 7f27a3833700 1 -- 172.21.15.123:0/22978951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279c0ffac0 msgr2=0x7f279c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.627+0000 7f27a3833700 1 --2- 172.21.15.123:0/22978951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279c0ffac0 0x7f279c069930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f279800d900 tx=0x7f279800dcc0 comp rx=0 tx=0).stop 2024-05-06T14:01:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.628+0000 7f27a3833700 1 -- 172.21.15.123:0/22978951 shutdown_connections 2024-05-06T14:01:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.628+0000 7f27a3833700 1 --2- 172.21.15.123:0/22978951 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f278806c4e0 0x7f278806e9a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.628+0000 7f27a3833700 1 --2- 172.21.15.123:0/22978951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f279c0ffac0 0x7f279c069930 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.628+0000 7f27a3833700 1 --2- 172.21.15.123:0/22978951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f279c100cc0 0x7f279c19b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.628+0000 7f27a3833700 1 -- 172.21.15.123:0/22978951 >> 172.21.15.123:0/22978951 conn(0x7f279c0fb060 msgr2=0x7f279c103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.628+0000 7f27a3833700 1 -- 172.21.15.123:0/22978951 shutdown_connections 2024-05-06T14:01:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:40.628+0000 7f27a3833700 1 -- 172.21.15.123:0/22978951 wait complete. 2024-05-06T14:01:41.266 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -e sha1=04416f48efe02891b265c07b4f38b46e422bbef9 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-05-06T14:01:41.511 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:42.334 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:42 smithi123 ceph-mon[27254]: pgmap v202: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T14:01:42.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:42 smithi174 ceph-mon[35160]: pgmap v202: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T14:01:43.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.168+0000 7f47f0c35700 1 -- 172.21.15.123:0/1559183923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47ec0ff280 msgr2=0x7f47ec0ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:43.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.168+0000 7f47f0c35700 1 --2- 172.21.15.123:0/1559183923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47ec0ff280 0x7f47ec0ff6a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009910 tx=0x7f47dc009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:43.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.168+0000 7f47f0c35700 1 -- 172.21.15.123:0/1559183923 shutdown_connections 2024-05-06T14:01:43.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.168+0000 7f47f0c35700 1 --2- 172.21.15.123:0/1559183923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47ec100480 0x7f47ec1008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.168+0000 7f47f0c35700 1 --2- 172.21.15.123:0/1559183923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47ec0ff280 0x7f47ec0ff6a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.168+0000 7f47f0c35700 1 -- 172.21.15.123:0/1559183923 >> 172.21.15.123:0/1559183923 conn(0x7f47ec0fa800 msgr2=0x7f47ec0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.169+0000 7f47f0c35700 1 -- 172.21.15.123:0/1559183923 shutdown_connections 2024-05-06T14:01:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.169+0000 7f47f0c35700 1 -- 172.21.15.123:0/1559183923 wait complete. 2024-05-06T14:01:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.169+0000 7f47f0c35700 1 Processor -- start 2024-05-06T14:01:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.169+0000 7f47f0c35700 1 -- start start 2024-05-06T14:01:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47f0c35700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47ec0ff280 0x7f47ec1941f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47f0c35700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47ec100480 0x7f47ec194730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47f0c35700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec194d50 con 0x7f47ec0ff280 2024-05-06T14:01:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47f0c35700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec194e90 con 0x7f47ec100480 2024-05-06T14:01:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47ea59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47ec0ff280 0x7f47ec1941f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47ea59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47ec0ff280 0x7f47ec1941f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57958/0 (socket says 172.21.15.123:57958) 2024-05-06T14:01:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47ea59c700 1 -- 172.21.15.123:0/1978382987 learned_addr learned my addr 172.21.15.123:0/1978382987 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47e9d9b700 1 --2- 172.21.15.123:0/1978382987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47ec100480 0x7f47ec194730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47ea59c700 1 -- 172.21.15.123:0/1978382987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47ec100480 msgr2=0x7f47ec194730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47ea59c700 1 --2- 172.21.15.123:0/1978382987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47ec100480 0x7f47ec194730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47ea59c700 1 -- 172.21.15.123:0/1978382987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc0095f0 con 0x7f47ec0ff280 2024-05-06T14:01:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47e9d9b700 1 --2- 172.21.15.123:0/1978382987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47ec100480 0x7f47ec194730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T14:01:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47ea59c700 1 --2- 172.21.15.123:0/1978382987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47ec0ff280 0x7f47ec1941f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00bda0 tx=0x7f47dc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47db7fe700 1 -- 172.21.15.123:0/1978382987 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47dc01d070 con 0x7f47ec0ff280 2024-05-06T14:01:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47db7fe700 1 -- 172.21.15.123:0/1978382987 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47dc004c50 con 0x7f47ec0ff280 2024-05-06T14:01:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47f0c35700 1 -- 172.21.15.123:0/1978382987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec1998e0 con 0x7f47ec0ff280 2024-05-06T14:01:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47db7fe700 1 -- 172.21.15.123:0/1978382987 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47dc00f690 con 0x7f47ec0ff280 2024-05-06T14:01:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.170+0000 7f47f0c35700 1 -- 172.21.15.123:0/1978382987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec199e50 con 0x7f47ec0ff280 2024-05-06T14:01:43.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.171+0000 7f47f0c35700 1 -- 172.21.15.123:0/1978382987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec1075d0 con 0x7f47ec0ff280 2024-05-06T14:01:43.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.172+0000 7f47db7fe700 1 -- 172.21.15.123:0/1978382987 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f47dc00f900 con 0x7f47ec0ff280 2024-05-06T14:01:43.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.172+0000 7f47db7fe700 1 --2- 172.21.15.123:0/1978382987 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f47d406e6f0 0x7f47d4070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:43.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.172+0000 7f47db7fe700 1 -- 172.21.15.123:0/1978382987 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f47dc08d040 con 0x7f47ec0ff280 2024-05-06T14:01:43.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.172+0000 7f47e9d9b700 1 --2- 172.21.15.123:0/1978382987 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f47d406e6f0 0x7f47d4070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:43.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.173+0000 7f47e9d9b700 1 --2- 172.21.15.123:0/1978382987 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f47d406e6f0 0x7f47d4070bb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f47e0007900 tx=0x7f47e0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:43.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.177+0000 7f47db7fe700 1 -- 172.21.15.123:0/1978382987 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f47dc05b250 con 0x7f47ec0ff280 2024-05-06T14:01:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.365+0000 7f47f0c35700 1 -- 172.21.15.123:0/1978382987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f47ec107790 con 0x7f47ec0ff280 2024-05-06T14:01:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.366+0000 7f47db7fe700 1 -- 172.21.15.123:0/1978382987 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f47dc05ade0 con 0x7f47ec0ff280 2024-05-06T14:01:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.368+0000 7f47f0c35700 1 -- 172.21.15.123:0/1978382987 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f47d406e6f0 msgr2=0x7f47d4070bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.368+0000 7f47f0c35700 1 --2- 172.21.15.123:0/1978382987 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f47d406e6f0 0x7f47d4070bb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f47e0007900 tx=0x7f47e0008040 comp rx=0 tx=0).stop 2024-05-06T14:01:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.368+0000 7f47f0c35700 1 -- 172.21.15.123:0/1978382987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47ec0ff280 msgr2=0x7f47ec1941f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.368+0000 7f47f0c35700 1 --2- 172.21.15.123:0/1978382987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47ec0ff280 0x7f47ec1941f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00bda0 tx=0x7f47dc00be80 comp rx=0 tx=0).stop 2024-05-06T14:01:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.368+0000 7f47f0c35700 1 -- 172.21.15.123:0/1978382987 shutdown_connections 2024-05-06T14:01:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.368+0000 7f47f0c35700 1 --2- 172.21.15.123:0/1978382987 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f47d406e6f0 0x7f47d4070bb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.368+0000 7f47f0c35700 1 --2- 172.21.15.123:0/1978382987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47ec0ff280 0x7f47ec1941f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.368+0000 7f47f0c35700 1 --2- 172.21.15.123:0/1978382987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47ec100480 0x7f47ec194730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.368+0000 7f47f0c35700 1 -- 172.21.15.123:0/1978382987 >> 172.21.15.123:0/1978382987 conn(0x7f47ec0fa800 msgr2=0x7f47ec1036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.368+0000 7f47f0c35700 1 -- 172.21.15.123:0/1978382987 shutdown_connections 2024-05-06T14:01:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:43.368+0000 7f47f0c35700 1 -- 172.21.15.123:0/1978382987 wait complete. 2024-05-06T14:01:44.013 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -e sha1=04416f48efe02891b265c07b4f38b46e422bbef9 -- bash -c 'ceph config set global log_to_journald false --force' 2024-05-06T14:01:44.216 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:44.334 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:44 smithi123 ceph-mon[27254]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-05-06T14:01:44.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:44 smithi174 ceph-mon[35160]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-05-06T14:01:45.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.884+0000 7f6262043700 1 -- 172.21.15.123:0/156612663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625c101dc0 msgr2=0x7f625c102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.884+0000 7f6262043700 1 --2- 172.21.15.123:0/156612663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625c101dc0 0x7f625c102220 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6244009910 tx=0x7f6244009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.884+0000 7f6262043700 1 -- 172.21.15.123:0/156612663 shutdown_connections 2024-05-06T14:01:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.884+0000 7f6262043700 1 --2- 172.21.15.123:0/156612663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625c101dc0 0x7f625c102220 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.884+0000 7f6262043700 1 --2- 172.21.15.123:0/156612663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f625c100bc0 0x7f625c100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.884+0000 7f6262043700 1 -- 172.21.15.123:0/156612663 >> 172.21.15.123:0/156612663 conn(0x7f625c0fc140 msgr2=0x7f625c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.884+0000 7f6262043700 1 -- 172.21.15.123:0/156612663 shutdown_connections 2024-05-06T14:01:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.884+0000 7f6262043700 1 -- 172.21.15.123:0/156612663 wait complete. 2024-05-06T14:01:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.885+0000 7f6262043700 1 Processor -- start 2024-05-06T14:01:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.885+0000 7f6262043700 1 -- start start 2024-05-06T14:01:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.885+0000 7f6262043700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625c100bc0 0x7f625c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.885+0000 7f6262043700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f625c101dc0 0x7f625c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.885+0000 7f6262043700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c199040 con 0x7f625c100bc0 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.885+0000 7f6262043700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c199180 con 0x7f625c101dc0 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.885+0000 7f625b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625c100bc0 0x7f625c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.885+0000 7f625b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625c100bc0 0x7f625c198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57980/0 (socket says 172.21.15.123:57980) 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.885+0000 7f625b7fe700 1 -- 172.21.15.123:0/2522705982 learned_addr learned my addr 172.21.15.123:0/2522705982 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.885+0000 7f625b7fe700 1 -- 172.21.15.123:0/2522705982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f625c101dc0 msgr2=0x7f625c198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.885+0000 7f625b7fe700 1 --2- 172.21.15.123:0/2522705982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f625c101dc0 0x7f625c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.885+0000 7f625b7fe700 1 -- 172.21.15.123:0/2522705982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440095f0 con 0x7f625c100bc0 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.886+0000 7f625b7fe700 1 --2- 172.21.15.123:0/2522705982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625c100bc0 0x7f625c198570 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c910 tx=0x7f624c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.886+0000 7f62597fa700 1 -- 172.21.15.123:0/2522705982 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f624c0041f0 con 0x7f625c100bc0 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.886+0000 7f62597fa700 1 -- 172.21.15.123:0/2522705982 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f624c007db0 con 0x7f625c100bc0 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.886+0000 7f6262043700 1 -- 172.21.15.123:0/2522705982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c19dc40 con 0x7f625c100bc0 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.886+0000 7f62597fa700 1 -- 172.21.15.123:0/2522705982 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f624c003d60 con 0x7f625c100bc0 2024-05-06T14:01:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.886+0000 7f6262043700 1 -- 172.21.15.123:0/2522705982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c19e160 con 0x7f625c100bc0 2024-05-06T14:01:45.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.887+0000 7f6262043700 1 -- 172.21.15.123:0/2522705982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c105ea0 con 0x7f625c100bc0 2024-05-06T14:01:45.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.887+0000 7f62597fa700 1 -- 172.21.15.123:0/2522705982 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f624c007900 con 0x7f625c100bc0 2024-05-06T14:01:45.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.888+0000 7f62597fa700 1 --2- 172.21.15.123:0/2522705982 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f624806c4e0 0x7f624806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:45.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.888+0000 7f6253fff700 1 --2- 172.21.15.123:0/2522705982 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f624806c4e0 0x7f624806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:45.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.888+0000 7f62597fa700 1 -- 172.21.15.123:0/2522705982 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f624c08b5d0 con 0x7f625c100bc0 2024-05-06T14:01:45.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.888+0000 7f6253fff700 1 --2- 172.21.15.123:0/2522705982 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f624806c4e0 0x7f624806e9a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f624400b5c0 tx=0x7f6244005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:45.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:45.892+0000 7f62597fa700 1 -- 172.21.15.123:0/2522705982 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f624c0597e0 con 0x7f625c100bc0 2024-05-06T14:01:46.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.085+0000 7f6262043700 1 -- 172.21.15.123:0/2522705982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f625c02cc70 con 0x7f625c100bc0 2024-05-06T14:01:46.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.086+0000 7f62597fa700 1 -- 172.21.15.123:0/2522705982 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f624c059370 con 0x7f625c100bc0 2024-05-06T14:01:46.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.087+0000 7f6262043700 1 -- 172.21.15.123:0/2522705982 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f624806c4e0 msgr2=0x7f624806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:46.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.087+0000 7f6262043700 1 --2- 172.21.15.123:0/2522705982 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f624806c4e0 0x7f624806e9a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f624400b5c0 tx=0x7f6244005fd0 comp rx=0 tx=0).stop 2024-05-06T14:01:46.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.087+0000 7f6262043700 1 -- 172.21.15.123:0/2522705982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625c100bc0 msgr2=0x7f625c198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:46.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.087+0000 7f6262043700 1 --2- 172.21.15.123:0/2522705982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625c100bc0 0x7f625c198570 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c910 tx=0x7f624c00ccd0 comp rx=0 tx=0).stop 2024-05-06T14:01:46.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.088+0000 7f6262043700 1 -- 172.21.15.123:0/2522705982 shutdown_connections 2024-05-06T14:01:46.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.088+0000 7f6262043700 1 --2- 172.21.15.123:0/2522705982 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f624806c4e0 0x7f624806e9a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:46.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.088+0000 7f6262043700 1 --2- 172.21.15.123:0/2522705982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625c100bc0 0x7f625c198570 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:46.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.088+0000 7f6262043700 1 --2- 172.21.15.123:0/2522705982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f625c101dc0 0x7f625c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:46.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.088+0000 7f6262043700 1 -- 172.21.15.123:0/2522705982 >> 172.21.15.123:0/2522705982 conn(0x7f625c0fc140 msgr2=0x7f625c102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:46.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.088+0000 7f6262043700 1 -- 172.21.15.123:0/2522705982 shutdown_connections 2024-05-06T14:01:46.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:46.088+0000 7f6262043700 1 -- 172.21.15.123:0/2522705982 wait complete. 2024-05-06T14:01:46.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:46 smithi123 ceph-mon[27254]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-05-06T14:01:46.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:46 smithi174 ceph-mon[35160]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-05-06T14:01:46.774 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -e sha1=04416f48efe02891b265c07b4f38b46e422bbef9 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-05-06T14:01:46.984 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:01:48.102 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:48 smithi123 ceph-mon[27254]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-05-06T14:01:48.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:48 smithi174 ceph-mon[35160]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-05-06T14:01:48.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.732+0000 7f71b6ac9700 1 -- 172.21.15.123:0/4237855667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0100bc0 msgr2=0x7f71b0100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:48.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.732+0000 7f71b6ac9700 1 --2- 172.21.15.123:0/4237855667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0100bc0 0x7f71b0100fe0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009910 tx=0x7f71a4009c20 comp rx=0 tx=0).stop 2024-05-06T14:01:48.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.732+0000 7f71b6ac9700 1 -- 172.21.15.123:0/4237855667 shutdown_connections 2024-05-06T14:01:48.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.732+0000 7f71b6ac9700 1 --2- 172.21.15.123:0/4237855667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f71b0102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.732+0000 7f71b6ac9700 1 --2- 172.21.15.123:0/4237855667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0100bc0 0x7f71b0100fe0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.732+0000 7f71b6ac9700 1 -- 172.21.15.123:0/4237855667 >> 172.21.15.123:0/4237855667 conn(0x7f71b00fc140 msgr2=0x7f71b00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.732+0000 7f71b6ac9700 1 -- 172.21.15.123:0/4237855667 shutdown_connections 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.733+0000 7f71b6ac9700 1 -- 172.21.15.123:0/4237855667 wait complete. 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.733+0000 7f71b6ac9700 1 Processor -- start 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.733+0000 7f71b6ac9700 1 -- start start 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.733+0000 7f71b6ac9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 0x7f71b0196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.733+0000 7f71b6ac9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0101dc0 0x7f71b01969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.733+0000 7f71b6ac9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b0196fe0 con 0x7f71b0101dc0 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.733+0000 7f71b6ac9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b0197120 con 0x7f71b0100bc0 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.734+0000 7f71affff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0101dc0 0x7f71b01969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.734+0000 7f71affff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0101dc0 0x7f71b01969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33226/0 (socket says 172.21.15.123:33226) 2024-05-06T14:01:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.734+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 learned_addr learned my addr 172.21.15.123:0/1314944135 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:01:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.734+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 0x7f71b0196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.734+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 msgr2=0x7f71b0196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:01:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.734+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 0x7f71b0196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:01:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.734+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a40095f0 con 0x7f71b0101dc0 2024-05-06T14:01:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.734+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0101dc0 0x7f71b01969c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f719c00b4b0 tx=0x7f719c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.734+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f719c011800 con 0x7f71b0101dc0 2024-05-06T14:01:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.734+0000 7f71b6ac9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b019bbd0 con 0x7f71b0101dc0 2024-05-06T14:01:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.734+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f719c011e10 con 0x7f71b0101dc0 2024-05-06T14:01:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.734+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f719c00f2e0 con 0x7f71b0101dc0 2024-05-06T14:01:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.735+0000 7f71b6ac9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b019c1a0 con 0x7f71b0101dc0 2024-05-06T14:01:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.735+0000 7f71b6ac9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b01097a0 con 0x7f71b0101dc0 2024-05-06T14:01:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.736+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f719c011960 con 0x7f71b0101dc0 2024-05-06T14:01:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.736+0000 7f71adffb700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71a006c4e0 0x7f71a006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:01:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.736+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f719c08b450 con 0x7f71b0101dc0 2024-05-06T14:01:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.736+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71a006c4e0 0x7f71a006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:01:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.737+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71a006c4e0 0x7f71a006e9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f71a4005090 tx=0x7f71a40058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:01:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.741+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f719c059660 con 0x7f71b0101dc0 2024-05-06T14:01:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:01:48.951+0000 7f71b6ac9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:04416f48efe02891b265c07b4f38b46e422bbef9", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f71b0106710 con 0x7f71a006c4e0 2024-05-06T14:01:50.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:50 smithi123 ceph-mon[27254]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-05-06T14:01:50.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:50 smithi123 ceph-mon[27254]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:04416f48efe02891b265c07b4f38b46e422bbef9", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:01:50.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:50 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:01:50.493 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:50 smithi174 ceph-mon[35160]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-05-06T14:01:50.494 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:50 smithi174 ceph-mon[35160]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:04416f48efe02891b265c07b4f38b46e422bbef9", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T14:01:50.494 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:50 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:01:52.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:52 smithi123 ceph-mon[27254]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-05-06T14:01:52.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:52 smithi174 ceph-mon[35160]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-05-06T14:01:54.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:54 smithi123 ceph-mon[27254]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-05-06T14:01:54.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:54 smithi174 ceph-mon[35160]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-05-06T14:01:56.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:56 smithi123 ceph-mon[27254]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T14:01:56.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:56 smithi174 ceph-mon[35160]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T14:01:58.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:01:58 smithi123 ceph-mon[27254]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T14:01:58.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:01:58 smithi174 ceph-mon[35160]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T14:02:00.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:00 smithi123 ceph-mon[27254]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:00.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:00 smithi174 ceph-mon[35160]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:02.353 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:02 smithi123 ceph-mon[27254]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:02.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:02 smithi174 ceph-mon[35160]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:04.323 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:04 smithi174 ceph-mon[35160]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:04.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:04 smithi123 ceph-mon[27254]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:05.102 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:05 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:02:05.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:05 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:02:06.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:06 smithi123 ceph-mon[27254]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:06.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:06 smithi174 ceph-mon[35160]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:08.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:08 smithi123 ceph-mon[27254]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:08.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:08 smithi174 ceph-mon[35160]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:10.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:10 smithi123 ceph-mon[27254]: pgmap v216: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:10.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:10 smithi174 ceph-mon[35160]: pgmap v216: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:12.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:12 smithi123 ceph-mon[27254]: pgmap v217: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:12.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:12 smithi174 ceph-mon[35160]: pgmap v217: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:14.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:14 smithi123 ceph-mon[27254]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T14:02:14.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:14 smithi174 ceph-mon[35160]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T14:02:16.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:16 smithi123 ceph-mon[27254]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T14:02:16.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:16 smithi174 ceph-mon[35160]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T14:02:18.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:18 smithi123 ceph-mon[27254]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T14:02:18.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:18 smithi174 ceph-mon[35160]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T14:02:20.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:20 smithi123 ceph-mon[27254]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T14:02:20.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:20 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:02:20.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:20 smithi174 ceph-mon[35160]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T14:02:20.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:20 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:02:22.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:22 smithi123 ceph-mon[27254]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T14:02:22.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:22 smithi174 ceph-mon[35160]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T14:02:24.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:24 smithi123 ceph-mon[27254]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-06T14:02:24.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:24 smithi174 ceph-mon[35160]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-06T14:02:26.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:26 smithi174 ceph-mon[35160]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T14:02:26.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:26 smithi123 ceph-mon[27254]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T14:02:28.520 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:28 smithi174 ceph-mon[35160]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T14:02:28.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:28 smithi123 ceph-mon[27254]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T14:02:30.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:30 smithi123 ceph-mon[27254]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T14:02:30.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:30 smithi174 ceph-mon[35160]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T14:02:32.520 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:32 smithi174 ceph-mon[35160]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T14:02:32.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:32 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T14:02:32.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:32 smithi123 ceph-mon[27254]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T14:02:32.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:32 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T14:02:33.520 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:33 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:02:33.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:33 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T14:02:33.521 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:33 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:02:33.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:33 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T14:02:33.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:33 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T14:02:33.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:33 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' 2024-05-06T14:02:34.421 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:34 smithi174 ceph-mon[35160]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T14:02:34.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:34 smithi123 ceph-mon[27254]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T14:02:35.503 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:35 smithi123 ceph-mon[27254]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:02:35.520 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:35 smithi174 ceph-mon[35160]: from='mgr.14217 172.21.15.123:0/2855370579' entity='mgr.smithi123.vjztrj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T14:02:35.712 INFO:tasks.workunit.client.0.smithi123.stderr:fatal: unable to access 'https://git.ceph.com/ceph.git/': transfer closed with outstanding read data remaining 2024-05-06T14:02:35.714 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-05-06T14:02:35.715 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_04416f48efe02891b265c07b4f38b46e422bbef9/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_04416f48efe02891b265c07b4f38b46e422bbef9/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_04416f48efe02891b265c07b4f38b46e422bbef9/qa/tasks/workunit.py", line 345, in _run_tests remote.run(logger=log.getChild(role), File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi123 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 04416f48efe02891b265c07b4f38b46e422bbef9' 2024-05-06T14:02:35.923 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=279cf547906a427bb7f9139c76176570 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_04416f48efe02891b265c07b4f38b46e422bbef9/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_04416f48efe02891b265c07b4f38b46e422bbef9/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_04416f48efe02891b265c07b4f38b46e422bbef9/qa/tasks/workunit.py", line 345, in _run_tests remote.run(logger=log.getChild(role), File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi123 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 04416f48efe02891b265c07b4f38b46e422bbef9' 2024-05-06T14:02:35.928 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-06T14:02:35.940 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-06T14:02:35.940 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T14:02:35.940 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-06T14:02:35.967 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-05-06T14:02:35.967 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-06T14:02:36.024 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-06T14:02:36.270 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:36 smithi174 ceph-mon[35160]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:36.301 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:02:36.351 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:36 smithi123 ceph-mon[27254]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:38.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.302+0000 7fb029a3f700 1 -- 172.21.15.123:0/3802217187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0240ffbd0 msgr2=0x7fb024100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:02:38.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.302+0000 7fb029a3f700 1 --2- 172.21.15.123:0/3802217187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0240ffbd0 0x7fb024100050 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb018009910 tx=0x7fb018009c20 comp rx=0 tx=0).stop 2024-05-06T14:02:38.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.302+0000 7fb029a3f700 1 -- 172.21.15.123:0/3802217187 shutdown_connections 2024-05-06T14:02:38.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.302+0000 7fb029a3f700 1 --2- 172.21.15.123:0/3802217187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0240ffbd0 0x7fb024100050 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:38.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.302+0000 7fb029a3f700 1 --2- 172.21.15.123:0/3802217187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb024105a40 0x7fb024105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.302+0000 7fb029a3f700 1 -- 172.21.15.123:0/3802217187 >> 172.21.15.123:0/3802217187 conn(0x7fb0240755a0 msgr2=0x7fb0240759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:02:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.302+0000 7fb029a3f700 1 -- 172.21.15.123:0/3802217187 shutdown_connections 2024-05-06T14:02:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.302+0000 7fb029a3f700 1 -- 172.21.15.123:0/3802217187 wait complete. 2024-05-06T14:02:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.303+0000 7fb029a3f700 1 Processor -- start 2024-05-06T14:02:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.303+0000 7fb029a3f700 1 -- start start 2024-05-06T14:02:38.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.303+0000 7fb029a3f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0240ffbd0 0x7fb024197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:38.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.303+0000 7fb029a3f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb024105a40 0x7fb024197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:38.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.303+0000 7fb029a3f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb024198100 con 0x7fb024105a40 2024-05-06T14:02:38.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.303+0000 7fb029a3f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb024198270 con 0x7fb0240ffbd0 2024-05-06T14:02:38.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.304+0000 7fb0227fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb024105a40 0x7fb024197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:02:38.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.304+0000 7fb0227fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb024105a40 0x7fb024197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48934/0 (socket says 172.21.15.123:48934) 2024-05-06T14:02:38.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.304+0000 7fb0227fc700 1 -- 172.21.15.123:0/702161364 learned_addr learned my addr 172.21.15.123:0/702161364 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:02:38.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.304+0000 7fb022ffd700 1 --2- 172.21.15.123:0/702161364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0240ffbd0 0x7fb024197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:02:38.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.304+0000 7fb0227fc700 1 -- 172.21.15.123:0/702161364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0240ffbd0 msgr2=0x7fb024197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:02:38.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.304+0000 7fb0227fc700 1 --2- 172.21.15.123:0/702161364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0240ffbd0 0x7fb024197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:38.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.304+0000 7fb0227fc700 1 -- 172.21.15.123:0/702161364 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180095f0 con 0x7fb024105a40 2024-05-06T14:02:38.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.304+0000 7fb0227fc700 1 --2- 172.21.15.123:0/702161364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb024105a40 0x7fb024197ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb018006010 tx=0x7fb01800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:02:38.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.304+0000 7fb028a3d700 1 -- 172.21.15.123:0/702161364 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01801d070 con 0x7fb024105a40 2024-05-06T14:02:38.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.304+0000 7fb028a3d700 1 -- 172.21.15.123:0/702161364 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb018004fa0 con 0x7fb024105a40 2024-05-06T14:02:38.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.304+0000 7fb029a3f700 1 -- 172.21.15.123:0/702161364 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0241a05e0 con 0x7fb024105a40 2024-05-06T14:02:38.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.304+0000 7fb029a3f700 1 -- 172.21.15.123:0/702161364 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0241a09f0 con 0x7fb024105a40 2024-05-06T14:02:38.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.305+0000 7fb028a3d700 1 -- 172.21.15.123:0/702161364 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01800f690 con 0x7fb024105a40 2024-05-06T14:02:38.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.306+0000 7fb029a3f700 1 -- 172.21.15.123:0/702161364 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb010005320 con 0x7fb024105a40 2024-05-06T14:02:38.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.306+0000 7fb028a3d700 1 -- 172.21.15.123:0/702161364 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fb018004af0 con 0x7fb024105a40 2024-05-06T14:02:38.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.306+0000 7fb028a3d700 1 --2- 172.21.15.123:0/702161364 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb00c06c4e0 0x7fb00c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:38.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.306+0000 7fb028a3d700 1 -- 172.21.15.123:0/702161364 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb01808cfc0 con 0x7fb024105a40 2024-05-06T14:02:38.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.306+0000 7fb022ffd700 1 --2- 172.21.15.123:0/702161364 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb00c06c4e0 0x7fb00c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:02:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.307+0000 7fb022ffd700 1 --2- 172.21.15.123:0/702161364 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb00c06c4e0 0x7fb00c06e9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb01400ac50 tx=0x7fb01400a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:02:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.311+0000 7fb028a3d700 1 -- 172.21.15.123:0/702161364 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb0180c00e0 con 0x7fb024105a40 2024-05-06T14:02:38.520 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:38 smithi174 ceph-mon[35160]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:38.601 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:38 smithi123 ceph-mon[27254]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.650+0000 7fb029a3f700 1 -- 172.21.15.123:0/702161364 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb010005f70 con 0x7fb024105a40 2024-05-06T14:02:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.650+0000 7fb028a3d700 1 -- 172.21.15.123:0/702161364 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v46) v1 ==== 81+0+1019 (secure 0 0 0) 0x7fb0180576e0 con 0x7fb024105a40 2024-05-06T14:02:38.649 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6827/4097360326 2024-05-07T14:01:14.834389+0000 2024-05-06T14:02:38.650 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1961046585 2024-05-07T13:54:54.367854+0000 2024-05-06T14:02:38.650 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3708790365 2024-05-07T13:54:21.525408+0000 2024-05-06T14:02:38.650 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1506782592 2024-05-07T13:56:04.790493+0000 2024-05-06T14:02:38.650 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/388885730 2024-05-07T13:56:04.790493+0000 2024-05-06T14:02:38.650 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/35564330 2024-05-07T13:54:21.525408+0000 2024-05-06T14:02:38.650 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1999705925 2024-05-07T13:56:04.790493+0000 2024-05-06T14:02:38.650 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/2710951021 2024-05-07T13:54:54.367854+0000 2024-05-06T14:02:38.651 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1489655906 2024-05-07T13:54:21.525408+0000 2024-05-06T14:02:38.651 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/4277354301 2024-05-07T13:54:21.525408+0000 2024-05-06T14:02:38.651 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/35564330 2024-05-07T13:54:21.525408+0000 2024-05-06T14:02:38.651 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/634683219 2024-05-07T13:54:54.367854+0000 2024-05-06T14:02:38.651 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/2710951021 2024-05-07T13:54:54.367854+0000 2024-05-06T14:02:38.651 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/306885224 2024-05-07T13:54:54.367854+0000 2024-05-06T14:02:38.651 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2647159870 2024-05-07T13:56:04.790493+0000 2024-05-06T14:02:38.651 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/388885730 2024-05-07T13:56:04.790493+0000 2024-05-06T14:02:38.652 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6826/4097360326 2024-05-07T14:01:14.834389+0000 2024-05-06T14:02:38.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.653+0000 7fb029a3f700 1 -- 172.21.15.123:0/702161364 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb00c06c4e0 msgr2=0x7fb00c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:02:38.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.653+0000 7fb029a3f700 1 --2- 172.21.15.123:0/702161364 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb00c06c4e0 0x7fb00c06e9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb01400ac50 tx=0x7fb01400a380 comp rx=0 tx=0).stop 2024-05-06T14:02:38.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.653+0000 7fb029a3f700 1 -- 172.21.15.123:0/702161364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb024105a40 msgr2=0x7fb024197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:02:38.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.653+0000 7fb029a3f700 1 --2- 172.21.15.123:0/702161364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb024105a40 0x7fb024197ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb018006010 tx=0x7fb01800bd70 comp rx=0 tx=0).stop 2024-05-06T14:02:38.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.653+0000 7fb029a3f700 1 -- 172.21.15.123:0/702161364 shutdown_connections 2024-05-06T14:02:38.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.653+0000 7fb029a3f700 1 --2- 172.21.15.123:0/702161364 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fb00c06c4e0 0x7fb00c06e9a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:38.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.653+0000 7fb029a3f700 1 --2- 172.21.15.123:0/702161364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0240ffbd0 0x7fb024197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:38.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.653+0000 7fb029a3f700 1 --2- 172.21.15.123:0/702161364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb024105a40 0x7fb024197ab0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.653+0000 7fb029a3f700 1 -- 172.21.15.123:0/702161364 >> 172.21.15.123:0/702161364 conn(0x7fb0240755a0 msgr2=0x7fb0240fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:02:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.653+0000 7fb029a3f700 1 -- 172.21.15.123:0/702161364 shutdown_connections 2024-05-06T14:02:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:38.653+0000 7fb029a3f700 1 -- 172.21.15.123:0/702161364 wait complete. 2024-05-06T14:02:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:listed 17 entries 2024-05-06T14:02:39.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:39 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/702161364' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T14:02:39.520 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:39 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/702161364' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T14:02:40.520 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:40 smithi174 ceph-mon[35160]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:40.601 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:40 smithi123 ceph-mon[27254]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:41.228 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-06T14:02:41.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:02:41.228 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-06T14:02:41.258 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-05-06T14:02:41.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:02:41.259 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-06T14:02:41.325 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T14:02:41.325 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-06T14:02:41.345 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T14:02:41.345 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-06T14:02:41.405 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-06T14:02:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/mon.smithi123/config 2024-05-06T14:02:42.351 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:42 smithi123 ceph-mon[27254]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:42.520 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:42 smithi174 ceph-mon[35160]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T14:02:43.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.387+0000 7fd2d510b700 1 -- 172.21.15.123:0/2352695793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d0101d40 msgr2=0x7fd2d0102120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:02:43.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.387+0000 7fd2d510b700 1 --2- 172.21.15.123:0/2352695793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d0101d40 0x7fd2d0102120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009910 tx=0x7fd2c0009c20 comp rx=0 tx=0).stop 2024-05-06T14:02:43.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.388+0000 7fd2d510b700 1 -- 172.21.15.123:0/2352695793 shutdown_connections 2024-05-06T14:02:43.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.388+0000 7fd2d510b700 1 --2- 172.21.15.123:0/2352695793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2d0102660 0x7fd2d010ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:43.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.388+0000 7fd2d510b700 1 --2- 172.21.15.123:0/2352695793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d0101d40 0x7fd2d0102120 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:43.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.388+0000 7fd2d510b700 1 -- 172.21.15.123:0/2352695793 >> 172.21.15.123:0/2352695793 conn(0x7fd2d00fb570 msgr2=0x7fd2d00fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:02:43.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.388+0000 7fd2d510b700 1 -- 172.21.15.123:0/2352695793 shutdown_connections 2024-05-06T14:02:43.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.388+0000 7fd2d510b700 1 -- 172.21.15.123:0/2352695793 wait complete. 2024-05-06T14:02:43.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.388+0000 7fd2d510b700 1 Processor -- start 2024-05-06T14:02:43.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2d510b700 1 -- start start 2024-05-06T14:02:43.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2d510b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2d0101d40 0x7fd2d00ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:43.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2d510b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d0102660 0x7fd2d00ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:43.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2d510b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d0100420 con 0x7fd2d0102660 2024-05-06T14:02:43.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2d510b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d0100560 con 0x7fd2d0101d40 2024-05-06T14:02:43.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2ce59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d0102660 0x7fd2d00ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:02:43.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2ce59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d0102660 0x7fd2d00ffee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48956/0 (socket says 172.21.15.123:48956) 2024-05-06T14:02:43.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2ce59c700 1 -- 172.21.15.123:0/3822886749 learned_addr learned my addr 172.21.15.123:0/3822886749 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-05-06T14:02:43.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2ced9d700 1 --2- 172.21.15.123:0/3822886749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2d0101d40 0x7fd2d00ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:02:43.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2ce59c700 1 -- 172.21.15.123:0/3822886749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2d0101d40 msgr2=0x7fd2d00ff9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:02:43.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2ce59c700 1 --2- 172.21.15.123:0/3822886749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2d0101d40 0x7fd2d00ff9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:43.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2ce59c700 1 -- 172.21.15.123:0/3822886749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c00095f0 con 0x7fd2d0102660 2024-05-06T14:02:43.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.389+0000 7fd2ce59c700 1 --2- 172.21.15.123:0/3822886749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d0102660 0x7fd2d00ffee0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400d900 tx=0x7fd2c400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:02:43.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.390+0000 7fd2b7fff700 1 -- 172.21.15.123:0/3822886749 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2c4009900 con 0x7fd2d0102660 2024-05-06T14:02:43.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.390+0000 7fd2b7fff700 1 -- 172.21.15.123:0/3822886749 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd2c4010460 con 0x7fd2d0102660 2024-05-06T14:02:43.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.390+0000 7fd2d510b700 1 -- 172.21.15.123:0/3822886749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d01a2950 con 0x7fd2d0102660 2024-05-06T14:02:43.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.390+0000 7fd2b7fff700 1 -- 172.21.15.123:0/3822886749 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2c400f5f0 con 0x7fd2d0102660 2024-05-06T14:02:43.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.390+0000 7fd2d510b700 1 -- 172.21.15.123:0/3822886749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d01a2d60 con 0x7fd2d0102660 2024-05-06T14:02:43.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.391+0000 7fd2b7fff700 1 -- 172.21.15.123:0/3822886749 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fd2c4009a60 con 0x7fd2d0102660 2024-05-06T14:02:43.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.391+0000 7fd2d510b700 1 -- 172.21.15.123:0/3822886749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d0108250 con 0x7fd2d0102660 2024-05-06T14:02:43.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.392+0000 7fd2b7fff700 1 --2- 172.21.15.123:0/3822886749 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fd2b806c4e0 0x7fd2b806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:43.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.392+0000 7fd2ced9d700 1 --2- 172.21.15.123:0/3822886749 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fd2b806c4e0 0x7fd2b806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:02:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.392+0000 7fd2b7fff700 1 -- 172.21.15.123:0/3822886749 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd2c408b370 con 0x7fd2d0102660 2024-05-06T14:02:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.392+0000 7fd2ced9d700 1 --2- 172.21.15.123:0/3822886749 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fd2b806c4e0 0x7fd2b806e9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0006010 tx=0x7fd2c001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:02:43.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.397+0000 7fd2b7fff700 1 -- 172.21.15.123:0/3822886749 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd2c4055b70 con 0x7fd2d0102660 2024-05-06T14:02:43.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.622+0000 7fd2d510b700 1 -- 172.21.15.123:0/3822886749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd2d004ea90 con 0x7fd2d0102660 2024-05-06T14:02:43.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.622+0000 7fd2b7fff700 1 -- 172.21.15.123:0/3822886749 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v46) v1 ==== 81+0+1019 (secure 0 0 0) 0x7fd2c4059190 con 0x7fd2d0102660 2024-05-06T14:02:43.621 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6827/4097360326 2024-05-07T14:01:14.834389+0000 2024-05-06T14:02:43.621 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1961046585 2024-05-07T13:54:54.367854+0000 2024-05-06T14:02:43.621 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/3708790365 2024-05-07T13:54:21.525408+0000 2024-05-06T14:02:43.622 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1506782592 2024-05-07T13:56:04.790493+0000 2024-05-06T14:02:43.622 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/388885730 2024-05-07T13:56:04.790493+0000 2024-05-06T14:02:43.622 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/35564330 2024-05-07T13:54:21.525408+0000 2024-05-06T14:02:43.622 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1999705925 2024-05-07T13:56:04.790493+0000 2024-05-06T14:02:43.622 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/2710951021 2024-05-07T13:54:54.367854+0000 2024-05-06T14:02:43.622 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1489655906 2024-05-07T13:54:21.525408+0000 2024-05-06T14:02:43.622 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/4277354301 2024-05-07T13:54:21.525408+0000 2024-05-06T14:02:43.622 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/35564330 2024-05-07T13:54:21.525408+0000 2024-05-06T14:02:43.622 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/634683219 2024-05-07T13:54:54.367854+0000 2024-05-06T14:02:43.623 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/2710951021 2024-05-07T13:54:54.367854+0000 2024-05-06T14:02:43.623 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/306885224 2024-05-07T13:54:54.367854+0000 2024-05-06T14:02:43.623 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2647159870 2024-05-07T13:56:04.790493+0000 2024-05-06T14:02:43.623 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/388885730 2024-05-07T13:56:04.790493+0000 2024-05-06T14:02:43.623 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6826/4097360326 2024-05-07T14:01:14.834389+0000 2024-05-06T14:02:43.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.624+0000 7fd2d510b700 1 -- 172.21.15.123:0/3822886749 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fd2b806c4e0 msgr2=0x7fd2b806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:02:43.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.624+0000 7fd2d510b700 1 --2- 172.21.15.123:0/3822886749 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fd2b806c4e0 0x7fd2b806e9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0006010 tx=0x7fd2c001a040 comp rx=0 tx=0).stop 2024-05-06T14:02:43.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.624+0000 7fd2d510b700 1 -- 172.21.15.123:0/3822886749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d0102660 msgr2=0x7fd2d00ffee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T14:02:43.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.624+0000 7fd2d510b700 1 --2- 172.21.15.123:0/3822886749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d0102660 0x7fd2d00ffee0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400d900 tx=0x7fd2c400dc10 comp rx=0 tx=0).stop 2024-05-06T14:02:43.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.624+0000 7fd2d510b700 1 -- 172.21.15.123:0/3822886749 shutdown_connections 2024-05-06T14:02:43.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.624+0000 7fd2d510b700 1 --2- 172.21.15.123:0/3822886749 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7fd2b806c4e0 0x7fd2b806e9a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:43.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.624+0000 7fd2d510b700 1 --2- 172.21.15.123:0/3822886749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2d0101d40 0x7fd2d00ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:43.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.624+0000 7fd2d510b700 1 --2- 172.21.15.123:0/3822886749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2d0102660 0x7fd2d00ffee0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:43.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.624+0000 7fd2d510b700 1 -- 172.21.15.123:0/3822886749 >> 172.21.15.123:0/3822886749 conn(0x7fd2d00fb570 msgr2=0x7fd2d0105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T14:02:43.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.625+0000 7fd2d510b700 1 -- 172.21.15.123:0/3822886749 shutdown_connections 2024-05-06T14:02:43.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:43.625+0000 7fd2d510b700 1 -- 172.21.15.123:0/3822886749 wait complete. 2024-05-06T14:02:43.625 INFO:teuthology.orchestra.run.smithi123.stderr:listed 17 entries 2024-05-06T14:02:44.351 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:44 smithi123 ceph-mon[27254]: pgmap v233: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T14:02:44.352 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:44 smithi123 ceph-mon[27254]: from='client.? 172.21.15.123:0/3822886749' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T14:02:44.412 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-06T14:02:44.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:02:44.412 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-06T14:02:44.439 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:44 smithi174 ceph-mon[35160]: pgmap v233: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T14:02:44.439 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:44 smithi174 ceph-mon[35160]: from='client.? 172.21.15.123:0/3822886749' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T14:02:44.448 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2024-05-06T14:02:44.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:02:44.448 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-06T14:02:44.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:02:44.511 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-05-06T14:02:44.527 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-06T14:02:44.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:02:44.527 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-06T14:02:44.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:02:44.593 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-05-06T14:02:44.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:02:44.696 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-06T14:02:44.714 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-06T14:02:44.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:02:44.714 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-06T14:02:44.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T14:02:44.785 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-05-06T14:02:44.886 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-06T14:02:44.897 INFO:tasks.cephadm:Teardown begin 2024-05-06T14:02:44.898 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-06T14:02:44.923 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-06T14:02:44.949 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-06T14:02:44.949 DEBUG:teuthology.orchestra.run.smithi123:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-06T14:02:44.978 DEBUG:teuthology.orchestra.run.smithi174:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-06T14:02:45.004 INFO:tasks.cephadm:Stopping all daemons... 2024-05-06T14:02:45.005 INFO:tasks.cephadm.mon.smithi123:Stopping mon.smithi123... 2024-05-06T14:02:45.005 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mon.smithi123 2024-05-06T14:02:45.272 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:45 smithi123 systemd[1]: Stopping Ceph mon.smithi123 for f22edd3c-0baf-11ef-bc97-c7b262605968... 2024-05-06T14:02:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f71b01969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-06T14:02:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f71b01969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T14:02:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0101dc0 0x7f71b01969c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f719c00b4b0 tx=0x7f719c00b7c0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-06T14:02:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0101dc0 0x7f71b01969c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f719c00b4b0 tx=0x7f719c00b7c0 comp rx=0 tx=0).stop 2024-05-06T14:02:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f71b01969c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-06T14:02:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71adffb700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b0101dc0 0x7f71b01969c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71adffb700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f71a00760d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:02:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71adffb700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 0x7f71a00789d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0079350 con 0x7f71a0073ce0 2024-05-06T14:02:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0079490 con 0x7f71b0100bc0 2024-05-06T14:02:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.348+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 0x7f71a00789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T14:02:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.349+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:02:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.349+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.349+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=3+}) v3 -- 0x7f71a0079690 con 0x7f71b0100bc0 2024-05-06T14:02:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.349+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 0x7f71a00789d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009dc0 tx=0x7f719c009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T14:02:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.351+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71a80098b0 con 0x7f71b0100bc0 2024-05-06T14:02:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.352+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f71a800bd30 con 0x7f71b0100bc0 2024-05-06T14:02:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:45.354+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f71a800d3f0 con 0x7f71b0100bc0 2024-05-06T14:02:45.601 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:45 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123[27250]: 2024-05-06T14:02:45.346+0000 7f61581c2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi123 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T14:02:45.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:45 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123[27250]: 2024-05-06T14:02:45.346+0000 7f61581c2700 -1 mon.smithi123@0(leader) e2 *** Got Signal Terminated *** 2024-05-06T14:02:45.602 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:45 smithi123 podman[77633]: 2024-05-06 14:02:45.509181602 +0000 UTC m=+0.292817584 container died 0e6293707f75e783593f9360bb8348c56b35bf4aae853d1bbdb8e1398a4774c0 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240222, RELEASE=HEAD, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True) 2024-05-06T14:02:46.101 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:46 smithi123 podman[77633]: 2024-05-06 14:02:46.055473093 +0000 UTC m=+0.839109069 container cleanup 0e6293707f75e783593f9360bb8348c56b35bf4aae853d1bbdb8e1398a4774c0 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, RELEASE=HEAD, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-05-06T14:02:46.102 INFO:journalctl@ceph.mon.smithi123.smithi123.stdout:May 06 14:02:46 smithi123 bash[77633]: ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi123 2024-05-06T14:02:46.489 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mon.smithi123.service' 2024-05-06T14:02:46.535 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T14:02:46.535 INFO:tasks.cephadm.mon.smithi123:Stopped mon.smithi123 2024-05-06T14:02:46.536 INFO:tasks.cephadm.mon.smithi174:Stopping mon.smithi174... 2024-05-06T14:02:46.536 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mon.smithi174 2024-05-06T14:02:46.835 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:46 smithi174 systemd[1]: Stopping Ceph mon.smithi174 for f22edd3c-0baf-11ef-bc97-c7b262605968... 2024-05-06T14:02:46.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 msgr2=0x7f71a00789d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-06T14:02:46.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 msgr2=0x7f71a00789d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T14:02:46.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 0x7f71a00789d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009dc0 tx=0x7f719c009290 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-06T14:02:46.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 0x7f71a00789d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009dc0 tx=0x7f719c009290 comp rx=0 tx=0).stop 2024-05-06T14:02:46.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 msgr2=0x7f71a00789d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-06T14:02:46.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71adffb700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0100bc0 0x7f71a00789d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:46.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71adffb700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f71a007b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:46.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71adffb700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f71a00760d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:46.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:46.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:02:46.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0036f00 con 0x7f71a0073ce0 2024-05-06T14:02:46.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0037040 con 0x7f71b0101dc0 2024-05-06T14:02:46.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f71a007b830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:46.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:46.837+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f71a007b830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:02:47.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.038+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.038+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:02:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.038+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f71a007b830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.038+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f71a007b830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:02:47.244 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:46 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi174[35142]: 2024-05-06T14:02:46.836+0000 7f34f860d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi174 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T14:02:47.244 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:46 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi174[35142]: 2024-05-06T14:02:46.836+0000 7f34f860d700 -1 mon.smithi174@1(peon) e2 *** Got Signal Terminated *** 2024-05-06T14:02:47.244 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:46 smithi174 podman[61417]: 2024-05-06 14:02:46.969777379 +0000 UTC m=+0.231365427 container died 24bb2b963f5a800c47a502e88695d40bb7119f55d33c581c4221a057f3eabdaa (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi174, RELEASE=HEAD, GIT_CLEAN=True, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True) 2024-05-06T14:02:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.439+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.439+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:02:47.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.439+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f71a007b830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:47.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.439+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f71a007b830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:02:47.520 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:47 smithi174 podman[61417]: 2024-05-06 14:02:47.454113352 +0000 UTC m=+0.715701454 container cleanup 24bb2b963f5a800c47a502e88695d40bb7119f55d33c581c4221a057f3eabdaa (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi174, io.buildah.version=1.29.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.1, ceph=True, GIT_BRANCH=HEAD) 2024-05-06T14:02:47.520 INFO:journalctl@ceph.mon.smithi174.smithi174.stdout:May 06 14:02:47 smithi174 bash[61417]: ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-mon-smithi174 2024-05-06T14:02:47.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.740+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f71a007b830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:02:47.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.740+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f71a007b830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:47.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.740+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:02:47.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.740+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:47.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.740+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:47.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.740+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190007c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:47.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.740+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0036f00 con 0x7f71a0073ce0 2024-05-06T14:02:47.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.741+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0037040 con 0x7f71b0101dc0 2024-05-06T14:02:47.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.741+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:47.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.741+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190007c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:47.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.741+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:02:47.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.741+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190007c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:02:47.829 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@mon.smithi174.service' 2024-05-06T14:02:47.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T14:02:47.871 INFO:tasks.cephadm.mon.smithi174:Stopped mon.smithi174 2024-05-06T14:02:47.872 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-06T14:02:47.872 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.0 2024-05-06T14:02:47.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.942+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190007c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:47.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.942+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190007c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:02:47.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.942+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:47.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:47.942+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:02:48.101 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:02:47 smithi123 systemd[1]: Stopping Ceph osd.0 for f22edd3c-0baf-11ef-bc97-c7b262605968... 2024-05-06T14:02:48.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:48.343+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190007c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:48.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:48.343+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190007c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:02:48.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:48.343+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:48.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:48.343+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:02:48.601 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:02:48 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0[46501]: 2024-05-06T14:02:48.201+0000 7f3ab56a2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T14:02:48.602 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:02:48 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0[46501]: 2024-05-06T14:02:48.201+0000 7f3ab56a2700 -1 osd.0 46 *** Got signal Terminated *** 2024-05-06T14:02:48.602 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:02:48 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0[46501]: 2024-05-06T14:02:48.201+0000 7f3ab56a2700 -1 osd.0 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T14:02:49.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:49.144+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190007c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:49.144+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190007c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:02:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:49.144+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:49.144+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:02:50.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:50.745+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190007c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:50.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:50.745+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190007c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:02:50.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:50.745+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:50.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:50.745+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:02:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:53.948+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190007c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:53.948+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190007c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:02:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:53.948+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:53.948+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:02:54.101 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:02:53 smithi123 podman[77763]: 2024-05-06 14:02:53.724126984 +0000 UTC m=+5.655446812 container died d8762a4b28085d166d77e68a0e9e200ebce534749f07f338253ce5ea3e6bc962 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-06T14:02:54.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.491+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:02:54.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.491+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:54.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.491+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190007c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:02:54.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.491+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190007c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:02:54.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.491+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:54.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.491+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190008520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:02:54.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.491+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0036f00 con 0x7f71a0073ce0 2024-05-06T14:02:54.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.491+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0037040 con 0x7f71b0101dc0 2024-05-06T14:02:54.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.491+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190008520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:54.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.491+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190008520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:02:54.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.491+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:54.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.491+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:02:54.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.692+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190008520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:54.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.692+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190008520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:02:54.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.692+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:54.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:54.692+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:02:55.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:55.093+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190008520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:55.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:55.093+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190008520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:02:55.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:55.093+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:55.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:55.093+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:02:55.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:55.894+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190008520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:55.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:55.894+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190008520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:02:55.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:55.894+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:55.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:55.894+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:02:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:57.495+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190008520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:02:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:57.495+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190008520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:02:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:57.495+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:02:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:02:57.495+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:03:00.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:00.698+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190008520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:00.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:00.698+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190008520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:03:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:00.699+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:00.699+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:03:03.851 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:03:03 smithi123 podman[77763]: 2024-05-06 14:03:03.50758632 +0000 UTC m=+15.438906127 container cleanup d8762a4b28085d166d77e68a0e9e200ebce534749f07f338253ce5ea3e6bc962 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0, ceph=True, RELEASE=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-06T14:03:03.852 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:03:03 smithi123 bash[77763]: ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0 2024-05-06T14:03:04.600 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:03:04 smithi123 podman[77782]: 2024-05-06 14:03:04.237475265 +0000 UTC m=+10.507370747 container remove d8762a4b28085d166d77e68a0e9e200ebce534749f07f338253ce5ea3e6bc962 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0, GIT_CLEAN=True, RELEASE=HEAD, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T14:03:04.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.616+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:03:04.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.616+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:03:04.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.616+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 msgr2=0x7f7190008520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:03:04.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.616+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71a0073ce0 0x7f7190008520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:03:04.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.616+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 0x7f7190008a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:03:04.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.616+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:03:04.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.616+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0036f00 con 0x7f7190007da0 2024-05-06T14:03:04.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.616+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0037040 con 0x7f71b0101dc0 2024-05-06T14:03:04.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.616+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 msgr2=0x7f7190008a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:04.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.616+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 0x7f7190008a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:03:04.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.616+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:04.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.616+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:03:04.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.817+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 msgr2=0x7f7190008a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:04.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.817+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 0x7f7190008a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:03:04.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.817+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:04.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:04.817+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:03:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:05.218+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 msgr2=0x7f7190008a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:05.218+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 0x7f7190008a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:03:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:05.218+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:05.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:05.218+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:03:05.918 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:03:05 smithi123 podman[77936]: 2024-05-06 14:03:05.698789623 +0000 UTC m=+0.018100684 image pull 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3 2024-05-06T14:03:05.919 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:03:05 smithi123 podman[77936]: 2024-05-06 14:03:05.797003152 +0000 UTC m=+0.116314199 container create 12d0a77ce188cafad26ce3ca4cae08e0b5972c64a1296a791a127b1eeaa089c8 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, ceph=True) 2024-05-06T14:03:06.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:06.019+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 msgr2=0x7f7190008a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:06.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:06.019+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 0x7f7190008a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:03:06.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:06.019+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:06.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:06.019+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:03:06.306 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:03:06 smithi123 podman[77936]: 2024-05-06 14:03:06.024387938 +0000 UTC m=+0.343698983 container init 12d0a77ce188cafad26ce3ca4cae08e0b5972c64a1296a791a127b1eeaa089c8 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.29.1, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-05-06T14:03:06.306 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:03:06 smithi123 podman[77936]: 2024-05-06 14:03:06.027574643 +0000 UTC m=+0.346885697 container start 12d0a77ce188cafad26ce3ca4cae08e0b5972c64a1296a791a127b1eeaa089c8 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0-deactivate, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-06T14:03:06.306 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:03:06 smithi123 podman[77936]: 2024-05-06 14:03:06.107702034 +0000 UTC m=+0.427013080 container attach 12d0a77ce188cafad26ce3ca4cae08e0b5972c64a1296a791a127b1eeaa089c8 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1) 2024-05-06T14:03:06.575 INFO:journalctl@ceph.osd.0.smithi123.stdout:May 06 14:03:06 smithi123 podman[77936]: 2024-05-06 14:03:06.309061893 +0000 UTC m=+0.628372939 container died 12d0a77ce188cafad26ce3ca4cae08e0b5972c64a1296a791a127b1eeaa089c8 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.1, RELEASE=HEAD, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-05-06T14:03:06.961 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.0.service' 2024-05-06T14:03:07.000 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T14:03:07.000 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-06T14:03:07.000 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-06T14:03:07.001 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.1 2024-05-06T14:03:07.314 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:07 smithi123 systemd[1]: Stopping Ceph osd.1 for f22edd3c-0baf-11ef-bc97-c7b262605968... 2024-05-06T14:03:07.601 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:07 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1[54161]: 2024-05-06T14:03:07.314+0000 7f105eda1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T14:03:07.601 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:07 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1[54161]: 2024-05-06T14:03:07.314+0000 7f105eda1700 -1 osd.1 46 *** Got signal Terminated *** 2024-05-06T14:03:07.601 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:07 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1[54161]: 2024-05-06T14:03:07.314+0000 7f105eda1700 -1 osd.1 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T14:03:07.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:07.620+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 msgr2=0x7f7190008a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:07.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:07.621+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 0x7f7190008a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:03:07.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:07.621+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:07.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:07.621+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:03:10.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:10.824+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 msgr2=0x7f7190008a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:10.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:10.824+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 0x7f7190008a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:03:10.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:10.824+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:10.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:10.824+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:03:12.888 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:12 smithi123 podman[78055]: 2024-05-06 14:03:12.629713956 +0000 UTC m=+5.399763512 container died 984558595cd6d567de04ed305ad943ac30630dfe3bcaaf5d2371fc211d078203 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=HEAD) 2024-05-06T14:03:13.263 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:13 smithi123 podman[78055]: 2024-05-06 14:03:13.073081382 +0000 UTC m=+5.843130917 container cleanup 984558595cd6d567de04ed305ad943ac30630dfe3bcaaf5d2371fc211d078203 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1, io.buildah.version=1.29.1, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-05-06T14:03:13.264 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:13 smithi123 bash[78055]: ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1 2024-05-06T14:03:13.601 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:13 smithi123 podman[78071]: 2024-05-06 14:03:13.266149234 +0000 UTC m=+0.632074714 container remove 984558595cd6d567de04ed305ad943ac30630dfe3bcaaf5d2371fc211d078203 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.1, RELEASE=HEAD, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0) 2024-05-06T14:03:13.966 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:13 smithi123 podman[78165]: 2024-05-06 14:03:13.692205223 +0000 UTC m=+0.112147427 container create 27143cd2b4b514662f723632aa0f76c2ffc7c049910ff2fb1e36bab6ccb5b550 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-05-06T14:03:13.967 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:13 smithi123 podman[78165]: 2024-05-06 14:03:13.598142012 +0000 UTC m=+0.018084235 image pull 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3 2024-05-06T14:03:13.967 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:13 smithi123 podman[78165]: 2024-05-06 14:03:13.886934597 +0000 UTC m=+0.306876801 container init 27143cd2b4b514662f723632aa0f76c2ffc7c049910ff2fb1e36bab6ccb5b550 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-06T14:03:13.967 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:13 smithi123 podman[78165]: 2024-05-06 14:03:13.890027003 +0000 UTC m=+0.309969215 container start 27143cd2b4b514662f723632aa0f76c2ffc7c049910ff2fb1e36bab6ccb5b550 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T14:03:13.967 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:13 smithi123 podman[78165]: 2024-05-06 14:03:13.96951843 +0000 UTC m=+0.389460637 container attach 27143cd2b4b514662f723632aa0f76c2ffc7c049910ff2fb1e36bab6ccb5b550 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T14:03:14.351 INFO:journalctl@ceph.osd.1.smithi123.stdout:May 06 14:03:14 smithi123 podman[78165]: 2024-05-06 14:03:14.173320577 +0000 UTC m=+0.593262773 container died 27143cd2b4b514662f723632aa0f76c2ffc7c049910ff2fb1e36bab6ccb5b550 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-06T14:03:14.851 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:14 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2[61572]: 2024-05-06T14:03:14.509+0000 7f1926e3d700 -1 osd.2 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:52.050036+0000 front 2024-05-06T14:02:52.050125+0000 (oldest deadline 2024-05-06T14:03:14.350111+0000) 2024-05-06T14:03:14.891 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.1.service' 2024-05-06T14:03:14.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T14:03:14.931 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-06T14:03:14.932 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-06T14:03:14.932 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.2 2024-05-06T14:03:15.257 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:15 smithi123 systemd[1]: Stopping Ceph osd.2 for f22edd3c-0baf-11ef-bc97-c7b262605968... 2024-05-06T14:03:15.257 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:15 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2[61572]: 2024-05-06T14:03:15.259+0000 7f192c04a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T14:03:15.258 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:15 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2[61572]: 2024-05-06T14:03:15.259+0000 7f192c04a700 -1 osd.2 46 *** Got signal Terminated *** 2024-05-06T14:03:15.258 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:15 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2[61572]: 2024-05-06T14:03:15.259+0000 7f192c04a700 -1 osd.2 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T14:03:15.851 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:15 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2[61572]: 2024-05-06T14:03:15.549+0000 7f1926e3d700 -1 osd.2 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:52.050036+0000 front 2024-05-06T14:02:52.050125+0000 (oldest deadline 2024-05-06T14:03:14.350111+0000) 2024-05-06T14:03:16.058 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:15 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:15.794+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:16.311 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:16 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:16.059+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:16.851 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:16 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2[61572]: 2024-05-06T14:03:16.536+0000 7f1926e3d700 -1 osd.2 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:52.050036+0000 front 2024-05-06T14:02:52.050125+0000 (oldest deadline 2024-05-06T14:03:14.350111+0000) 2024-05-06T14:03:17.038 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:16 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:16.776+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:17.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:17.227+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 msgr2=0x7f7190008a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:17.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:17.227+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 0x7f7190008a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-05-06T14:03:17.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:17.231+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:17.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:17.231+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-05-06T14:03:17.519 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:17 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:17.039+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:17.520 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:17 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:17.228+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:17.851 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:17 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2[61572]: 2024-05-06T14:03:17.531+0000 7f1926e3d700 -1 osd.2 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:52.050036+0000 front 2024-05-06T14:02:52.050125+0000 (oldest deadline 2024-05-06T14:03:14.350111+0000) 2024-05-06T14:03:18.019 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:17 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:17.767+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:18.519 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:18 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:18.048+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:18.520 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:18 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:18.206+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:18.851 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:18 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2[61572]: 2024-05-06T14:03:18.501+0000 7f1926e3d700 -1 osd.2 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:52.050036+0000 front 2024-05-06T14:02:52.050125+0000 (oldest deadline 2024-05-06T14:03:14.350111+0000) 2024-05-06T14:03:19.019 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:18 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:18.758+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:19.519 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:19 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:19.053+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:19.520 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:19 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:19.174+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:19.601 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:19 smithi123 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2[61572]: 2024-05-06T14:03:19.468+0000 7f1926e3d700 -1 osd.2 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:52.050036+0000 front 2024-05-06T14:02:52.050125+0000 (oldest deadline 2024-05-06T14:03:14.350111+0000) 2024-05-06T14:03:19.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:19.804+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:03:19.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:19.804+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:03:19.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:19.804+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 msgr2=0x7f7190008a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:03:19.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:19.804+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190007da0 0x7f7190008a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:03:19.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:19.804+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f719000afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:03:19.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:19.804+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:03:19.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:19.804+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0036f00 con 0x7f7190008640 2024-05-06T14:03:19.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:19.804+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0037040 con 0x7f71b0101dc0 2024-05-06T14:03:19.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:19.804+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f719000afb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:19.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:19.804+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f719000afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:03:19.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:19.804+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:19.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:19.804+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:03:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:20.005+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f719000afb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:20.005+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f719000afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:03:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:20.005+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:20.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:20.005+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:03:20.019 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:19 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:19.731+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:20.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:20.406+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f719000afb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:20.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:20.406+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f719000afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:03:20.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:20.406+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:20.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:20.406+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:03:20.519 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:20 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:20.069+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:20.520 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:20 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:20.159+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:20.851 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:20 smithi123 podman[78270]: 2024-05-06 14:03:20.631870697 +0000 UTC m=+5.469820113 container died 2aa0a706b75c888bd57ee66d67f8638b578abff8525adf9cabc9896dc67e85c4 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2, ceph=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD) 2024-05-06T14:03:21.019 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:20 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:20.698+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:21.205 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:21 smithi123 podman[78270]: 2024-05-06 14:03:21.076393261 +0000 UTC m=+5.914342710 container cleanup 2aa0a706b75c888bd57ee66d67f8638b578abff8525adf9cabc9896dc67e85c4 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-05-06T14:03:21.205 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:21 smithi123 bash[78270]: ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2 2024-05-06T14:03:21.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:21.207+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f719000afb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:21.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:21.207+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f719000afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:03:21.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:21.207+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:21.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:21.207+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:03:21.357 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:21 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:21.132+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:21.358 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:21 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:21.024+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:21.601 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:21 smithi123 podman[78287]: 2024-05-06 14:03:21.369555031 +0000 UTC m=+0.738974083 container remove 2aa0a706b75c888bd57ee66d67f8638b578abff8525adf9cabc9896dc67e85c4 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2, org.label-schema.build-date=20240222, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-06T14:03:21.978 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:21 smithi123 podman[78379]: 2024-05-06 14:03:21.67037232 +0000 UTC m=+0.094082437 container create 95d856f4d0ded5ccfb2d78b51d2c896216700bd64dd78ffd2fee35ed50fb030a (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2-deactivate, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, RELEASE=HEAD) 2024-05-06T14:03:21.978 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:21 smithi123 podman[78379]: 2024-05-06 14:03:21.594331931 +0000 UTC m=+0.018042057 image pull 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3 2024-05-06T14:03:21.978 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:21 smithi123 podman[78379]: 2024-05-06 14:03:21.881055985 +0000 UTC m=+0.304766101 container init 95d856f4d0ded5ccfb2d78b51d2c896216700bd64dd78ffd2fee35ed50fb030a (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2-deactivate, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1) 2024-05-06T14:03:21.978 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:21 smithi123 podman[78379]: 2024-05-06 14:03:21.884228295 +0000 UTC m=+0.307938411 container start 95d856f4d0ded5ccfb2d78b51d2c896216700bd64dd78ffd2fee35ed50fb030a (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux ) 2024-05-06T14:03:21.978 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:21 smithi123 podman[78379]: 2024-05-06 14:03:21.981067463 +0000 UTC m=+0.404777582 container attach 95d856f4d0ded5ccfb2d78b51d2c896216700bd64dd78ffd2fee35ed50fb030a (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.1) 2024-05-06T14:03:22.020 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:21 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:21.705+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:22.351 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:22 smithi123 podman[78379]: 2024-05-06 14:03:22.163213131 +0000 UTC m=+0.586923241 container died 95d856f4d0ded5ccfb2d78b51d2c896216700bd64dd78ffd2fee35ed50fb030a (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS) 2024-05-06T14:03:22.519 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:22 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:22.178+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:22.520 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:22 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:22.055+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:22.714 INFO:journalctl@ceph.osd.2.smithi123.stdout:May 06 14:03:22 smithi123 podman[78406]: 2024-05-06 14:03:22.701272231 +0000 UTC m=+0.532819865 container remove 95d856f4d0ded5ccfb2d78b51d2c896216700bd64dd78ffd2fee35ed50fb030a (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-2-deactivate, io.buildah.version=1.29.1, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, ceph=True) 2024-05-06T14:03:22.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.2.service' 2024-05-06T14:03:22.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T14:03:22.757 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-06T14:03:22.758 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-06T14:03:22.758 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.3 2024-05-06T14:03:22.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:22.808+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f719000afb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:22.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:22.809+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f719000afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:03:22.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:22.809+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:22.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:22.809+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:03:23.019 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:22 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:22.739+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:23.020 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:22 smithi174 systemd[1]: Stopping Ceph osd.3 for f22edd3c-0baf-11ef-bc97-c7b262605968... 2024-05-06T14:03:23.519 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:23 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:23.037+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:23.520 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:23 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:23.202+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:23.520 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:23 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:23.064+0000 7f1506e70700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T14:03:23.520 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:23 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:23.064+0000 7f1506e70700 -1 osd.3 46 *** Got signal Terminated *** 2024-05-06T14:03:23.520 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:23 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:23.064+0000 7f1506e70700 -1 osd.3 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T14:03:24.214 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:23 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:23.784+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:24.214 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:24 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:24.030+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:24.519 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:24 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:24.216+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:25.019 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:24 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:24.767+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:25.020 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:25 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:25.017+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:25.519 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:25 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:25.218+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:26.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:26.012+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f719000afb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:26.012+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f719000afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:03:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:26.012+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:26.012+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:03:26.015 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:25 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:25.766+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:26.269 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:26 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:26.249+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:26.270 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:26 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:26.017+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:27.019 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:26 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:26.760+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:27.519 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:27 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:27.059+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:27.520 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:27 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:27.271+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:28.095 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:27 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3[41218]: 2024-05-06T14:03:27.802+0000 7f1503c67700 -1 osd.3 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:49.518326+0000 front 2024-05-06T14:02:49.518335+0000 (oldest deadline 2024-05-06T14:03:14.818327+0000) 2024-05-06T14:03:28.487 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:28 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:28.303+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:28.487 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:28 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:28.097+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:28.769 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:28 smithi174 podman[61551]: 2024-05-06 14:03:28.489712257 +0000 UTC m=+5.539069098 container died 43da6966185b20207be41ccf45bebee5b1d060efd2f4cc267379b6c4d726b171 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, RELEASE=HEAD) 2024-05-06T14:03:29.105 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:28 smithi174 podman[61551]: 2024-05-06 14:03:28.948406111 +0000 UTC m=+5.997762943 container cleanup 43da6966185b20207be41ccf45bebee5b1d060efd2f4cc267379b6c4d726b171 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20240222, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-06T14:03:29.105 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:28 smithi174 bash[61551]: ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3 2024-05-06T14:03:29.519 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:29 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:29.107+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:29.520 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:29 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:29.259+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:29.520 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:29 smithi174 podman[61574]: 2024-05-06 14:03:29.241349969 +0000 UTC m=+0.747453952 container remove 43da6966185b20207be41ccf45bebee5b1d060efd2f4cc267379b6c4d726b171 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, RELEASE=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-06T14:03:29.967 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:29 smithi174 podman[61659]: 2024-05-06 14:03:29.545392102 +0000 UTC m=+0.019485798 image pull 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3 2024-05-06T14:03:29.968 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:29 smithi174 podman[61659]: 2024-05-06 14:03:29.642170573 +0000 UTC m=+0.116264246 container create 1f2c71267f57de6750a661740275df20605e09d71fcc65416c774a5bea090f09 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, RELEASE=HEAD, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222) 2024-05-06T14:03:29.968 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:29 smithi174 podman[61659]: 2024-05-06 14:03:29.878011779 +0000 UTC m=+0.352105466 container init 1f2c71267f57de6750a661740275df20605e09d71fcc65416c774a5bea090f09 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3-deactivate, RELEASE=HEAD, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-06T14:03:29.968 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:29 smithi174 podman[61659]: 2024-05-06 14:03:29.882337151 +0000 UTC m=+0.356430828 container start 1f2c71267f57de6750a661740275df20605e09d71fcc65416c774a5bea090f09 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.29.1) 2024-05-06T14:03:29.968 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:29 smithi174 podman[61659]: 2024-05-06 14:03:29.969369443 +0000 UTC m=+0.443463137 container attach 1f2c71267f57de6750a661740275df20605e09d71fcc65416c774a5bea090f09 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, RELEASE=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, ceph=True, GIT_BRANCH=HEAD) 2024-05-06T14:03:30.219 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:30 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:30.073+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:30.519 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:30 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:30.234+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:30.520 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:30 smithi174 podman[61659]: 2024-05-06 14:03:30.222595233 +0000 UTC m=+0.696688905 container died 1f2c71267f57de6750a661740275df20605e09d71fcc65416c774a5bea090f09 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, RELEASE=HEAD, ceph=True, GIT_BRANCH=HEAD) 2024-05-06T14:03:30.797 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.3.service' 2024-05-06T14:03:30.819 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:30 smithi174 podman[61685]: 2024-05-06 14:03:30.790090877 +0000 UTC m=+0.560605639 container remove 1f2c71267f57de6750a661740275df20605e09d71fcc65416c774a5bea090f09 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-3-deactivate, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.build-date=20240222, GIT_CLEAN=True) 2024-05-06T14:03:30.819 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:30 smithi174 systemd[1]: ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.3.service: Deactivated successfully. 2024-05-06T14:03:30.819 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:30 smithi174 systemd[1]: Stopped Ceph osd.3 for f22edd3c-0baf-11ef-bc97-c7b262605968. 2024-05-06T14:03:30.819 INFO:journalctl@ceph.osd.3.smithi174.stdout:May 06 14:03:30 smithi174 systemd[1]: ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.3.service: Consumed 3.330s CPU time. 2024-05-06T14:03:30.842 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T14:03:30.842 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-06T14:03:30.842 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-06T14:03:30.842 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.4 2024-05-06T14:03:31.101 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:30 smithi174 systemd[1]: Stopping Ceph osd.4 for f22edd3c-0baf-11ef-bc97-c7b262605968... 2024-05-06T14:03:31.449 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:31 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:31.250+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:31.450 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:31 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:31.103+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:31.450 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:31 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:31.235+0000 7fea928d0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T14:03:31.450 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:31 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:31.235+0000 7fea928d0700 -1 osd.4 46 *** Got signal Terminated *** 2024-05-06T14:03:31.450 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:31 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:31.235+0000 7fea928d0700 -1 osd.4 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T14:03:32.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:32.419+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f719000afb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:32.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:32.419+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f719000afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-05-06T14:03:32.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:32.419+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:32.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:32.419+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-05-06T14:03:32.519 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:32 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:32.130+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:32.519 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:32 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:32.291+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:33.519 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:33 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:33.109+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:33.520 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:33 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:33.262+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:34.519 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:34 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:34.102+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:34.520 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:34 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:34.286+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:35.519 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:35 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:35.102+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:35.520 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:35 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:35.312+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:35.520 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:35 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:35.312+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-05-06T14:03:09.619419+0000 front 2024-05-06T14:03:09.619366+0000 (oldest deadline 2024-05-06T14:03:34.319308+0000) 2024-05-06T14:03:36.421 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:36 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:36.139+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.024322+0000 front 2024-05-06T14:02:50.024190+0000 (oldest deadline 2024-05-06T14:03:15.324206+0000) 2024-05-06T14:03:36.421 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:36 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4[47866]: 2024-05-06T14:03:36.139+0000 7fea8e6c5700 -1 osd.4 46 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-05-06T14:03:11.626743+0000 front 2024-05-06T14:03:11.626875+0000 (oldest deadline 2024-05-06T14:03:35.126571+0000) 2024-05-06T14:03:36.421 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:36 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:36.347+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:36.422 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:36 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:36.347+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-05-06T14:03:09.619419+0000 front 2024-05-06T14:03:09.619366+0000 (oldest deadline 2024-05-06T14:03:34.319308+0000) 2024-05-06T14:03:36.698 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:36 smithi174 podman[61765]: 2024-05-06 14:03:36.699841448 +0000 UTC m=+5.602503663 container died a10cb353bea3a01323306837e5d42027bbb6bb65508a30afbdeccc448d61dc31 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.1, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-05-06T14:03:37.269 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:37 smithi174 podman[61765]: 2024-05-06 14:03:37.176624831 +0000 UTC m=+6.079287036 container cleanup a10cb353bea3a01323306837e5d42027bbb6bb65508a30afbdeccc448d61dc31 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, io.buildah.version=1.29.1, ceph=True, GIT_BRANCH=HEAD) 2024-05-06T14:03:37.270 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:37 smithi174 bash[61765]: ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4 2024-05-06T14:03:37.769 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:37 smithi174 podman[61784]: 2024-05-06 14:03:37.453692119 +0000 UTC m=+0.749661151 container remove a10cb353bea3a01323306837e5d42027bbb6bb65508a30afbdeccc448d61dc31 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222) 2024-05-06T14:03:37.770 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:37 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:37.321+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:37.770 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:37 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:37.321+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-05-06T14:03:09.619419+0000 front 2024-05-06T14:03:09.619366+0000 (oldest deadline 2024-05-06T14:03:34.319308+0000) 2024-05-06T14:03:38.110 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:37 smithi174 podman[61869]: 2024-05-06 14:03:37.862929692 +0000 UTC m=+0.110297053 container create 303bfb8a9207889ed8e8fa0cb70b73e6c87162c255e07fa3e376a641b408bc40 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222) 2024-05-06T14:03:38.111 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:37 smithi174 podman[61869]: 2024-05-06 14:03:37.773386541 +0000 UTC m=+0.020753913 image pull 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3 2024-05-06T14:03:38.111 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:38 smithi174 podman[61869]: 2024-05-06 14:03:38.108278628 +0000 UTC m=+0.355645991 container init 303bfb8a9207889ed8e8fa0cb70b73e6c87162c255e07fa3e376a641b408bc40 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, ceph=True, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-06T14:03:38.111 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:38 smithi174 podman[61869]: 2024-05-06 14:03:38.113444462 +0000 UTC m=+0.360811823 container start 303bfb8a9207889ed8e8fa0cb70b73e6c87162c255e07fa3e376a641b408bc40 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4-deactivate, RELEASE=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD) 2024-05-06T14:03:38.397 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:38 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:38.282+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:38.397 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:38 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:38.282+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-05-06T14:03:09.619419+0000 front 2024-05-06T14:03:09.619366+0000 (oldest deadline 2024-05-06T14:03:34.319308+0000) 2024-05-06T14:03:38.398 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:38 smithi174 podman[61869]: 2024-05-06 14:03:38.233478545 +0000 UTC m=+0.480845907 container attach 303bfb8a9207889ed8e8fa0cb70b73e6c87162c255e07fa3e376a641b408bc40 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-06T14:03:38.398 INFO:journalctl@ceph.osd.4.smithi174.stdout:May 06 14:03:38 smithi174 podman[61869]: 2024-05-06 14:03:38.400673117 +0000 UTC m=+0.648040478 container died 303bfb8a9207889ed8e8fa0cb70b73e6c87162c255e07fa3e376a641b408bc40 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, ceph=True, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.license=GPLv2, RELEASE=HEAD, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222) 2024-05-06T14:03:38.946 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.4.service' 2024-05-06T14:03:38.997 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T14:03:38.998 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-06T14:03:38.998 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-06T14:03:38.998 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.5 2024-05-06T14:03:39.269 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:39 smithi174 systemd[1]: Stopping Ceph osd.5 for f22edd3c-0baf-11ef-bc97-c7b262605968... 2024-05-06T14:03:39.769 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:39 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:39.283+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:39.770 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:39 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:39.283+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-05-06T14:03:09.619419+0000 front 2024-05-06T14:03:09.619366+0000 (oldest deadline 2024-05-06T14:03:34.319308+0000) 2024-05-06T14:03:39.770 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:39 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:39.374+0000 7ff1a24ea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T14:03:39.770 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:39 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:39.374+0000 7ff1a24ea700 -1 osd.5 46 *** Got signal Terminated *** 2024-05-06T14:03:39.770 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:39 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:39.374+0000 7ff1a24ea700 -1 osd.5 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T14:03:40.769 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:40 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:40.307+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:40.769 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:40 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:40.307+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-05-06T14:03:09.619419+0000 front 2024-05-06T14:03:09.619366+0000 (oldest deadline 2024-05-06T14:03:34.319308+0000) 2024-05-06T14:03:41.542 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:41 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:41.277+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:41.543 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:41 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:41.277+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-05-06T14:03:09.619419+0000 front 2024-05-06T14:03:09.619366+0000 (oldest deadline 2024-05-06T14:03:34.319308+0000) 2024-05-06T14:03:42.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.585+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:03:42.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.585+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:03:42.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.586+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f719000afb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:03:42.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.586+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f719000afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:03:42.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.586+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:03:42.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.586+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f7190005ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:03:42.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.586+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0036f00 con 0x7f7190008640 2024-05-06T14:03:42.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.586+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0037040 con 0x7f71b0101dc0 2024-05-06T14:03:42.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.586+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:42.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.586+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:03:42.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.586+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:42.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.586+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:03:42.769 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:42 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:42.302+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:42.769 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:42 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:42.302+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-05-06T14:03:09.619419+0000 front 2024-05-06T14:03:09.619366+0000 (oldest deadline 2024-05-06T14:03:34.319308+0000) 2024-05-06T14:03:42.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.787+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:42.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.787+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:03:42.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.787+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:42.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:42.787+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:03:43.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:43.188+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:43.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:43.188+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:03:43.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:43.188+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:43.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:43.188+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:03:43.769 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:43 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:43.321+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:43.769 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:43 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:43.321+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-05-06T14:03:09.619419+0000 front 2024-05-06T14:03:09.619366+0000 (oldest deadline 2024-05-06T14:03:34.319308+0000) 2024-05-06T14:03:43.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:43.989+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:43.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:43.989+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:03:43.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:43.989+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:43.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:43.989+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:03:44.769 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:44 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:44.365+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-05-06T14:02:50.917053+0000 front 2024-05-06T14:02:50.917085+0000 (oldest deadline 2024-05-06T14:03:16.817213+0000) 2024-05-06T14:03:44.769 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:44 smithi174 ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5[54375]: 2024-05-06T14:03:44.365+0000 7ff19bada700 -1 osd.5 46 heartbeat_check: no reply from 172.21.15.123:6814 osd.1 since back 2024-05-06T14:03:09.619419+0000 front 2024-05-06T14:03:09.619366+0000 (oldest deadline 2024-05-06T14:03:34.319308+0000) 2024-05-06T14:03:45.138 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:44 smithi174 podman[61969]: 2024-05-06 14:03:44.878591181 +0000 UTC m=+5.634080013 container died 5fcdecb0b4e87f9a94394c1d11cbace133d3bef2598b1fad8428450c62458aed (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.29.1, GIT_BRANCH=HEAD) 2024-05-06T14:03:45.519 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:45 smithi174 podman[61969]: 2024-05-06 14:03:45.306820845 +0000 UTC m=+6.062309678 container cleanup 5fcdecb0b4e87f9a94394c1d11cbace133d3bef2598b1fad8428450c62458aed (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-05-06T14:03:45.519 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:45 smithi174 bash[61969]: ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5 2024-05-06T14:03:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:45.590+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:45.591+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:03:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:45.591+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:45.591+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:03:46.005 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:45 smithi174 podman[61984]: 2024-05-06 14:03:45.574683761 +0000 UTC m=+0.684994354 container remove 5fcdecb0b4e87f9a94394c1d11cbace133d3bef2598b1fad8428450c62458aed (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-06T14:03:46.269 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:46 smithi174 podman[62062]: 2024-05-06 14:03:46.00867474 +0000 UTC m=+0.106991477 container create 751cc6f00af96f03fbc8b57f052622a943e399b72c9c96f2b4bd481bcf9e2cdc (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, RELEASE=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1) 2024-05-06T14:03:46.269 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:46 smithi174 podman[62062]: 2024-05-06 14:03:45.928225046 +0000 UTC m=+0.026541822 image pull 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3 2024-05-06T14:03:46.270 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:46 smithi174 podman[62062]: 2024-05-06 14:03:46.236639815 +0000 UTC m=+0.334956563 container init 751cc6f00af96f03fbc8b57f052622a943e399b72c9c96f2b4bd481bcf9e2cdc (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, RELEASE=HEAD, ceph=True, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2) 2024-05-06T14:03:46.270 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:46 smithi174 podman[62062]: 2024-05-06 14:03:46.24197201 +0000 UTC m=+0.340288754 container start 751cc6f00af96f03fbc8b57f052622a943e399b72c9c96f2b4bd481bcf9e2cdc (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, ceph=True, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-06T14:03:46.580 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:46 smithi174 podman[62062]: 2024-05-06 14:03:46.311069232 +0000 UTC m=+0.409385986 container attach 751cc6f00af96f03fbc8b57f052622a943e399b72c9c96f2b4bd481bcf9e2cdc (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.29.1, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, RELEASE=HEAD, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T14:03:47.019 INFO:journalctl@ceph.osd.5.smithi174.stdout:May 06 14:03:46 smithi174 podman[62062]: 2024-05-06 14:03:46.624196442 +0000 UTC m=+0.722513186 container died 751cc6f00af96f03fbc8b57f052622a943e399b72c9c96f2b4bd481bcf9e2cdc (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-f22edd3c-0baf-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-06T14:03:47.311 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f22edd3c-0baf-11ef-bc97-c7b262605968@osd.5.service' 2024-05-06T14:03:47.351 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T14:03:47.351 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-06T14:03:47.352 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-06T14:03:47.505 INFO:teuthology.orchestra.run.smithi123.stdout:Deleting cluster with fsid: f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T14:03:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.069+0000 7f71b4865700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71a006c4e0 msgr2=0x7f71a006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-06T14:03:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.069+0000 7f71b4865700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71a006c4e0 msgr2=0x7f71a006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T14:03:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.069+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71a006c4e0 0x7f71a006e9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f71a4005090 tx=0x7f71a40058e0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-06T14:03:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.069+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71a006c4e0 0x7f71a006e9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f71a4005090 tx=0x7f71a40058e0 comp rx=0 tx=0).stop 2024-05-06T14:03:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.069+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71a006c4e0 msgr2=0x7f71a006e9a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-06T14:03:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.069+0000 7f71adffb700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71a006c4e0 0x7f71a006e9a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:03:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.069+0000 7f71adffb700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 0x7f71a00760d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:03:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.069+0000 7f71adffb700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:04416f48efe02891b265c07b4f38b46e422bbef9", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f71a800bd30 con 0x7f71b0100bc0 2024-05-06T14:03:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.069+0000 7f71b4865700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3135616195 2024-05-06T14:03:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.069+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:03:48.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.270+0000 7f71b4865700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3135616195 2024-05-06T14:03:48.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.270+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:03:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.671+0000 7f71b4865700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3135616195 2024-05-06T14:03:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.671+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:03:48.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.794+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:48.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.794+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:03:48.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.794+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:48.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:48.794+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:03:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:49.472+0000 7f71b4865700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3135616195 2024-05-06T14:03:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:49.472+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:03:51.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:51.073+0000 7f71b4865700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3135616195 2024-05-06T14:03:51.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:51.073+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:03:54.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:54.276+0000 7f71b4865700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3135616195 2024-05-06T14:03:54.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:54.276+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:03:55.128 INFO:tasks.workunit.client.1.smithi174.stderr:Note: switching to '04416f48efe02891b265c07b4f38b46e422bbef9'. 2024-05-06T14:03:55.128 INFO:tasks.workunit.client.1.smithi174.stderr: 2024-05-06T14:03:55.128 INFO:tasks.workunit.client.1.smithi174.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-06T14:03:55.128 INFO:tasks.workunit.client.1.smithi174.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-06T14:03:55.128 INFO:tasks.workunit.client.1.smithi174.stderr:state without impacting any branches by switching back to a branch. 2024-05-06T14:03:55.128 INFO:tasks.workunit.client.1.smithi174.stderr: 2024-05-06T14:03:55.129 INFO:tasks.workunit.client.1.smithi174.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-06T14:03:55.129 INFO:tasks.workunit.client.1.smithi174.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-06T14:03:55.129 INFO:tasks.workunit.client.1.smithi174.stderr: 2024-05-06T14:03:55.129 INFO:tasks.workunit.client.1.smithi174.stderr: git switch -c 2024-05-06T14:03:55.129 INFO:tasks.workunit.client.1.smithi174.stderr: 2024-05-06T14:03:55.129 INFO:tasks.workunit.client.1.smithi174.stderr:Or undo this operation with: 2024-05-06T14:03:55.129 INFO:tasks.workunit.client.1.smithi174.stderr: 2024-05-06T14:03:55.129 INFO:tasks.workunit.client.1.smithi174.stderr: git switch - 2024-05-06T14:03:55.130 INFO:tasks.workunit.client.1.smithi174.stderr: 2024-05-06T14:03:55.130 INFO:tasks.workunit.client.1.smithi174.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-06T14:03:55.130 INFO:tasks.workunit.client.1.smithi174.stderr: 2024-05-06T14:03:55.130 INFO:tasks.workunit.client.1.smithi174.stderr:HEAD is now at 04416f48efe Merge pull request #56846 from rishabh-d-dave/test-fs-auth 2024-05-06T14:03:55.131 DEBUG:teuthology.orchestra.run.smithi174:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-05-06T14:03:55.165 INFO:tasks.workunit.client.1.smithi174.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-06T14:03:55.166 INFO:tasks.workunit.client.1.smithi174.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-06T14:03:55.167 INFO:tasks.workunit.client.1.smithi174.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-06T14:03:55.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:55.200+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:03:55.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:55.200+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-05-06T14:03:55.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:55.201+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:03:55.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:03:55.201+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-05-06T14:03:55.817 INFO:tasks.workunit.client.1.smithi174.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-06T14:03:55.875 INFO:tasks.workunit.client.1.smithi174.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-06T14:03:55.918 INFO:tasks.workunit.client.1.smithi174.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-06T14:03:55.919 INFO:tasks.workunit.client.1.smithi174.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-06T14:03:55.919 INFO:tasks.workunit.client.1.smithi174.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-06T14:03:55.958 INFO:tasks.workunit.client.1.smithi174.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-06T14:03:55.962 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-06T14:03:55.962 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-05-06T14:03:56.017 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-05-06T14:03:56.019 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-05-06T14:03:56.019 DEBUG:teuthology.orchestra.run.smithi174:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04416f48efe02891b265c07b4f38b46e422bbef9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-05-06T14:03:56.075 INFO:tasks.workunit.client.1.smithi174.stderr:+ mkdir -p fsstress 2024-05-06T14:03:56.076 INFO:tasks.workunit.client.1.smithi174.stderr:+ pushd fsstress 2024-05-06T14:03:56.076 INFO:tasks.workunit.client.1.smithi174.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-06T14:03:56.076 INFO:tasks.workunit.client.1.smithi174.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-05-06T14:03:57.702 INFO:tasks.workunit.client.1.smithi174.stderr:+ tar xzf ltp-full.tgz 2024-05-06T14:03:58.096 INFO:tasks.workunit.client.1.smithi174.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-05-06T14:03:58.097 INFO:tasks.workunit.client.1.smithi174.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-06T14:03:58.097 INFO:tasks.workunit.client.1.smithi174.stderr:+ make 2024-05-06T14:03:58.098 INFO:tasks.workunit.client.1.smithi174.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-05-06T14:03:58.254 INFO:tasks.workunit.client.1.smithi174.stderr:++ readlink -f fsstress 2024-05-06T14:03:58.254 INFO:tasks.workunit.client.1.smithi174.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-05-06T14:03:58.255 INFO:tasks.workunit.client.1.smithi174.stderr:+ popd 2024-05-06T14:03:58.255 INFO:tasks.workunit.client.1.smithi174.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-06T14:03:58.255 INFO:tasks.workunit.client.1.smithi174.stderr:+ popd 2024-05-06T14:03:58.256 INFO:tasks.workunit.client.1.smithi174.stdout:~/cephtest/mnt.1/client.1/tmp 2024-05-06T14:03:58.256 INFO:tasks.workunit.client.1.smithi174.stderr:++ mktemp -d -p . 2024-05-06T14:03:58.256 INFO:tasks.workunit.client.1.smithi174.stderr:+ T=./tmp.8G8UPVvPKW 2024-05-06T14:03:58.256 INFO:tasks.workunit.client.1.smithi174.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.8G8UPVvPKW -l 1 -n 1000 -p 10 -v 2024-05-06T14:03:58.259 INFO:tasks.workunit.client.1.smithi174.stdout:seed = 1715149695 2024-05-06T14:03:58.259 INFO:tasks.workunit.client.1.smithi174.stdout:0/0: chown . 92155 1 2024-05-06T14:03:58.259 INFO:tasks.workunit.client.1.smithi174.stdout:0/1: dwrite - no filename 2024-05-06T14:03:58.259 INFO:tasks.workunit.client.1.smithi174.stdout:0/2: mkdir d0 0 2024-05-06T14:03:58.259 INFO:tasks.workunit.client.1.smithi174.stdout:0/3: readlink - no filename 2024-05-06T14:03:58.259 INFO:tasks.workunit.client.1.smithi174.stdout:0/4: getdents d0 0 2024-05-06T14:03:58.260 INFO:tasks.workunit.client.1.smithi174.stdout:1/0: mknod c0 0 2024-05-06T14:03:58.260 INFO:tasks.workunit.client.1.smithi174.stdout:2/0: mkdir d0 0 2024-05-06T14:03:58.260 INFO:tasks.workunit.client.1.smithi174.stdout:2/1: dread - no filename 2024-05-06T14:03:58.260 INFO:tasks.workunit.client.1.smithi174.stdout:3/0: write - no filename 2024-05-06T14:03:58.260 INFO:tasks.workunit.client.1.smithi174.stdout:0/5: mknod d0/c1 0 2024-05-06T14:03:58.260 INFO:tasks.workunit.client.1.smithi174.stdout:0/6: chown d0 0 1 2024-05-06T14:03:58.260 INFO:tasks.workunit.client.1.smithi174.stdout:0/7: link d0/c1 d0/c2 0 2024-05-06T14:03:58.260 INFO:tasks.workunit.client.1.smithi174.stdout:1/1: creat f1 x:0 0 0 2024-05-06T14:03:58.260 INFO:tasks.workunit.client.1.smithi174.stdout:0/8: dread - no filename 2024-05-06T14:03:58.261 INFO:tasks.workunit.client.1.smithi174.stdout:4/0: readlink - no filename 2024-05-06T14:03:58.261 INFO:tasks.workunit.client.1.smithi174.stdout:0/9: rmdir d0 39 2024-05-06T14:03:58.261 INFO:tasks.workunit.client.1.smithi174.stdout:0/10: dread - no filename 2024-05-06T14:03:58.261 INFO:tasks.workunit.client.1.smithi174.stdout:4/1: unlink - no file 2024-05-06T14:03:58.261 INFO:tasks.workunit.client.1.smithi174.stdout:3/1: creat f0 x:0 0 0 2024-05-06T14:03:58.261 INFO:tasks.workunit.client.1.smithi174.stdout:0/11: chown d0/c1 17 1 2024-05-06T14:03:58.261 INFO:tasks.workunit.client.1.smithi174.stdout:1/2: dread - f1 zero size 2024-05-06T14:03:58.261 INFO:tasks.workunit.client.1.smithi174.stdout:3/2: readlink - no filename 2024-05-06T14:03:58.261 INFO:tasks.workunit.client.1.smithi174.stdout:2/2: mkdir d0/d1 0 2024-05-06T14:03:58.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/12: stat d0 0 2024-05-06T14:03:58.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/13: truncate - no filename 2024-05-06T14:03:58.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/14: dread - no filename 2024-05-06T14:03:58.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/15: dwrite - no filename 2024-05-06T14:03:58.262 INFO:tasks.workunit.client.1.smithi174.stdout:2/3: mkdir d0/d1/d2 0 2024-05-06T14:03:58.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/16: mkdir d0/d3 0 2024-05-06T14:03:58.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/17: dread - no filename 2024-05-06T14:03:58.262 INFO:tasks.workunit.client.1.smithi174.stdout:1/3: symlink l2 0 2024-05-06T14:03:58.262 INFO:tasks.workunit.client.1.smithi174.stdout:3/3: symlink l1 0 2024-05-06T14:03:58.263 INFO:tasks.workunit.client.1.smithi174.stdout:3/4: chown f0 2152161 1 2024-05-06T14:03:58.263 INFO:tasks.workunit.client.1.smithi174.stdout:1/4: mknod c3 0 2024-05-06T14:03:58.263 INFO:tasks.workunit.client.1.smithi174.stdout:1/5: read - f1 zero size 2024-05-06T14:03:58.263 INFO:tasks.workunit.client.1.smithi174.stdout:5/0: mknod c0 0 2024-05-06T14:03:58.263 INFO:tasks.workunit.client.1.smithi174.stdout:5/1: dread - no filename 2024-05-06T14:03:58.264 INFO:tasks.workunit.client.1.smithi174.stdout:3/5: creat f2 x:0 0 0 2024-05-06T14:03:58.264 INFO:tasks.workunit.client.1.smithi174.stdout:1/6: mknod c4 0 2024-05-06T14:03:58.264 INFO:tasks.workunit.client.1.smithi174.stdout:0/18: mkdir d0/d4 0 2024-05-06T14:03:58.264 INFO:tasks.workunit.client.1.smithi174.stdout:0/19: write - no filename 2024-05-06T14:03:58.264 INFO:tasks.workunit.client.1.smithi174.stdout:1/7: chown c3 460 1 2024-05-06T14:03:58.264 INFO:tasks.workunit.client.1.smithi174.stdout:3/6: dread - f0 zero size 2024-05-06T14:03:58.264 INFO:tasks.workunit.client.1.smithi174.stdout:3/7: stat f2 0 2024-05-06T14:03:58.264 INFO:tasks.workunit.client.1.smithi174.stdout:5/2: mkdir d1 0 2024-05-06T14:03:58.264 INFO:tasks.workunit.client.1.smithi174.stdout:0/20: creat d0/d3/f5 x:0 0 0 2024-05-06T14:03:58.265 INFO:tasks.workunit.client.1.smithi174.stdout:0/21: truncate d0/d3/f5 989900 0 2024-05-06T14:03:58.265 INFO:tasks.workunit.client.1.smithi174.stdout:0/22: stat d0 0 2024-05-06T14:03:58.265 INFO:tasks.workunit.client.1.smithi174.stdout:2/4: stat d0/d1 0 2024-05-06T14:03:58.265 INFO:tasks.workunit.client.1.smithi174.stdout:2/5: fdatasync - no filename 2024-05-06T14:03:58.265 INFO:tasks.workunit.client.1.smithi174.stdout:2/6: write - no filename 2024-05-06T14:03:58.265 INFO:tasks.workunit.client.1.smithi174.stdout:2/7: read - no filename 2024-05-06T14:03:58.265 INFO:tasks.workunit.client.1.smithi174.stdout:2/8: rename d0 to d0/d1/d2/d3 22 2024-05-06T14:03:58.265 INFO:tasks.workunit.client.1.smithi174.stdout:2/9: dread - no filename 2024-05-06T14:03:58.266 INFO:tasks.workunit.client.1.smithi174.stdout:2/10: chown d0/d1 320976 1 2024-05-06T14:03:58.266 INFO:tasks.workunit.client.1.smithi174.stdout:0/23: write d0/d3/f5 [1200846,5936] 0 2024-05-06T14:03:58.266 INFO:tasks.workunit.client.1.smithi174.stdout:2/11: dread - no filename 2024-05-06T14:03:58.266 INFO:tasks.workunit.client.1.smithi174.stdout:2/12: link - no file 2024-05-06T14:03:58.266 INFO:tasks.workunit.client.1.smithi174.stdout:2/13: truncate - no filename 2024-05-06T14:03:58.266 INFO:tasks.workunit.client.1.smithi174.stdout:2/14: dread - no filename 2024-05-06T14:03:58.266 INFO:tasks.workunit.client.1.smithi174.stdout:2/15: unlink - no file 2024-05-06T14:03:58.266 INFO:tasks.workunit.client.1.smithi174.stdout:0/24: rename d0/c2 to d0/d3/c6 0 2024-05-06T14:03:58.266 INFO:tasks.workunit.client.1.smithi174.stdout:1/8: write f1 [80775,43844] 0 2024-05-06T14:03:58.269 INFO:tasks.workunit.client.1.smithi174.stdout:5/3: creat d1/f2 x:0 0 0 2024-05-06T14:03:58.269 INFO:tasks.workunit.client.1.smithi174.stdout:0/25: mknod d0/d3/c7 0 2024-05-06T14:03:58.269 INFO:tasks.workunit.client.1.smithi174.stdout:3/8: symlink l3 0 2024-05-06T14:03:58.269 INFO:tasks.workunit.client.1.smithi174.stdout:1/9: creat f5 x:0 0 0 2024-05-06T14:03:58.269 INFO:tasks.workunit.client.1.smithi174.stdout:5/4: rename d1/f2 to d1/f3 0 2024-05-06T14:03:58.269 INFO:tasks.workunit.client.1.smithi174.stdout:6/0: mkdir d0 0 2024-05-06T14:03:58.270 INFO:tasks.workunit.client.1.smithi174.stdout:6/1: dwrite - no filename 2024-05-06T14:03:58.270 INFO:tasks.workunit.client.1.smithi174.stdout:2/16: mkdir d0/d1/d2/d4 0 2024-05-06T14:03:58.270 INFO:tasks.workunit.client.1.smithi174.stdout:6/2: dwrite - no filename 2024-05-06T14:03:58.270 INFO:tasks.workunit.client.1.smithi174.stdout:2/17: stat d0 0 2024-05-06T14:03:58.270 INFO:tasks.workunit.client.1.smithi174.stdout:6/3: rename d0 to d0/d1 22 2024-05-06T14:03:58.270 INFO:tasks.workunit.client.1.smithi174.stdout:3/9: creat f4 x:0 0 0 2024-05-06T14:03:58.270 INFO:tasks.workunit.client.1.smithi174.stdout:6/4: write - no filename 2024-05-06T14:03:58.270 INFO:tasks.workunit.client.1.smithi174.stdout:6/5: write - no filename 2024-05-06T14:03:58.271 INFO:tasks.workunit.client.1.smithi174.stdout:6/6: rename d0 to d0/d2 22 2024-05-06T14:03:58.271 INFO:tasks.workunit.client.1.smithi174.stdout:6/7: readlink - no filename 2024-05-06T14:03:58.271 INFO:tasks.workunit.client.1.smithi174.stdout:6/8: readlink - no filename 2024-05-06T14:03:58.271 INFO:tasks.workunit.client.1.smithi174.stdout:6/9: fsync - no filename 2024-05-06T14:03:58.271 INFO:tasks.workunit.client.1.smithi174.stdout:3/10: creat f5 x:0 0 0 2024-05-06T14:03:58.271 INFO:tasks.workunit.client.1.smithi174.stdout:7/0: write - no filename 2024-05-06T14:03:58.271 INFO:tasks.workunit.client.1.smithi174.stdout:3/11: creat f6 x:0 0 0 2024-05-06T14:03:58.271 INFO:tasks.workunit.client.1.smithi174.stdout:3/12: dread - f2 zero size 2024-05-06T14:03:58.271 INFO:tasks.workunit.client.1.smithi174.stdout:7/1: getdents . 0 2024-05-06T14:03:58.272 INFO:tasks.workunit.client.1.smithi174.stdout:6/10: mkdir d0/d3 0 2024-05-06T14:03:58.272 INFO:tasks.workunit.client.1.smithi174.stdout:6/11: dread - no filename 2024-05-06T14:03:58.272 INFO:tasks.workunit.client.1.smithi174.stdout:7/2: readlink - no filename 2024-05-06T14:03:58.272 INFO:tasks.workunit.client.1.smithi174.stdout:3/13: creat f7 x:0 0 0 2024-05-06T14:03:58.272 INFO:tasks.workunit.client.1.smithi174.stdout:7/3: read - no filename 2024-05-06T14:03:58.272 INFO:tasks.workunit.client.1.smithi174.stdout:7/4: dread - no filename 2024-05-06T14:03:58.272 INFO:tasks.workunit.client.1.smithi174.stdout:7/5: truncate - no filename 2024-05-06T14:03:58.272 INFO:tasks.workunit.client.1.smithi174.stdout:7/6: fsync - no filename 2024-05-06T14:03:58.272 INFO:tasks.workunit.client.1.smithi174.stdout:5/5: creat d1/f4 x:0 0 0 2024-05-06T14:03:58.273 INFO:tasks.workunit.client.1.smithi174.stdout:0/26: read d0/d3/f5 [160868,110301] 0 2024-05-06T14:03:58.273 INFO:tasks.workunit.client.1.smithi174.stdout:6/12: mknod d0/c4 0 2024-05-06T14:03:58.273 INFO:tasks.workunit.client.1.smithi174.stdout:0/27: readlink - no filename 2024-05-06T14:03:58.273 INFO:tasks.workunit.client.1.smithi174.stdout:6/13: fsync - no filename 2024-05-06T14:03:58.273 INFO:tasks.workunit.client.1.smithi174.stdout:7/7: mkdir d0 0 2024-05-06T14:03:58.273 INFO:tasks.workunit.client.1.smithi174.stdout:7/8: dread - no filename 2024-05-06T14:03:58.273 INFO:tasks.workunit.client.1.smithi174.stdout:7/9: write - no filename 2024-05-06T14:03:58.273 INFO:tasks.workunit.client.1.smithi174.stdout:6/14: link d0/c4 d0/c5 0 2024-05-06T14:03:58.274 INFO:tasks.workunit.client.1.smithi174.stdout:5/6: rename c0 to d1/c5 0 2024-05-06T14:03:58.274 INFO:tasks.workunit.client.1.smithi174.stdout:8/0: dwrite - no filename 2024-05-06T14:03:58.274 INFO:tasks.workunit.client.1.smithi174.stdout:7/10: creat d0/f1 x:0 0 0 2024-05-06T14:03:58.274 INFO:tasks.workunit.client.1.smithi174.stdout:8/1: creat f0 x:0 0 0 2024-05-06T14:03:58.274 INFO:tasks.workunit.client.1.smithi174.stdout:8/2: chown f0 302 1 2024-05-06T14:03:58.274 INFO:tasks.workunit.client.1.smithi174.stdout:8/3: chown f0 898161 1 2024-05-06T14:03:58.274 INFO:tasks.workunit.client.1.smithi174.stdout:7/11: mknod d0/c2 0 2024-05-06T14:03:58.274 INFO:tasks.workunit.client.1.smithi174.stdout:7/12: readlink - no filename 2024-05-06T14:03:58.275 INFO:tasks.workunit.client.1.smithi174.stdout:8/4: dread - f0 zero size 2024-05-06T14:03:58.275 INFO:tasks.workunit.client.1.smithi174.stdout:8/5: mknod c1 0 2024-05-06T14:03:58.275 INFO:tasks.workunit.client.1.smithi174.stdout:8/6: readlink - no filename 2024-05-06T14:03:58.275 INFO:tasks.workunit.client.1.smithi174.stdout:8/7: chown c1 1 1 2024-05-06T14:03:58.276 INFO:tasks.workunit.client.1.smithi174.stdout:7/13: mkdir d0/d3 0 2024-05-06T14:03:58.276 INFO:tasks.workunit.client.1.smithi174.stdout:6/15: symlink d0/l6 0 2024-05-06T14:03:58.276 INFO:tasks.workunit.client.1.smithi174.stdout:0/28: mkdir d0/d4/d8 0 2024-05-06T14:03:58.277 INFO:tasks.workunit.client.1.smithi174.stdout:6/16: dwrite - no filename 2024-05-06T14:03:58.277 INFO:tasks.workunit.client.1.smithi174.stdout:0/29: chown d0/d3/f5 845746184 1 2024-05-06T14:03:58.277 INFO:tasks.workunit.client.1.smithi174.stdout:6/17: readlink d0/l6 0 2024-05-06T14:03:58.277 INFO:tasks.workunit.client.1.smithi174.stdout:6/18: chown d0 825 1 2024-05-06T14:03:58.277 INFO:tasks.workunit.client.1.smithi174.stdout:6/19: rename d0/d3 to d0/d3/d7 22 2024-05-06T14:03:58.277 INFO:tasks.workunit.client.1.smithi174.stdout:6/20: dwrite - no filename 2024-05-06T14:03:58.277 INFO:tasks.workunit.client.1.smithi174.stdout:1/10: dwrite f1 [479232,57344] 0 2024-05-06T14:03:58.277 INFO:tasks.workunit.client.1.smithi174.stdout:6/21: unlink d0/c4 0 2024-05-06T14:03:58.277 INFO:tasks.workunit.client.1.smithi174.stdout:9/0: dread - no filename 2024-05-06T14:03:58.278 INFO:tasks.workunit.client.1.smithi174.stdout:6/22: dread - no filename 2024-05-06T14:03:58.278 INFO:tasks.workunit.client.1.smithi174.stdout:6/23: dread - no filename 2024-05-06T14:03:58.278 INFO:tasks.workunit.client.1.smithi174.stdout:6/24: dwrite - no filename 2024-05-06T14:03:58.278 INFO:tasks.workunit.client.1.smithi174.stdout:9/1: chown . 11061092 1 2024-05-06T14:03:58.278 INFO:tasks.workunit.client.1.smithi174.stdout:9/2: dread - no filename 2024-05-06T14:03:58.279 INFO:tasks.workunit.client.1.smithi174.stdout:6/25: mknod d0/c8 0 2024-05-06T14:03:58.279 INFO:tasks.workunit.client.1.smithi174.stdout:0/30: mkdir d0/d4/d8/d9 0 2024-05-06T14:03:58.279 INFO:tasks.workunit.client.1.smithi174.stdout:6/26: fdatasync - no filename 2024-05-06T14:03:58.279 INFO:tasks.workunit.client.1.smithi174.stdout:6/27: link d0/l6 d0/l9 0 2024-05-06T14:03:58.279 INFO:tasks.workunit.client.1.smithi174.stdout:6/28: write - no filename 2024-05-06T14:03:58.279 INFO:tasks.workunit.client.1.smithi174.stdout:6/29: dread - no filename 2024-05-06T14:03:58.279 INFO:tasks.workunit.client.1.smithi174.stdout:6/30: dwrite - no filename 2024-05-06T14:03:58.279 INFO:tasks.workunit.client.1.smithi174.stdout:1/11: symlink l6 0 2024-05-06T14:03:58.279 INFO:tasks.workunit.client.1.smithi174.stdout:9/3: symlink l0 0 2024-05-06T14:03:58.280 INFO:tasks.workunit.client.1.smithi174.stdout:7/14: dread - d0/f1 zero size 2024-05-06T14:03:58.280 INFO:tasks.workunit.client.1.smithi174.stdout:0/31: dread d0/d3/f5 [737280,110592] 0 2024-05-06T14:03:58.280 INFO:tasks.workunit.client.1.smithi174.stdout:9/4: chown l0 2866 1 2024-05-06T14:03:58.280 INFO:tasks.workunit.client.1.smithi174.stdout:6/31: unlink d0/c8 0 2024-05-06T14:03:58.280 INFO:tasks.workunit.client.1.smithi174.stdout:9/5: readlink l0 0 2024-05-06T14:03:58.280 INFO:tasks.workunit.client.1.smithi174.stdout:9/6: write - no filename 2024-05-06T14:03:58.280 INFO:tasks.workunit.client.1.smithi174.stdout:9/7: read - no filename 2024-05-06T14:03:58.280 INFO:tasks.workunit.client.1.smithi174.stdout:9/8: fdatasync - no filename 2024-05-06T14:03:58.280 INFO:tasks.workunit.client.1.smithi174.stdout:7/15: chown d0/c2 1386 1 2024-05-06T14:03:58.281 INFO:tasks.workunit.client.1.smithi174.stdout:7/16: rename d0 to d0/d3/d4 22 2024-05-06T14:03:58.281 INFO:tasks.workunit.client.1.smithi174.stdout:9/9: creat f1 x:0 0 0 2024-05-06T14:03:58.281 INFO:tasks.workunit.client.1.smithi174.stdout:7/17: dread - d0/f1 zero size 2024-05-06T14:03:58.281 INFO:tasks.workunit.client.1.smithi174.stdout:9/10: dread - f1 zero size 2024-05-06T14:03:58.281 INFO:tasks.workunit.client.1.smithi174.stdout:6/32: mkdir d0/d3/da 0 2024-05-06T14:03:58.281 INFO:tasks.workunit.client.1.smithi174.stdout:1/12: write f1 [718833,33010] 0 2024-05-06T14:03:58.281 INFO:tasks.workunit.client.1.smithi174.stdout:6/33: write - no filename 2024-05-06T14:03:58.281 INFO:tasks.workunit.client.1.smithi174.stdout:6/34: chown d0/d3/da 124 1 2024-05-06T14:03:58.282 INFO:tasks.workunit.client.1.smithi174.stdout:9/11: creat f2 x:0 0 0 2024-05-06T14:03:58.282 INFO:tasks.workunit.client.1.smithi174.stdout:9/12: truncate f2 542217 0 2024-05-06T14:03:58.282 INFO:tasks.workunit.client.1.smithi174.stdout:9/13: truncate f1 488698 0 2024-05-06T14:03:58.282 INFO:tasks.workunit.client.1.smithi174.stdout:9/14: dread f2 [512000,28672] 0 2024-05-06T14:03:58.303 INFO:tasks.workunit.client.1.smithi174.stdout:8/8: dwrite f0 [200704,77824] 0 2024-05-06T14:03:58.303 INFO:tasks.workunit.client.1.smithi174.stdout:0/32: dwrite d0/d3/f5 [1658880,49152] 0 2024-05-06T14:03:58.303 INFO:tasks.workunit.client.1.smithi174.stdout:0/33: rename d0/d3/f5 to d0/fa 0 2024-05-06T14:03:58.303 INFO:tasks.workunit.client.1.smithi174.stdout:0/34: mkdir d0/d4/d8/db 0 2024-05-06T14:03:58.305 INFO:tasks.workunit.client.1.smithi174.stdout:1/13: dwrite f1 [942080,40960] 0 2024-05-06T14:03:58.305 INFO:tasks.workunit.client.1.smithi174.stdout:5/7: dwrite d1/f4 [131072,36864] 0 2024-05-06T14:03:58.305 INFO:tasks.workunit.client.1.smithi174.stdout:9/15: dwrite f1 [98304,36864] 0 2024-05-06T14:03:58.305 INFO:tasks.workunit.client.1.smithi174.stdout:9/16: stat f2 0 2024-05-06T14:03:58.305 INFO:tasks.workunit.client.1.smithi174.stdout:9/17: creat f3 x:0 0 0 2024-05-06T14:03:58.305 INFO:tasks.workunit.client.1.smithi174.stdout:9/18: symlink l4 0 2024-05-06T14:03:58.305 INFO:tasks.workunit.client.1.smithi174.stdout:9/19: rename l4 to l5 0 2024-05-06T14:03:58.305 INFO:tasks.workunit.client.1.smithi174.stdout:9/20: symlink l6 0 2024-05-06T14:03:58.307 INFO:tasks.workunit.client.1.smithi174.stdout:0/35: dwrite d0/fa [1765376,45056] 0 2024-05-06T14:03:58.309 INFO:tasks.workunit.client.1.smithi174.stdout:5/8: dwrite d1/f3 [208896,4096] 0 2024-05-06T14:03:58.310 INFO:tasks.workunit.client.1.smithi174.stdout:5/9: mkdir d1/d6 0 2024-05-06T14:03:58.310 INFO:tasks.workunit.client.1.smithi174.stdout:5/10: mkdir d1/d6/d7 0 2024-05-06T14:03:58.310 INFO:tasks.workunit.client.1.smithi174.stdout:5/11: creat d1/f8 x:0 0 0 2024-05-06T14:03:58.310 INFO:tasks.workunit.client.1.smithi174.stdout:5/12: write d1/f8 [678240,29007] 0 2024-05-06T14:03:58.312 INFO:tasks.workunit.client.1.smithi174.stdout:9/21: dwrite f3 [966656,16384] 0 2024-05-06T14:03:58.312 INFO:tasks.workunit.client.1.smithi174.stdout:9/22: creat f7 x:0 0 0 2024-05-06T14:03:58.312 INFO:tasks.workunit.client.1.smithi174.stdout:9/23: dread f2 [208896,40960] 0 2024-05-06T14:03:58.312 INFO:tasks.workunit.client.1.smithi174.stdout:0/36: dwrite d0/fa [1781760,28672] 0 2024-05-06T14:03:58.312 INFO:tasks.workunit.client.1.smithi174.stdout:0/37: dread d0/fa [192512,81920] 0 2024-05-06T14:03:58.313 INFO:tasks.workunit.client.1.smithi174.stdout:9/24: symlink l8 0 2024-05-06T14:03:58.313 INFO:tasks.workunit.client.1.smithi174.stdout:0/38: mkdir d0/d3/dc 0 2024-05-06T14:03:58.313 INFO:tasks.workunit.client.1.smithi174.stdout:0/39: chown d0/d3 975347722 1 2024-05-06T14:03:58.313 INFO:tasks.workunit.client.1.smithi174.stdout:0/40: stat d0 0 2024-05-06T14:03:58.313 INFO:tasks.workunit.client.1.smithi174.stdout:0/41: write d0/fa [1467172,98737] 0 2024-05-06T14:03:58.313 INFO:tasks.workunit.client.1.smithi174.stdout:0/42: getdents d0/d3/dc 0 2024-05-06T14:03:58.313 INFO:tasks.workunit.client.1.smithi174.stdout:0/43: write d0/fa [2069441,15167] 0 2024-05-06T14:03:58.313 INFO:tasks.workunit.client.1.smithi174.stdout:0/44: mknod d0/d4/d8/cd 0 2024-05-06T14:03:58.313 INFO:tasks.workunit.client.1.smithi174.stdout:0/45: read d0/fa [1814766,34742] 0 2024-05-06T14:03:58.314 INFO:tasks.workunit.client.1.smithi174.stdout:0/46: write d0/fa [1147891,6529] 0 2024-05-06T14:03:58.316 INFO:tasks.workunit.client.1.smithi174.stdout:9/25: dwrite f3 [1314816,81920] 0 2024-05-06T14:03:58.317 INFO:tasks.workunit.client.1.smithi174.stdout:9/26: write f3 [1422842,98381] 0 2024-05-06T14:03:58.317 INFO:tasks.workunit.client.1.smithi174.stdout:9/27: symlink l9 0 2024-05-06T14:03:58.317 INFO:tasks.workunit.client.1.smithi174.stdout:1/14: truncate f1 520113 0 2024-05-06T14:03:58.317 INFO:tasks.workunit.client.1.smithi174.stdout:0/47: dwrite d0/fa [2011136,28672] 0 2024-05-06T14:03:58.322 INFO:tasks.workunit.client.1.smithi174.stdout:9/28: dwrite f3 [1155072,118784] 0 2024-05-06T14:03:58.323 INFO:tasks.workunit.client.1.smithi174.stdout:9/29: dread f1 [122880,20480] 0 2024-05-06T14:03:58.323 INFO:tasks.workunit.client.1.smithi174.stdout:9/30: write f2 [1089823,97701] 0 2024-05-06T14:03:58.323 INFO:tasks.workunit.client.1.smithi174.stdout:9/31: creat fa x:0 0 0 2024-05-06T14:03:58.627 INFO:tasks.workunit.client.1.smithi174.stdout:3/14: fsync f2 0 2024-05-06T14:03:58.627 INFO:tasks.workunit.client.1.smithi174.stdout:3/15: rmdir - no directory 2024-05-06T14:03:58.627 INFO:tasks.workunit.client.1.smithi174.stdout:3/16: stat l1 0 2024-05-06T14:03:58.713 INFO:tasks.workunit.client.1.smithi174.stdout:3/17: fdatasync f7 0 2024-05-06T14:03:58.741 INFO:tasks.workunit.client.1.smithi174.stdout:3/18: write f7 [941354,87391] 0 2024-05-06T14:03:58.828 INFO:tasks.workunit.client.1.smithi174.stdout:3/19: fsync f0 0 2024-05-06T14:03:58.828 INFO:tasks.workunit.client.1.smithi174.stdout:3/20: mknod c8 0 2024-05-06T14:03:58.828 INFO:tasks.workunit.client.1.smithi174.stdout:3/21: dread - f2 zero size 2024-05-06T14:03:58.828 INFO:tasks.workunit.client.1.smithi174.stdout:3/22: unlink c8 0 2024-05-06T14:03:58.829 INFO:tasks.workunit.client.1.smithi174.stdout:3/23: dread f7 [753664,86016] 0 2024-05-06T14:03:58.829 INFO:tasks.workunit.client.1.smithi174.stdout:3/24: link f5 f9 0 2024-05-06T14:03:58.842 INFO:tasks.workunit.client.1.smithi174.stdout:3/25: dwrite f2 [856064,20480] 0 2024-05-06T14:03:58.842 INFO:tasks.workunit.client.1.smithi174.stdout:3/26: chown f4 54074106 1 2024-05-06T14:03:58.842 INFO:tasks.workunit.client.1.smithi174.stdout:3/27: write f6 [835650,58040] 0 2024-05-06T14:03:58.843 INFO:tasks.workunit.client.1.smithi174.stdout:3/28: symlink la 0 2024-05-06T14:03:58.843 INFO:tasks.workunit.client.1.smithi174.stdout:3/29: chown f5 16 1 2024-05-06T14:03:58.843 INFO:tasks.workunit.client.1.smithi174.stdout:3/30: write f2 [1088793,115813] 0 2024-05-06T14:03:58.843 INFO:tasks.workunit.client.1.smithi174.stdout:3/31: write f7 [654570,54745] 0 2024-05-06T14:03:58.843 INFO:tasks.workunit.client.1.smithi174.stdout:3/32: rename f6 to fb 0 2024-05-06T14:03:58.843 INFO:tasks.workunit.client.1.smithi174.stdout:3/33: rename f0 to fc 0 2024-05-06T14:03:58.843 INFO:tasks.workunit.client.1.smithi174.stdout:3/34: creat fd x:0 0 0 2024-05-06T14:03:58.843 INFO:tasks.workunit.client.1.smithi174.stdout:3/35: creat fe x:0 0 0 2024-05-06T14:03:58.844 INFO:tasks.workunit.client.1.smithi174.stdout:3/36: write f9 [618257,39335] 0 2024-05-06T14:03:58.938 INFO:tasks.workunit.client.1.smithi174.stdout:8/9: fsync f0 0 2024-05-06T14:03:58.938 INFO:tasks.workunit.client.1.smithi174.stdout:5/13: fdatasync d1/f8 0 2024-05-06T14:03:58.938 INFO:tasks.workunit.client.1.smithi174.stdout:7/18: fdatasync d0/f1 0 2024-05-06T14:03:58.939 INFO:tasks.workunit.client.1.smithi174.stdout:5/14: chown d1/f3 0 1 2024-05-06T14:03:58.941 INFO:tasks.workunit.client.1.smithi174.stdout:8/10: dread f0 [24576,32768] 0 2024-05-06T14:03:58.942 INFO:tasks.workunit.client.1.smithi174.stdout:8/11: truncate f0 550163 0 2024-05-06T14:03:58.942 INFO:tasks.workunit.client.1.smithi174.stdout:7/19: creat d0/f5 x:0 0 0 2024-05-06T14:03:58.942 INFO:tasks.workunit.client.1.smithi174.stdout:5/15: creat d1/d6/f9 x:0 0 0 2024-05-06T14:03:58.942 INFO:tasks.workunit.client.1.smithi174.stdout:3/37: dwrite f4 [737280,28672] 0 2024-05-06T14:03:58.942 INFO:tasks.workunit.client.1.smithi174.stdout:5/16: truncate d1/f4 1146276 0 2024-05-06T14:03:58.942 INFO:tasks.workunit.client.1.smithi174.stdout:8/12: write f0 [796663,40442] 0 2024-05-06T14:03:58.942 INFO:tasks.workunit.client.1.smithi174.stdout:8/13: write f0 [600982,10294] 0 2024-05-06T14:03:58.943 INFO:tasks.workunit.client.1.smithi174.stdout:7/20: write d0/f5 [667492,121531] 0 2024-05-06T14:03:58.943 INFO:tasks.workunit.client.1.smithi174.stdout:7/21: write d0/f1 [317602,32588] 0 2024-05-06T14:03:58.943 INFO:tasks.workunit.client.1.smithi174.stdout:7/22: creat d0/f6 x:0 0 0 2024-05-06T14:03:58.962 INFO:tasks.workunit.client.1.smithi174.stdout:3/38: dwrite fe [917504,16384] 0 2024-05-06T14:03:58.963 INFO:tasks.workunit.client.1.smithi174.stdout:3/39: mkdir df 0 2024-05-06T14:03:58.963 INFO:tasks.workunit.client.1.smithi174.stdout:3/40: dread - fd zero size 2024-05-06T14:03:58.963 INFO:tasks.workunit.client.1.smithi174.stdout:3/41: chown la 271633 1 2024-05-06T14:03:58.963 INFO:tasks.workunit.client.1.smithi174.stdout:5/17: dwrite d1/f8 [868352,73728] 0 2024-05-06T14:03:58.963 INFO:tasks.workunit.client.1.smithi174.stdout:5/18: getdents d1/d6 0 2024-05-06T14:03:58.963 INFO:tasks.workunit.client.1.smithi174.stdout:5/19: mkdir d1/d6/da 0 2024-05-06T14:03:58.966 INFO:tasks.workunit.client.1.smithi174.stdout:8/14: dwrite f0 [356352,118784] 0 2024-05-06T14:03:58.966 INFO:tasks.workunit.client.1.smithi174.stdout:8/15: readlink - no filename 2024-05-06T14:03:58.967 INFO:tasks.workunit.client.1.smithi174.stdout:8/16: symlink l2 0 2024-05-06T14:03:58.971 INFO:tasks.workunit.client.1.smithi174.stdout:7/23: dwrite d0/f1 [139264,4096] 0 2024-05-06T14:03:58.971 INFO:tasks.workunit.client.1.smithi174.stdout:7/24: unlink d0/c2 0 2024-05-06T14:03:58.971 INFO:tasks.workunit.client.1.smithi174.stdout:7/25: write d0/f1 [1031390,119727] 0 2024-05-06T14:03:58.972 INFO:tasks.workunit.client.1.smithi174.stdout:7/26: dread - d0/f6 zero size 2024-05-06T14:03:58.972 INFO:tasks.workunit.client.1.smithi174.stdout:7/27: creat d0/d3/f7 x:0 0 0 2024-05-06T14:03:58.972 INFO:tasks.workunit.client.1.smithi174.stdout:7/28: chown d0 19001869 1 2024-05-06T14:03:58.972 INFO:tasks.workunit.client.1.smithi174.stdout:7/29: link d0/f1 d0/f8 0 2024-05-06T14:03:58.972 INFO:tasks.workunit.client.1.smithi174.stdout:3/42: dwrite f4 [196608,122880] 0 2024-05-06T14:03:58.972 INFO:tasks.workunit.client.1.smithi174.stdout:7/30: read d0/f1 [932763,33752] 0 2024-05-06T14:03:58.972 INFO:tasks.workunit.client.1.smithi174.stdout:3/43: mkdir df/d10 0 2024-05-06T14:03:58.973 INFO:tasks.workunit.client.1.smithi174.stdout:7/31: dread d0/f1 [798720,65536] 0 2024-05-06T14:03:58.973 INFO:tasks.workunit.client.1.smithi174.stdout:3/44: rename la to df/l11 0 2024-05-06T14:03:58.973 INFO:tasks.workunit.client.1.smithi174.stdout:3/45: link f2 df/d10/f12 0 2024-05-06T14:03:58.973 INFO:tasks.workunit.client.1.smithi174.stdout:7/32: mknod d0/d3/c9 0 2024-05-06T14:03:58.973 INFO:tasks.workunit.client.1.smithi174.stdout:7/33: unlink d0/d3/c9 0 2024-05-06T14:03:58.973 INFO:tasks.workunit.client.1.smithi174.stdout:3/46: symlink df/l13 0 2024-05-06T14:03:58.973 INFO:tasks.workunit.client.1.smithi174.stdout:3/47: chown df/l13 210591761 1 2024-05-06T14:03:58.974 INFO:tasks.workunit.client.1.smithi174.stdout:7/34: mkdir d0/da 0 2024-05-06T14:03:58.974 INFO:tasks.workunit.client.1.smithi174.stdout:7/35: rmdir d0 39 2024-05-06T14:03:58.974 INFO:tasks.workunit.client.1.smithi174.stdout:7/36: chown d0/f8 8 1 2024-05-06T14:03:58.974 INFO:tasks.workunit.client.1.smithi174.stdout:7/37: rmdir d0 39 2024-05-06T14:03:58.974 INFO:tasks.workunit.client.1.smithi174.stdout:7/38: dwrite d0/f1 [843776,49152] 0 2024-05-06T14:03:58.974 INFO:tasks.workunit.client.1.smithi174.stdout:7/39: truncate d0/f1 597091 0 2024-05-06T14:03:58.975 INFO:tasks.workunit.client.1.smithi174.stdout:7/40: creat d0/da/fb x:0 0 0 2024-05-06T14:03:58.975 INFO:tasks.workunit.client.1.smithi174.stdout:7/41: dread - d0/da/fb zero size 2024-05-06T14:03:58.975 INFO:tasks.workunit.client.1.smithi174.stdout:7/42: rmdir d0 39 2024-05-06T14:03:58.992 INFO:tasks.workunit.client.1.smithi174.stdout:8/17: dread f0 [237568,102400] 0 2024-05-06T14:03:59.101 INFO:tasks.workunit.client.1.smithi174.stdout:5/20: fsync d1/f3 0 2024-05-06T14:03:59.110 INFO:tasks.workunit.client.1.smithi174.stdout:5/21: getdents d1/d6/d7 0 2024-05-06T14:03:59.110 INFO:tasks.workunit.client.1.smithi174.stdout:5/22: mkdir d1/d6/da/db 0 2024-05-06T14:03:59.110 INFO:tasks.workunit.client.1.smithi174.stdout:5/23: read d1/f4 [18903,11958] 0 2024-05-06T14:03:59.110 INFO:tasks.workunit.client.1.smithi174.stdout:5/24: write d1/d6/f9 [443653,101812] 0 2024-05-06T14:03:59.110 INFO:tasks.workunit.client.1.smithi174.stdout:5/25: readlink - no filename 2024-05-06T14:03:59.110 INFO:tasks.workunit.client.1.smithi174.stdout:5/26: write d1/f8 [567434,25150] 0 2024-05-06T14:03:59.143 INFO:tasks.workunit.client.1.smithi174.stdout:8/18: dread f0 [405504,73728] 0 2024-05-06T14:03:59.166 INFO:tasks.workunit.client.1.smithi174.stdout:8/19: dwrite f0 [438272,122880] 0 2024-05-06T14:03:59.256 INFO:tasks.workunit.client.1.smithi174.stdout:8/20: dwrite f0 [503808,81920] 0 2024-05-06T14:03:59.256 INFO:tasks.workunit.client.1.smithi174.stdout:8/21: stat l2 0 2024-05-06T14:03:59.256 INFO:tasks.workunit.client.1.smithi174.stdout:8/22: rmdir - no directory 2024-05-06T14:03:59.256 INFO:tasks.workunit.client.1.smithi174.stdout:8/23: creat f3 x:0 0 0 2024-05-06T14:03:59.257 INFO:tasks.workunit.client.1.smithi174.stdout:8/24: write f0 [1802458,105529] 0 2024-05-06T14:03:59.292 INFO:tasks.workunit.client.1.smithi174.stdout:7/43: fdatasync d0/f6 0 2024-05-06T14:03:59.292 INFO:tasks.workunit.client.1.smithi174.stdout:3/48: fdatasync f4 0 2024-05-06T14:03:59.292 INFO:tasks.workunit.client.1.smithi174.stdout:8/25: dwrite f0 [1376256,32768] 0 2024-05-06T14:03:59.292 INFO:tasks.workunit.client.1.smithi174.stdout:8/26: write f3 [984156,24278] 0 2024-05-06T14:03:59.297 INFO:tasks.workunit.client.1.smithi174.stdout:7/44: dwrite d0/f5 [1789952,16384] 0 2024-05-06T14:03:59.297 INFO:tasks.workunit.client.1.smithi174.stdout:7/45: symlink d0/d3/lc 0 2024-05-06T14:03:59.297 INFO:tasks.workunit.client.1.smithi174.stdout:8/27: dwrite f0 [2060288,110592] 0 2024-05-06T14:03:59.297 INFO:tasks.workunit.client.1.smithi174.stdout:8/28: chown c1 362429 1 2024-05-06T14:03:59.376 INFO:tasks.workunit.client.1.smithi174.stdout:3/49: fsync fd 0 2024-05-06T14:03:59.377 INFO:tasks.workunit.client.1.smithi174.stdout:3/50: creat df/d10/f14 x:0 0 0 2024-05-06T14:03:59.377 INFO:tasks.workunit.client.1.smithi174.stdout:3/51: rmdir df 39 2024-05-06T14:03:59.377 INFO:tasks.workunit.client.1.smithi174.stdout:3/52: symlink df/d10/l15 0 2024-05-06T14:03:59.377 INFO:tasks.workunit.client.1.smithi174.stdout:3/53: creat df/d10/f16 x:0 0 0 2024-05-06T14:03:59.377 INFO:tasks.workunit.client.1.smithi174.stdout:3/54: stat df/d10/f14 0 2024-05-06T14:03:59.377 INFO:tasks.workunit.client.1.smithi174.stdout:3/55: write df/d10/f16 [417560,66512] 0 2024-05-06T14:03:59.380 INFO:tasks.workunit.client.1.smithi174.stdout:8/29: dwrite f3 [1843200,24576] 0 2024-05-06T14:03:59.380 INFO:tasks.workunit.client.1.smithi174.stdout:8/30: dread f3 [425984,61440] 0 2024-05-06T14:03:59.380 INFO:tasks.workunit.client.1.smithi174.stdout:8/31: mkdir d4 0 2024-05-06T14:03:59.381 INFO:tasks.workunit.client.1.smithi174.stdout:8/32: unlink l2 0 2024-05-06T14:03:59.381 INFO:tasks.workunit.client.1.smithi174.stdout:8/33: mknod d4/c5 0 2024-05-06T14:03:59.381 INFO:tasks.workunit.client.1.smithi174.stdout:8/34: link c1 d4/c6 0 2024-05-06T14:03:59.381 INFO:tasks.workunit.client.1.smithi174.stdout:8/35: symlink d4/l7 0 2024-05-06T14:03:59.381 INFO:tasks.workunit.client.1.smithi174.stdout:8/36: truncate f0 1458646 0 2024-05-06T14:03:59.381 INFO:tasks.workunit.client.1.smithi174.stdout:8/37: chown f3 5 1 2024-05-06T14:03:59.381 INFO:tasks.workunit.client.1.smithi174.stdout:8/38: mknod d4/c8 0 2024-05-06T14:03:59.381 INFO:tasks.workunit.client.1.smithi174.stdout:8/39: rename d4/l7 to d4/l9 0 2024-05-06T14:03:59.381 INFO:tasks.workunit.client.1.smithi174.stdout:8/40: write f0 [2500835,71252] 0 2024-05-06T14:03:59.382 INFO:tasks.workunit.client.1.smithi174.stdout:8/41: rename d4/l9 to d4/la 0 2024-05-06T14:03:59.382 INFO:tasks.workunit.client.1.smithi174.stdout:8/42: dread f3 [1155072,86016] 0 2024-05-06T14:03:59.382 INFO:tasks.workunit.client.1.smithi174.stdout:8/43: write f0 [2994021,36433] 0 2024-05-06T14:03:59.395 INFO:tasks.workunit.client.1.smithi174.stdout:8/44: dwrite f3 [2043904,8192] 0 2024-05-06T14:03:59.395 INFO:tasks.workunit.client.1.smithi174.stdout:8/45: creat d4/fb x:0 0 0 2024-05-06T14:03:59.395 INFO:tasks.workunit.client.1.smithi174.stdout:8/46: mknod d4/cc 0 2024-05-06T14:03:59.399 INFO:tasks.workunit.client.1.smithi174.stdout:3/56: dwrite fc [94208,106496] 0 2024-05-06T14:03:59.402 INFO:tasks.workunit.client.1.smithi174.stdout:3/57: dwrite df/d10/f14 [970752,94208] 0 2024-05-06T14:03:59.402 INFO:tasks.workunit.client.1.smithi174.stdout:3/58: rename fb to df/f17 0 2024-05-06T14:03:59.402 INFO:tasks.workunit.client.1.smithi174.stdout:3/59: creat df/f18 x:0 0 0 2024-05-06T14:03:59.766 INFO:tasks.workunit.client.1.smithi174.stdout:8/47: fsync f0 0 2024-05-06T14:03:59.766 INFO:tasks.workunit.client.1.smithi174.stdout:8/48: rename d4/la to d4/ld 0 2024-05-06T14:03:59.766 INFO:tasks.workunit.client.1.smithi174.stdout:8/49: unlink f0 0 2024-05-06T14:03:59.766 INFO:tasks.workunit.client.1.smithi174.stdout:8/50: mkdir d4/de 0 2024-05-06T14:03:59.767 INFO:tasks.workunit.client.1.smithi174.stdout:8/51: write d4/fb [977870,61081] 0 2024-05-06T14:03:59.767 INFO:tasks.workunit.client.1.smithi174.stdout:8/52: creat d4/ff x:0 0 0 2024-05-06T14:03:59.767 INFO:tasks.workunit.client.1.smithi174.stdout:8/53: rename d4/c6 to d4/c10 0 2024-05-06T14:03:59.767 INFO:tasks.workunit.client.1.smithi174.stdout:8/54: dread - d4/ff zero size 2024-05-06T14:03:59.767 INFO:tasks.workunit.client.1.smithi174.stdout:8/55: unlink c1 0 2024-05-06T14:03:59.767 INFO:tasks.workunit.client.1.smithi174.stdout:8/56: unlink d4/c8 0 2024-05-06T14:03:59.767 INFO:tasks.workunit.client.1.smithi174.stdout:8/57: readlink d4/ld 0 2024-05-06T14:03:59.767 INFO:tasks.workunit.client.1.smithi174.stdout:8/58: write d4/fb [223888,63195] 0 2024-05-06T14:03:59.773 INFO:tasks.workunit.client.1.smithi174.stdout:8/59: dwrite d4/ff [1036288,53248] 0 2024-05-06T14:03:59.847 INFO:tasks.workunit.client.1.smithi174.stdout:8/60: dwrite d4/fb [1015808,81920] 0 2024-05-06T14:03:59.847 INFO:tasks.workunit.client.1.smithi174.stdout:8/61: creat d4/de/f11 x:0 0 0 2024-05-06T14:03:59.847 INFO:tasks.workunit.client.1.smithi174.stdout:8/62: creat d4/de/f12 x:0 0 0 2024-05-06T14:03:59.848 INFO:tasks.workunit.client.1.smithi174.stdout:8/63: write d4/de/f12 [749439,16668] 0 2024-05-06T14:03:59.848 INFO:tasks.workunit.client.1.smithi174.stdout:8/64: creat d4/de/f13 x:0 0 0 2024-05-06T14:03:59.848 INFO:tasks.workunit.client.1.smithi174.stdout:8/65: chown d4/de 22 1 2024-05-06T14:03:59.848 INFO:tasks.workunit.client.1.smithi174.stdout:8/66: mknod d4/de/c14 0 2024-05-06T14:03:59.848 INFO:tasks.workunit.client.1.smithi174.stdout:8/67: chown d4 167919968 1 2024-05-06T14:03:59.848 INFO:tasks.workunit.client.1.smithi174.stdout:8/68: write d4/de/f12 [190819,83251] 0 2024-05-06T14:03:59.848 INFO:tasks.workunit.client.1.smithi174.stdout:8/69: write d4/fb [1995775,86751] 0 2024-05-06T14:03:59.848 INFO:tasks.workunit.client.1.smithi174.stdout:8/70: mkdir d4/d15 0 2024-05-06T14:03:59.849 INFO:tasks.workunit.client.1.smithi174.stdout:8/71: truncate d4/de/f11 920076 0 2024-05-06T14:03:59.849 INFO:tasks.workunit.client.1.smithi174.stdout:8/72: dread d4/de/f11 [638976,8192] 0 2024-05-06T14:03:59.849 INFO:tasks.workunit.client.1.smithi174.stdout:8/73: readlink d4/ld 0 2024-05-06T14:03:59.849 INFO:tasks.workunit.client.1.smithi174.stdout:8/74: creat d4/d15/f16 x:0 0 0 2024-05-06T14:03:59.849 INFO:tasks.workunit.client.1.smithi174.stdout:8/75: creat d4/de/f17 x:0 0 0 2024-05-06T14:03:59.849 INFO:tasks.workunit.client.1.smithi174.stdout:8/76: chown d4/de 60 1 2024-05-06T14:03:59.849 INFO:tasks.workunit.client.1.smithi174.stdout:8/77: getdents d4 0 2024-05-06T14:03:59.850 INFO:tasks.workunit.client.1.smithi174.stdout:8/78: dread - d4/d15/f16 zero size 2024-05-06T14:03:59.850 INFO:tasks.workunit.client.1.smithi174.stdout:8/79: symlink d4/d15/l18 0 2024-05-06T14:03:59.850 INFO:tasks.workunit.client.1.smithi174.stdout:8/80: creat d4/de/f19 x:0 0 0 2024-05-06T14:03:59.851 INFO:tasks.workunit.client.1.smithi174.stdout:8/81: dwrite d4/de/f17 [458752,65536] 0 2024-05-06T14:03:59.852 INFO:tasks.workunit.client.1.smithi174.stdout:8/82: write d4/de/f12 [428670,91141] 0 2024-05-06T14:03:59.852 INFO:tasks.workunit.client.1.smithi174.stdout:8/83: read f3 [655545,83590] 0 2024-05-06T14:03:59.852 INFO:tasks.workunit.client.1.smithi174.stdout:8/84: getdents d4/de 0 2024-05-06T14:04:00.226 INFO:tasks.workunit.client.1.smithi174.stdout:8/85: fsync d4/de/f19 0 2024-05-06T14:04:00.227 INFO:tasks.workunit.client.1.smithi174.stdout:8/86: write d4/de/f13 [1025703,76838] 0 2024-05-06T14:04:00.227 INFO:tasks.workunit.client.1.smithi174.stdout:8/87: truncate d4/de/f17 1145010 0 2024-05-06T14:04:00.227 INFO:tasks.workunit.client.1.smithi174.stdout:8/88: link d4/c5 d4/de/c1a 0 2024-05-06T14:04:00.227 INFO:tasks.workunit.client.1.smithi174.stdout:8/89: symlink d4/l1b 0 2024-05-06T14:04:00.227 INFO:tasks.workunit.client.1.smithi174.stdout:8/90: write d4/d15/f16 [893880,96310] 0 2024-05-06T14:04:00.257 INFO:tasks.workunit.client.1.smithi174.stdout:8/91: dwrite d4/de/f19 [643072,8192] 0 2024-05-06T14:04:00.258 INFO:tasks.workunit.client.1.smithi174.stdout:8/92: chown d4/de/f17 1848 1 2024-05-06T14:04:00.258 INFO:tasks.workunit.client.1.smithi174.stdout:8/93: unlink f3 0 2024-05-06T14:04:00.258 INFO:tasks.workunit.client.1.smithi174.stdout:8/94: write d4/de/f17 [1846756,3461] 0 2024-05-06T14:04:00.258 INFO:tasks.workunit.client.1.smithi174.stdout:8/95: dread d4/de/f11 [466944,106496] 0 2024-05-06T14:04:00.258 INFO:tasks.workunit.client.1.smithi174.stdout:8/96: dwrite d4/d15/f16 [212992,53248] 0 2024-05-06T14:04:00.258 INFO:tasks.workunit.client.1.smithi174.stdout:8/97: symlink d4/l1c 0 2024-05-06T14:04:00.259 INFO:tasks.workunit.client.1.smithi174.stdout:8/98: rmdir d4/de 39 2024-05-06T14:04:00.259 INFO:tasks.workunit.client.1.smithi174.stdout:8/99: link d4/l1c d4/l1d 0 2024-05-06T14:04:00.259 INFO:tasks.workunit.client.1.smithi174.stdout:8/100: write d4/de/f11 [1797461,129708] 0 2024-05-06T14:04:00.259 INFO:tasks.workunit.client.1.smithi174.stdout:8/101: creat d4/d15/f1e x:0 0 0 2024-05-06T14:04:00.259 INFO:tasks.workunit.client.1.smithi174.stdout:8/102: dread d4/ff [630784,16384] 0 2024-05-06T14:04:00.344 INFO:tasks.workunit.client.1.smithi174.stdout:8/103: dread d4/de/f11 [1740800,86016] 0 2024-05-06T14:04:00.345 INFO:tasks.workunit.client.1.smithi174.stdout:8/104: chown d4/d15 231059625 1 2024-05-06T14:04:00.345 INFO:tasks.workunit.client.1.smithi174.stdout:8/105: readlink d4/d15/l18 0 2024-05-06T14:04:00.345 INFO:tasks.workunit.client.1.smithi174.stdout:8/106: write d4/de/f11 [508458,52811] 0 2024-05-06T14:04:00.345 INFO:tasks.workunit.client.1.smithi174.stdout:8/107: rename d4/ff to d4/de/f1f 0 2024-05-06T14:04:00.345 INFO:tasks.workunit.client.1.smithi174.stdout:8/108: dwrite d4/de/f13 [548864,32768] 0 2024-05-06T14:04:00.345 INFO:tasks.workunit.client.1.smithi174.stdout:8/109: mkdir d4/d15/d20 0 2024-05-06T14:04:00.345 INFO:tasks.workunit.client.1.smithi174.stdout:8/110: mknod d4/d15/d20/c21 0 2024-05-06T14:04:00.346 INFO:tasks.workunit.client.1.smithi174.stdout:8/111: dwrite d4/de/f1f [872448,86016] 0 2024-05-06T14:04:00.347 INFO:tasks.workunit.client.1.smithi174.stdout:8/112: symlink d4/de/l22 0 2024-05-06T14:04:00.347 INFO:tasks.workunit.client.1.smithi174.stdout:8/113: mkdir d4/de/d23 0 2024-05-06T14:04:00.347 INFO:tasks.workunit.client.1.smithi174.stdout:8/114: readlink d4/l1d 0 2024-05-06T14:04:00.347 INFO:tasks.workunit.client.1.smithi174.stdout:8/115: dread d4/de/f19 [368640,126976] 0 2024-05-06T14:04:00.347 INFO:tasks.workunit.client.1.smithi174.stdout:8/116: mkdir d4/de/d24 0 2024-05-06T14:04:00.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:00.683+0000 7f71b4865700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3135616195 2024-05-06T14:04:00.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:00.683+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-05-06T14:04:01.648 INFO:tasks.workunit.client.1.smithi174.stdout:4/2: sync 2024-05-06T14:04:01.649 INFO:tasks.workunit.client.1.smithi174.stdout:4/3: stat - no entries 2024-05-06T14:04:01.649 INFO:tasks.workunit.client.1.smithi174.stdout:4/4: getdents . 0 2024-05-06T14:04:01.649 INFO:tasks.workunit.client.1.smithi174.stdout:4/5: fsync - no filename 2024-05-06T14:04:01.649 INFO:tasks.workunit.client.1.smithi174.stdout:4/6: chown . 54 1 2024-05-06T14:04:01.649 INFO:tasks.workunit.client.1.smithi174.stdout:4/7: mknod c0 0 2024-05-06T14:04:01.649 INFO:tasks.workunit.client.1.smithi174.stdout:4/8: mkdir d1 0 2024-05-06T14:04:01.649 INFO:tasks.workunit.client.1.smithi174.stdout:4/9: mknod d1/c2 0 2024-05-06T14:04:01.649 INFO:tasks.workunit.client.1.smithi174.stdout:4/10: read - no filename 2024-05-06T14:04:01.650 INFO:tasks.workunit.client.1.smithi174.stdout:4/11: link c0 d1/c3 0 2024-05-06T14:04:01.650 INFO:tasks.workunit.client.1.smithi174.stdout:4/12: stat d1 0 2024-05-06T14:04:01.650 INFO:tasks.workunit.client.1.smithi174.stdout:4/13: readlink - no filename 2024-05-06T14:04:01.650 INFO:tasks.workunit.client.1.smithi174.stdout:4/14: mknod d1/c4 0 2024-05-06T14:04:01.650 INFO:tasks.workunit.client.1.smithi174.stdout:4/15: creat d1/f5 x:0 0 0 2024-05-06T14:04:01.650 INFO:tasks.workunit.client.1.smithi174.stdout:4/16: chown d1/c2 39638780 1 2024-05-06T14:04:01.650 INFO:tasks.workunit.client.1.smithi174.stdout:4/17: creat d1/f6 x:0 0 0 2024-05-06T14:04:01.650 INFO:tasks.workunit.client.1.smithi174.stdout:4/18: truncate d1/f6 868307 0 2024-05-06T14:04:01.650 INFO:tasks.workunit.client.1.smithi174.stdout:4/19: symlink d1/l7 0 2024-05-06T14:04:01.651 INFO:tasks.workunit.client.1.smithi174.stdout:4/20: symlink d1/l8 0 2024-05-06T14:04:01.726 INFO:tasks.workunit.client.1.smithi174.stdout:4/21: dwrite d1/f6 [53248,28672] 0 2024-05-06T14:04:01.727 INFO:tasks.workunit.client.1.smithi174.stdout:4/22: mkdir d1/d9 0 2024-05-06T14:04:01.728 INFO:tasks.workunit.client.1.smithi174.stdout:6/35: sync 2024-05-06T14:04:01.728 INFO:tasks.workunit.client.1.smithi174.stdout:5/27: sync 2024-05-06T14:04:01.728 INFO:tasks.workunit.client.1.smithi174.stdout:6/36: chown d0/d3/da 0 1 2024-05-06T14:04:01.728 INFO:tasks.workunit.client.1.smithi174.stdout:6/37: chown d0/c5 4 1 2024-05-06T14:04:01.728 INFO:tasks.workunit.client.1.smithi174.stdout:7/46: sync 2024-05-06T14:04:01.729 INFO:tasks.workunit.client.1.smithi174.stdout:7/47: chown d0/f8 798980045 1 2024-05-06T14:04:01.729 INFO:tasks.workunit.client.1.smithi174.stdout:3/60: sync 2024-05-06T14:04:01.729 INFO:tasks.workunit.client.1.smithi174.stdout:2/18: sync 2024-05-06T14:04:01.729 INFO:tasks.workunit.client.1.smithi174.stdout:1/15: sync 2024-05-06T14:04:01.729 INFO:tasks.workunit.client.1.smithi174.stdout:2/19: stat d0/d1/d2/d4 0 2024-05-06T14:04:01.729 INFO:tasks.workunit.client.1.smithi174.stdout:8/117: sync 2024-05-06T14:04:01.729 INFO:tasks.workunit.client.1.smithi174.stdout:2/20: unlink - no file 2024-05-06T14:04:01.729 INFO:tasks.workunit.client.1.smithi174.stdout:9/32: sync 2024-05-06T14:04:01.729 INFO:tasks.workunit.client.1.smithi174.stdout:9/33: rmdir - no directory 2024-05-06T14:04:01.730 INFO:tasks.workunit.client.1.smithi174.stdout:0/48: sync 2024-05-06T14:04:01.730 INFO:tasks.workunit.client.1.smithi174.stdout:9/34: stat f7 0 2024-05-06T14:04:01.730 INFO:tasks.workunit.client.1.smithi174.stdout:1/16: dread f1 [143360,90112] 0 2024-05-06T14:04:01.730 INFO:tasks.workunit.client.1.smithi174.stdout:8/118: creat d4/de/d23/f25 x:0 0 0 2024-05-06T14:04:01.730 INFO:tasks.workunit.client.1.smithi174.stdout:0/49: creat d0/d4/d8/db/fe x:0 0 0 2024-05-06T14:04:01.730 INFO:tasks.workunit.client.1.smithi174.stdout:9/35: rename l5 to lb 0 2024-05-06T14:04:01.730 INFO:tasks.workunit.client.1.smithi174.stdout:8/119: getdents d4/de 0 2024-05-06T14:04:01.730 INFO:tasks.workunit.client.1.smithi174.stdout:2/21: creat d0/d1/f5 x:0 0 0 2024-05-06T14:04:01.730 INFO:tasks.workunit.client.1.smithi174.stdout:0/50: write d0/fa [2819702,75764] 0 2024-05-06T14:04:01.765 INFO:tasks.workunit.client.1.smithi174.stdout:5/28: fdatasync d1/f4 0 2024-05-06T14:04:01.765 INFO:tasks.workunit.client.1.smithi174.stdout:5/29: getdents d1/d6/d7 0 2024-05-06T14:04:01.768 INFO:tasks.workunit.client.1.smithi174.stdout:2/22: dwrite d0/d1/f5 [114688,65536] 0 2024-05-06T14:04:01.768 INFO:tasks.workunit.client.1.smithi174.stdout:2/23: dread d0/d1/f5 [61440,4096] 0 2024-05-06T14:04:01.768 INFO:tasks.workunit.client.1.smithi174.stdout:3/61: dwrite df/f17 [487424,8192] 0 2024-05-06T14:04:01.774 INFO:tasks.workunit.client.1.smithi174.stdout:6/38: mknod d0/cb 0 2024-05-06T14:04:01.774 INFO:tasks.workunit.client.1.smithi174.stdout:6/39: write - no filename 2024-05-06T14:04:01.774 INFO:tasks.workunit.client.1.smithi174.stdout:3/62: creat df/d10/f19 x:0 0 0 2024-05-06T14:04:01.774 INFO:tasks.workunit.client.1.smithi174.stdout:7/48: creat d0/d3/fd x:0 0 0 2024-05-06T14:04:01.775 INFO:tasks.workunit.client.1.smithi174.stdout:1/17: symlink l7 0 2024-05-06T14:04:01.775 INFO:tasks.workunit.client.1.smithi174.stdout:7/49: read - d0/d3/fd zero size 2024-05-06T14:04:01.775 INFO:tasks.workunit.client.1.smithi174.stdout:0/51: creat d0/d4/d8/db/ff x:0 0 0 2024-05-06T14:04:01.775 INFO:tasks.workunit.client.1.smithi174.stdout:1/18: chown f1 31249 1 2024-05-06T14:04:01.775 INFO:tasks.workunit.client.1.smithi174.stdout:3/63: creat df/d10/f1a x:0 0 0 2024-05-06T14:04:01.775 INFO:tasks.workunit.client.1.smithi174.stdout:6/40: mkdir d0/dc 0 2024-05-06T14:04:01.775 INFO:tasks.workunit.client.1.smithi174.stdout:6/41: dread - no filename 2024-05-06T14:04:01.775 INFO:tasks.workunit.client.1.smithi174.stdout:7/50: link d0/d3/f7 d0/fe 0 2024-05-06T14:04:01.775 INFO:tasks.workunit.client.1.smithi174.stdout:1/19: mknod c8 0 2024-05-06T14:04:01.776 INFO:tasks.workunit.client.1.smithi174.stdout:6/42: unlink d0/c5 0 2024-05-06T14:04:01.776 INFO:tasks.workunit.client.1.smithi174.stdout:6/43: write - no filename 2024-05-06T14:04:01.776 INFO:tasks.workunit.client.1.smithi174.stdout:6/44: rename d0 to d0/d3/da/dd 22 2024-05-06T14:04:01.776 INFO:tasks.workunit.client.1.smithi174.stdout:6/45: dwrite - no filename 2024-05-06T14:04:01.776 INFO:tasks.workunit.client.1.smithi174.stdout:6/46: dread - no filename 2024-05-06T14:04:01.776 INFO:tasks.workunit.client.1.smithi174.stdout:6/47: dwrite - no filename 2024-05-06T14:04:01.776 INFO:tasks.workunit.client.1.smithi174.stdout:3/64: dread df/d10/f12 [512000,110592] 0 2024-05-06T14:04:01.776 INFO:tasks.workunit.client.1.smithi174.stdout:6/48: chown d0/cb 246 1 2024-05-06T14:04:01.777 INFO:tasks.workunit.client.1.smithi174.stdout:6/49: fsync - no filename 2024-05-06T14:04:01.777 INFO:tasks.workunit.client.1.smithi174.stdout:1/20: mknod c9 0 2024-05-06T14:04:01.777 INFO:tasks.workunit.client.1.smithi174.stdout:6/50: link d0/l9 d0/le 0 2024-05-06T14:04:01.777 INFO:tasks.workunit.client.1.smithi174.stdout:6/51: dread - no filename 2024-05-06T14:04:01.777 INFO:tasks.workunit.client.1.smithi174.stdout:6/52: chown d0/le 1504954107 1 2024-05-06T14:04:01.777 INFO:tasks.workunit.client.1.smithi174.stdout:6/53: rmdir d0/d3/da 0 2024-05-06T14:04:01.777 INFO:tasks.workunit.client.1.smithi174.stdout:6/54: rmdir d0/dc 0 2024-05-06T14:04:01.777 INFO:tasks.workunit.client.1.smithi174.stdout:6/55: fdatasync - no filename 2024-05-06T14:04:01.778 INFO:tasks.workunit.client.1.smithi174.stdout:6/56: chown d0/cb 480 1 2024-05-06T14:04:01.778 INFO:tasks.workunit.client.1.smithi174.stdout:6/57: dwrite - no filename 2024-05-06T14:04:01.778 INFO:tasks.workunit.client.1.smithi174.stdout:6/58: unlink d0/l6 0 2024-05-06T14:04:01.778 INFO:tasks.workunit.client.1.smithi174.stdout:6/59: readlink d0/le 0 2024-05-06T14:04:01.778 INFO:tasks.workunit.client.1.smithi174.stdout:6/60: fdatasync - no filename 2024-05-06T14:04:01.778 INFO:tasks.workunit.client.1.smithi174.stdout:6/61: rename d0/d3 to d0/df 0 2024-05-06T14:04:01.778 INFO:tasks.workunit.client.1.smithi174.stdout:6/62: dwrite - no filename 2024-05-06T14:04:01.778 INFO:tasks.workunit.client.1.smithi174.stdout:6/63: chown d0/l9 251 1 2024-05-06T14:04:01.779 INFO:tasks.workunit.client.1.smithi174.stdout:6/64: fdatasync - no filename 2024-05-06T14:04:01.779 INFO:tasks.workunit.client.1.smithi174.stdout:6/65: fsync - no filename 2024-05-06T14:04:01.779 INFO:tasks.workunit.client.1.smithi174.stdout:1/21: write f5 [487683,88011] 0 2024-05-06T14:04:01.779 INFO:tasks.workunit.client.1.smithi174.stdout:7/51: write d0/d3/fd [766255,113913] 0 2024-05-06T14:04:01.779 INFO:tasks.workunit.client.1.smithi174.stdout:6/66: symlink d0/df/l10 0 2024-05-06T14:04:01.779 INFO:tasks.workunit.client.1.smithi174.stdout:6/67: chown d0/l9 3198185 1 2024-05-06T14:04:01.779 INFO:tasks.workunit.client.1.smithi174.stdout:6/68: fdatasync - no filename 2024-05-06T14:04:01.779 INFO:tasks.workunit.client.1.smithi174.stdout:1/22: symlink la 0 2024-05-06T14:04:01.779 INFO:tasks.workunit.client.1.smithi174.stdout:7/52: dread - d0/f6 zero size 2024-05-06T14:04:01.780 INFO:tasks.workunit.client.1.smithi174.stdout:6/69: symlink d0/l11 0 2024-05-06T14:04:01.780 INFO:tasks.workunit.client.1.smithi174.stdout:6/70: rename d0 to d0/df/d12 22 2024-05-06T14:04:01.780 INFO:tasks.workunit.client.1.smithi174.stdout:6/71: dwrite - no filename 2024-05-06T14:04:01.780 INFO:tasks.workunit.client.1.smithi174.stdout:6/72: link d0/l9 d0/df/l13 0 2024-05-06T14:04:01.780 INFO:tasks.workunit.client.1.smithi174.stdout:6/73: dread - no filename 2024-05-06T14:04:01.780 INFO:tasks.workunit.client.1.smithi174.stdout:6/74: chown d0/df/l10 70130 1 2024-05-06T14:04:01.780 INFO:tasks.workunit.client.1.smithi174.stdout:6/75: stat d0/le 0 2024-05-06T14:04:01.780 INFO:tasks.workunit.client.1.smithi174.stdout:6/76: readlink d0/l9 0 2024-05-06T14:04:01.780 INFO:tasks.workunit.client.1.smithi174.stdout:6/77: stat d0/df/l10 0 2024-05-06T14:04:01.781 INFO:tasks.workunit.client.1.smithi174.stdout:6/78: creat d0/df/f14 x:0 0 0 2024-05-06T14:04:01.781 INFO:tasks.workunit.client.1.smithi174.stdout:6/79: creat d0/f15 x:0 0 0 2024-05-06T14:04:01.781 INFO:tasks.workunit.client.1.smithi174.stdout:6/80: creat d0/f16 x:0 0 0 2024-05-06T14:04:01.812 INFO:tasks.workunit.client.1.smithi174.stdout:5/30: fdatasync d1/f4 0 2024-05-06T14:04:01.812 INFO:tasks.workunit.client.1.smithi174.stdout:5/31: link d1/f8 d1/d6/fc 0 2024-05-06T14:04:01.812 INFO:tasks.workunit.client.1.smithi174.stdout:4/23: fsync d1/f5 0 2024-05-06T14:04:01.815 INFO:tasks.workunit.client.1.smithi174.stdout:7/53: dwrite d0/d3/f7 [389120,94208] 0 2024-05-06T14:04:01.815 INFO:tasks.workunit.client.1.smithi174.stdout:3/65: dwrite fc [1204224,45056] 0 2024-05-06T14:04:01.816 INFO:tasks.workunit.client.1.smithi174.stdout:4/24: creat d1/d9/fa x:0 0 0 2024-05-06T14:04:01.816 INFO:tasks.workunit.client.1.smithi174.stdout:0/52: dwrite d0/fa [2371584,28672] 0 2024-05-06T14:04:01.816 INFO:tasks.workunit.client.1.smithi174.stdout:3/66: chown df/l13 16293 1 2024-05-06T14:04:01.816 INFO:tasks.workunit.client.1.smithi174.stdout:4/25: rename d1 to d1/d9/db 22 2024-05-06T14:04:01.816 INFO:tasks.workunit.client.1.smithi174.stdout:0/53: chown d0 319 1 2024-05-06T14:04:01.816 INFO:tasks.workunit.client.1.smithi174.stdout:4/26: dread d1/f6 [765952,61440] 0 2024-05-06T14:04:01.816 INFO:tasks.workunit.client.1.smithi174.stdout:3/67: mkdir df/d10/d1b 0 2024-05-06T14:04:01.816 INFO:tasks.workunit.client.1.smithi174.stdout:3/68: creat df/d10/f1c x:0 0 0 2024-05-06T14:04:01.817 INFO:tasks.workunit.client.1.smithi174.stdout:3/69: creat df/d10/f1d x:0 0 0 2024-05-06T14:04:01.817 INFO:tasks.workunit.client.1.smithi174.stdout:3/70: write df/d10/f1a [821053,29229] 0 2024-05-06T14:04:01.817 INFO:tasks.workunit.client.1.smithi174.stdout:3/71: symlink df/l1e 0 2024-05-06T14:04:01.818 INFO:tasks.workunit.client.1.smithi174.stdout:5/32: write d1/d6/fc [843413,49003] 0 2024-05-06T14:04:01.818 INFO:tasks.workunit.client.1.smithi174.stdout:5/33: stat d1/d6/da 0 2024-05-06T14:04:01.818 INFO:tasks.workunit.client.1.smithi174.stdout:5/34: link d1/d6/fc d1/d6/da/fd 0 2024-05-06T14:04:01.818 INFO:tasks.workunit.client.1.smithi174.stdout:5/35: chown d1/f8 22361843 1 2024-05-06T14:04:01.818 INFO:tasks.workunit.client.1.smithi174.stdout:5/36: truncate d1/f8 1412406 0 2024-05-06T14:04:01.818 INFO:tasks.workunit.client.1.smithi174.stdout:5/37: mkdir d1/d6/da/de 0 2024-05-06T14:04:01.859 INFO:tasks.workunit.client.1.smithi174.stdout:3/72: dwrite df/d10/f1c [479232,73728] 0 2024-05-06T14:04:01.859 INFO:tasks.workunit.client.1.smithi174.stdout:3/73: write df/d10/f1c [381117,32143] 0 2024-05-06T14:04:01.860 INFO:tasks.workunit.client.1.smithi174.stdout:3/74: dread - df/f18 zero size 2024-05-06T14:04:01.860 INFO:tasks.workunit.client.1.smithi174.stdout:3/75: creat df/f1f x:0 0 0 2024-05-06T14:04:01.860 INFO:tasks.workunit.client.1.smithi174.stdout:4/27: dwrite d1/f5 [466944,16384] 0 2024-05-06T14:04:01.860 INFO:tasks.workunit.client.1.smithi174.stdout:5/38: truncate d1/f8 420952 0 2024-05-06T14:04:01.860 INFO:tasks.workunit.client.1.smithi174.stdout:3/76: creat df/d10/d1b/f20 x:0 0 0 2024-05-06T14:04:01.861 INFO:tasks.workunit.client.1.smithi174.stdout:3/77: chown f7 0 1 2024-05-06T14:04:01.861 INFO:tasks.workunit.client.1.smithi174.stdout:3/78: mknod df/c21 0 2024-05-06T14:04:01.861 INFO:tasks.workunit.client.1.smithi174.stdout:4/28: rename d1/d9/fa to d1/fc 0 2024-05-06T14:04:01.861 INFO:tasks.workunit.client.1.smithi174.stdout:5/39: write d1/d6/fc [311544,60731] 0 2024-05-06T14:04:01.861 INFO:tasks.workunit.client.1.smithi174.stdout:4/29: dread d1/f5 [73728,98304] 0 2024-05-06T14:04:01.861 INFO:tasks.workunit.client.1.smithi174.stdout:5/40: write d1/d6/fc [1123997,21745] 0 2024-05-06T14:04:01.861 INFO:tasks.workunit.client.1.smithi174.stdout:5/41: mkdir d1/d6/df 0 2024-05-06T14:04:01.861 INFO:tasks.workunit.client.1.smithi174.stdout:5/42: link d1/d6/fc d1/f10 0 2024-05-06T14:04:01.862 INFO:tasks.workunit.client.1.smithi174.stdout:5/43: unlink d1/f4 0 2024-05-06T14:04:01.862 INFO:tasks.workunit.client.1.smithi174.stdout:4/30: write d1/f6 [1095152,121386] 0 2024-05-06T14:04:01.862 INFO:tasks.workunit.client.1.smithi174.stdout:5/44: dread d1/f10 [835584,126976] 0 2024-05-06T14:04:01.862 INFO:tasks.workunit.client.1.smithi174.stdout:5/45: unlink d1/f3 0 2024-05-06T14:04:01.862 INFO:tasks.workunit.client.1.smithi174.stdout:5/46: symlink d1/d6/da/db/l11 0 2024-05-06T14:04:01.886 INFO:tasks.workunit.client.1.smithi174.stdout:2/24: fdatasync d0/d1/f5 0 2024-05-06T14:04:01.887 INFO:tasks.workunit.client.1.smithi174.stdout:1/23: fsync f1 0 2024-05-06T14:04:01.897 INFO:tasks.workunit.client.1.smithi174.stdout:3/79: fdatasync df/f17 0 2024-05-06T14:04:01.899 INFO:tasks.workunit.client.1.smithi174.stdout:3/80: rename df/d10/f1d to df/d10/d1b/f22 0 2024-05-06T14:04:01.899 INFO:tasks.workunit.client.1.smithi174.stdout:4/31: dwrite d1/f5 [172032,4096] 0 2024-05-06T14:04:01.899 INFO:tasks.workunit.client.1.smithi174.stdout:5/47: dwrite d1/f8 [794624,4096] 0 2024-05-06T14:04:01.900 INFO:tasks.workunit.client.1.smithi174.stdout:5/48: chown d1/d6/d7 38075860 1 2024-05-06T14:04:01.900 INFO:tasks.workunit.client.1.smithi174.stdout:3/81: symlink df/d10/l23 0 2024-05-06T14:04:01.900 INFO:tasks.workunit.client.1.smithi174.stdout:3/82: write f5 [348957,22068] 0 2024-05-06T14:04:01.900 INFO:tasks.workunit.client.1.smithi174.stdout:5/49: symlink d1/d6/df/l12 0 2024-05-06T14:04:01.900 INFO:tasks.workunit.client.1.smithi174.stdout:5/50: rename d1/f8 to d1/d6/f13 0 2024-05-06T14:04:01.900 INFO:tasks.workunit.client.1.smithi174.stdout:5/51: rmdir d1/d6/da 39 2024-05-06T14:04:01.900 INFO:tasks.workunit.client.1.smithi174.stdout:5/52: mknod d1/d6/c14 0 2024-05-06T14:04:01.900 INFO:tasks.workunit.client.1.smithi174.stdout:5/53: mknod d1/d6/da/db/c15 0 2024-05-06T14:04:01.900 INFO:tasks.workunit.client.1.smithi174.stdout:5/54: creat d1/d6/da/db/f16 x:0 0 0 2024-05-06T14:04:01.901 INFO:tasks.workunit.client.1.smithi174.stdout:3/83: write df/f17 [897637,98542] 0 2024-05-06T14:04:01.901 INFO:tasks.workunit.client.1.smithi174.stdout:5/55: truncate d1/d6/da/db/f16 510722 0 2024-05-06T14:04:01.901 INFO:tasks.workunit.client.1.smithi174.stdout:3/84: creat df/d10/d1b/f24 x:0 0 0 2024-05-06T14:04:01.901 INFO:tasks.workunit.client.1.smithi174.stdout:5/56: link d1/d6/da/db/f16 d1/d6/da/f17 0 2024-05-06T14:04:01.901 INFO:tasks.workunit.client.1.smithi174.stdout:5/57: creat d1/d6/f18 x:0 0 0 2024-05-06T14:04:01.901 INFO:tasks.workunit.client.1.smithi174.stdout:5/58: symlink d1/l19 0 2024-05-06T14:04:01.902 INFO:tasks.workunit.client.1.smithi174.stdout:1/24: creat fb x:0 0 0 2024-05-06T14:04:01.902 INFO:tasks.workunit.client.1.smithi174.stdout:1/25: creat fc x:0 0 0 2024-05-06T14:04:01.902 INFO:tasks.workunit.client.1.smithi174.stdout:1/26: symlink ld 0 2024-05-06T14:04:01.902 INFO:tasks.workunit.client.1.smithi174.stdout:1/27: creat fe x:0 0 0 2024-05-06T14:04:01.903 INFO:tasks.workunit.client.1.smithi174.stdout:1/28: symlink lf 0 2024-05-06T14:04:01.903 INFO:tasks.workunit.client.1.smithi174.stdout:1/29: mknod c10 0 2024-05-06T14:04:01.903 INFO:tasks.workunit.client.1.smithi174.stdout:8/120: sync 2024-05-06T14:04:01.904 INFO:tasks.workunit.client.1.smithi174.stdout:9/36: sync 2024-05-06T14:04:01.904 INFO:tasks.workunit.client.1.smithi174.stdout:8/121: stat d4/de/f1f 0 2024-05-06T14:04:01.904 INFO:tasks.workunit.client.1.smithi174.stdout:9/37: rmdir - no directory 2024-05-06T14:04:01.904 INFO:tasks.workunit.client.1.smithi174.stdout:9/38: dread - fa zero size 2024-05-06T14:04:01.904 INFO:tasks.workunit.client.1.smithi174.stdout:9/39: readlink l0 0 2024-05-06T14:04:01.904 INFO:tasks.workunit.client.1.smithi174.stdout:2/25: dwrite d0/d1/f5 [53248,12288] 0 2024-05-06T14:04:01.904 INFO:tasks.workunit.client.1.smithi174.stdout:8/122: write d4/de/d23/f25 [233764,75484] 0 2024-05-06T14:04:01.938 INFO:tasks.workunit.client.1.smithi174.stdout:2/26: dwrite d0/d1/f5 [532480,61440] 0 2024-05-06T14:04:01.938 INFO:tasks.workunit.client.1.smithi174.stdout:2/27: chown d0/d1 974547 1 2024-05-06T14:04:01.938 INFO:tasks.workunit.client.1.smithi174.stdout:2/28: chown d0/d1/d2/d4 3 1 2024-05-06T14:04:01.938 INFO:tasks.workunit.client.1.smithi174.stdout:2/29: dread d0/d1/f5 [217088,16384] 0 2024-05-06T14:04:01.939 INFO:tasks.workunit.client.1.smithi174.stdout:2/30: chown d0/d1/f5 877842 1 2024-05-06T14:04:01.939 INFO:tasks.workunit.client.1.smithi174.stdout:9/40: dwrite fa [282624,40960] 0 2024-05-06T14:04:01.939 INFO:tasks.workunit.client.1.smithi174.stdout:9/41: mkdir dc 0 2024-05-06T14:04:01.939 INFO:tasks.workunit.client.1.smithi174.stdout:9/42: mknod dc/cd 0 2024-05-06T14:04:01.939 INFO:tasks.workunit.client.1.smithi174.stdout:9/43: truncate f1 682362 0 2024-05-06T14:04:01.939 INFO:tasks.workunit.client.1.smithi174.stdout:9/44: chown l9 91 1 2024-05-06T14:04:01.939 INFO:tasks.workunit.client.1.smithi174.stdout:9/45: mkdir dc/de 0 2024-05-06T14:04:01.939 INFO:tasks.workunit.client.1.smithi174.stdout:9/46: mkdir dc/df 0 2024-05-06T14:04:01.940 INFO:tasks.workunit.client.1.smithi174.stdout:9/47: write f7 [742024,82117] 0 2024-05-06T14:04:01.940 INFO:tasks.workunit.client.1.smithi174.stdout:9/48: chown dc/cd 372329376 1 2024-05-06T14:04:01.940 INFO:tasks.workunit.client.1.smithi174.stdout:9/49: stat l0 0 2024-05-06T14:04:01.940 INFO:tasks.workunit.client.1.smithi174.stdout:9/50: dread f3 [479232,4096] 0 2024-05-06T14:04:01.940 INFO:tasks.workunit.client.1.smithi174.stdout:9/51: rename l9 to dc/de/l10 0 2024-05-06T14:04:01.980 INFO:tasks.workunit.client.1.smithi174.stdout:7/54: fdatasync d0/fe 0 2024-05-06T14:04:01.980 INFO:tasks.workunit.client.1.smithi174.stdout:2/31: dread d0/d1/f5 [528384,86016] 0 2024-05-06T14:04:01.982 INFO:tasks.workunit.client.1.smithi174.stdout:0/54: sync 2024-05-06T14:04:01.982 INFO:tasks.workunit.client.1.smithi174.stdout:6/81: sync 2024-05-06T14:04:01.983 INFO:tasks.workunit.client.1.smithi174.stdout:3/85: dwrite df/d10/f1a [823296,57344] 0 2024-05-06T14:04:01.983 INFO:tasks.workunit.client.1.smithi174.stdout:7/55: mknod d0/cf 0 2024-05-06T14:04:01.984 INFO:tasks.workunit.client.1.smithi174.stdout:0/55: creat d0/f10 x:0 0 0 2024-05-06T14:04:01.984 INFO:tasks.workunit.client.1.smithi174.stdout:6/82: symlink d0/df/l17 0 2024-05-06T14:04:01.984 INFO:tasks.workunit.client.1.smithi174.stdout:0/56: symlink d0/l11 0 2024-05-06T14:04:01.984 INFO:tasks.workunit.client.1.smithi174.stdout:6/83: creat d0/df/f18 x:0 0 0 2024-05-06T14:04:01.984 INFO:tasks.workunit.client.1.smithi174.stdout:6/84: mknod d0/df/c19 0 2024-05-06T14:04:01.984 INFO:tasks.workunit.client.1.smithi174.stdout:0/57: creat d0/d3/dc/f12 x:0 0 0 2024-05-06T14:04:01.984 INFO:tasks.workunit.client.1.smithi174.stdout:6/85: chown d0/cb 0 1 2024-05-06T14:04:01.985 INFO:tasks.workunit.client.1.smithi174.stdout:6/86: write d0/df/f18 [416402,11050] 0 2024-05-06T14:04:01.985 INFO:tasks.workunit.client.1.smithi174.stdout:6/87: creat d0/f1a x:0 0 0 2024-05-06T14:04:01.985 INFO:tasks.workunit.client.1.smithi174.stdout:6/88: symlink d0/df/l1b 0 2024-05-06T14:04:01.985 INFO:tasks.workunit.client.1.smithi174.stdout:6/89: link d0/df/l10 d0/l1c 0 2024-05-06T14:04:01.985 INFO:tasks.workunit.client.1.smithi174.stdout:6/90: mknod d0/df/c1d 0 2024-05-06T14:04:02.025 INFO:tasks.workunit.client.1.smithi174.stdout:9/52: dread f7 [667648,126976] 0 2024-05-06T14:04:02.025 INFO:tasks.workunit.client.1.smithi174.stdout:9/53: write fa [737879,65968] 0 2024-05-06T14:04:02.025 INFO:tasks.workunit.client.1.smithi174.stdout:9/54: creat dc/df/f11 x:0 0 0 2024-05-06T14:04:02.025 INFO:tasks.workunit.client.1.smithi174.stdout:9/55: link dc/df/f11 dc/df/f12 0 2024-05-06T14:04:02.025 INFO:tasks.workunit.client.1.smithi174.stdout:9/56: symlink dc/de/l13 0 2024-05-06T14:04:02.025 INFO:tasks.workunit.client.1.smithi174.stdout:3/86: dwrite df/d10/f1a [1900544,102400] 0 2024-05-06T14:04:02.026 INFO:tasks.workunit.client.1.smithi174.stdout:3/87: dread - df/d10/d1b/f20 zero size 2024-05-06T14:04:02.026 INFO:tasks.workunit.client.1.smithi174.stdout:3/88: write f7 [1713411,67473] 0 2024-05-06T14:04:02.026 INFO:tasks.workunit.client.1.smithi174.stdout:6/91: dwrite d0/f16 [720896,8192] 0 2024-05-06T14:04:02.026 INFO:tasks.workunit.client.1.smithi174.stdout:9/57: dwrite f2 [589824,110592] 0 2024-05-06T14:04:02.051 INFO:tasks.workunit.client.1.smithi174.stdout:7/56: fdatasync d0/f6 0 2024-05-06T14:04:02.051 INFO:tasks.workunit.client.1.smithi174.stdout:0/58: fdatasync d0/fa 0 2024-05-06T14:04:02.051 INFO:tasks.workunit.client.1.smithi174.stdout:2/32: fsync d0/d1/f5 0 2024-05-06T14:04:02.051 INFO:tasks.workunit.client.1.smithi174.stdout:0/59: dread - d0/f10 zero size 2024-05-06T14:04:02.051 INFO:tasks.workunit.client.1.smithi174.stdout:4/32: fdatasync d1/f6 0 2024-05-06T14:04:02.052 INFO:tasks.workunit.client.1.smithi174.stdout:5/59: fdatasync d1/d6/fc 0 2024-05-06T14:04:02.052 INFO:tasks.workunit.client.1.smithi174.stdout:0/60: creat d0/d4/d8/d9/f13 x:0 0 0 2024-05-06T14:04:02.052 INFO:tasks.workunit.client.1.smithi174.stdout:4/33: creat d1/fd x:0 0 0 2024-05-06T14:04:02.052 INFO:tasks.workunit.client.1.smithi174.stdout:4/34: read d1/f5 [67454,39392] 0 2024-05-06T14:04:02.052 INFO:tasks.workunit.client.1.smithi174.stdout:4/35: chown d1/c4 113944 1 2024-05-06T14:04:02.052 INFO:tasks.workunit.client.1.smithi174.stdout:4/36: creat d1/d9/fe x:0 0 0 2024-05-06T14:04:02.052 INFO:tasks.workunit.client.1.smithi174.stdout:4/37: dread - d1/d9/fe zero size 2024-05-06T14:04:02.053 INFO:tasks.workunit.client.1.smithi174.stdout:9/58: dwrite f1 [1343488,16384] 0 2024-05-06T14:04:02.055 INFO:tasks.workunit.client.1.smithi174.stdout:1/30: sync 2024-05-06T14:04:02.055 INFO:tasks.workunit.client.1.smithi174.stdout:2/33: dwrite d0/d1/f5 [655360,106496] 0 2024-05-06T14:04:02.055 INFO:tasks.workunit.client.1.smithi174.stdout:2/34: rmdir d0 39 2024-05-06T14:04:02.056 INFO:tasks.workunit.client.1.smithi174.stdout:2/35: truncate d0/d1/f5 788082 0 2024-05-06T14:04:02.056 INFO:tasks.workunit.client.1.smithi174.stdout:2/36: readlink - no filename 2024-05-06T14:04:02.056 INFO:tasks.workunit.client.1.smithi174.stdout:7/57: rename d0/f8 to d0/d3/f10 0 2024-05-06T14:04:02.056 INFO:tasks.workunit.client.1.smithi174.stdout:3/89: dwrite f4 [647168,24576] 0 2024-05-06T14:04:02.056 INFO:tasks.workunit.client.1.smithi174.stdout:1/31: mkdir d11 0 2024-05-06T14:04:02.056 INFO:tasks.workunit.client.1.smithi174.stdout:5/60: unlink d1/d6/df/l12 0 2024-05-06T14:04:02.056 INFO:tasks.workunit.client.1.smithi174.stdout:2/37: mkdir d0/d1/d2/d4/d6 0 2024-05-06T14:04:02.057 INFO:tasks.workunit.client.1.smithi174.stdout:2/38: chown d0/d1/d2/d4/d6 123800 1 2024-05-06T14:04:02.057 INFO:tasks.workunit.client.1.smithi174.stdout:3/90: mknod df/d10/c25 0 2024-05-06T14:04:02.057 INFO:tasks.workunit.client.1.smithi174.stdout:5/61: dread d1/d6/f13 [614400,40960] 0 2024-05-06T14:04:02.057 INFO:tasks.workunit.client.1.smithi174.stdout:7/58: mkdir d0/da/d11 0 2024-05-06T14:04:02.057 INFO:tasks.workunit.client.1.smithi174.stdout:3/91: readlink df/l11 0 2024-05-06T14:04:02.057 INFO:tasks.workunit.client.1.smithi174.stdout:4/38: dwrite d1/f5 [598016,20480] 0 2024-05-06T14:04:02.057 INFO:tasks.workunit.client.1.smithi174.stdout:0/61: write d0/d4/d8/db/ff [388636,88917] 0 2024-05-06T14:04:02.057 INFO:tasks.workunit.client.1.smithi174.stdout:5/62: write d1/d6/f9 [1259205,49106] 0 2024-05-06T14:04:02.057 INFO:tasks.workunit.client.1.smithi174.stdout:1/32: write fc [721175,95044] 0 2024-05-06T14:04:02.058 INFO:tasks.workunit.client.1.smithi174.stdout:0/62: mknod d0/d4/c14 0 2024-05-06T14:04:02.058 INFO:tasks.workunit.client.1.smithi174.stdout:1/33: chown l2 13 1 2024-05-06T14:04:02.058 INFO:tasks.workunit.client.1.smithi174.stdout:1/34: rename d11 to d11/d12 22 2024-05-06T14:04:02.058 INFO:tasks.workunit.client.1.smithi174.stdout:1/35: dread - fb zero size 2024-05-06T14:04:02.058 INFO:tasks.workunit.client.1.smithi174.stdout:1/36: mknod d11/c13 0 2024-05-06T14:04:02.058 INFO:tasks.workunit.client.1.smithi174.stdout:1/37: readlink l6 0 2024-05-06T14:04:02.115 INFO:tasks.workunit.client.1.smithi174.stdout:2/39: dwrite d0/d1/f5 [1171456,61440] 0 2024-05-06T14:04:02.115 INFO:tasks.workunit.client.1.smithi174.stdout:2/40: creat d0/d1/d2/d4/d6/f7 x:0 0 0 2024-05-06T14:04:02.116 INFO:tasks.workunit.client.1.smithi174.stdout:2/41: symlink d0/d1/d2/d4/d6/l8 0 2024-05-06T14:04:02.116 INFO:tasks.workunit.client.1.smithi174.stdout:2/42: write d0/d1/d2/d4/d6/f7 [507524,10578] 0 2024-05-06T14:04:02.117 INFO:tasks.workunit.client.1.smithi174.stdout:4/39: dwrite d1/f5 [303104,69632] 0 2024-05-06T14:04:02.117 INFO:tasks.workunit.client.1.smithi174.stdout:4/40: creat d1/d9/ff x:0 0 0 2024-05-06T14:04:02.117 INFO:tasks.workunit.client.1.smithi174.stdout:4/41: creat d1/f10 x:0 0 0 2024-05-06T14:04:02.117 INFO:tasks.workunit.client.1.smithi174.stdout:5/63: dwrite d1/d6/da/fd [974848,53248] 0 2024-05-06T14:04:02.118 INFO:tasks.workunit.client.1.smithi174.stdout:5/64: creat d1/d6/da/db/f1a x:0 0 0 2024-05-06T14:04:02.118 INFO:tasks.workunit.client.1.smithi174.stdout:5/65: creat d1/d6/da/db/f1b x:0 0 0 2024-05-06T14:04:02.118 INFO:tasks.workunit.client.1.smithi174.stdout:5/66: chown d1/d6/d7 16237 1 2024-05-06T14:04:02.119 INFO:tasks.workunit.client.1.smithi174.stdout:0/63: dwrite d0/d4/d8/db/ff [684032,106496] 0 2024-05-06T14:04:02.120 INFO:tasks.workunit.client.1.smithi174.stdout:0/64: truncate d0/d3/dc/f12 887322 0 2024-05-06T14:04:02.120 INFO:tasks.workunit.client.1.smithi174.stdout:0/65: write d0/d3/dc/f12 [1437094,21768] 0 2024-05-06T14:04:02.120 INFO:tasks.workunit.client.1.smithi174.stdout:1/38: dwrite f5 [1097728,8192] 0 2024-05-06T14:04:02.120 INFO:tasks.workunit.client.1.smithi174.stdout:3/92: write fc [1196027,44207] 0 2024-05-06T14:04:02.120 INFO:tasks.workunit.client.1.smithi174.stdout:1/39: rename c3 to d11/c14 0 2024-05-06T14:04:02.120 INFO:tasks.workunit.client.1.smithi174.stdout:3/93: symlink df/d10/l26 0 2024-05-06T14:04:02.120 INFO:tasks.workunit.client.1.smithi174.stdout:2/43: dwrite d0/d1/f5 [1056768,32768] 0 2024-05-06T14:04:02.120 INFO:tasks.workunit.client.1.smithi174.stdout:1/40: write fb [828598,33695] 0 2024-05-06T14:04:02.121 INFO:tasks.workunit.client.1.smithi174.stdout:1/41: rename d11 to d11/d15 22 2024-05-06T14:04:02.121 INFO:tasks.workunit.client.1.smithi174.stdout:1/42: unlink l7 0 2024-05-06T14:04:02.121 INFO:tasks.workunit.client.1.smithi174.stdout:1/43: dread f5 [40960,77824] 0 2024-05-06T14:04:02.121 INFO:tasks.workunit.client.1.smithi174.stdout:1/44: rename c8 to d11/c16 0 2024-05-06T14:04:02.121 INFO:tasks.workunit.client.1.smithi174.stdout:3/94: write f4 [490743,129790] 0 2024-05-06T14:04:02.121 INFO:tasks.workunit.client.1.smithi174.stdout:3/95: write fd [295211,68653] 0 2024-05-06T14:04:02.121 INFO:tasks.workunit.client.1.smithi174.stdout:3/96: creat df/d10/d1b/f27 x:0 0 0 2024-05-06T14:04:02.121 INFO:tasks.workunit.client.1.smithi174.stdout:3/97: stat df 0 2024-05-06T14:04:02.176 INFO:tasks.workunit.client.1.smithi174.stdout:9/59: fdatasync f7 0 2024-05-06T14:04:02.176 INFO:tasks.workunit.client.1.smithi174.stdout:6/92: fdatasync d0/f16 0 2024-05-06T14:04:02.176 INFO:tasks.workunit.client.1.smithi174.stdout:9/60: mkdir dc/d14 0 2024-05-06T14:04:02.176 INFO:tasks.workunit.client.1.smithi174.stdout:1/45: fdatasync fe 0 2024-05-06T14:04:02.179 INFO:tasks.workunit.client.1.smithi174.stdout:3/98: dwrite f7 [819200,40960] 0 2024-05-06T14:04:02.179 INFO:tasks.workunit.client.1.smithi174.stdout:3/99: truncate df/f18 149793 0 2024-05-06T14:04:02.179 INFO:tasks.workunit.client.1.smithi174.stdout:3/100: chown fe 111490 1 2024-05-06T14:04:02.179 INFO:tasks.workunit.client.1.smithi174.stdout:3/101: read - df/d10/d1b/f24 zero size 2024-05-06T14:04:02.180 INFO:tasks.workunit.client.1.smithi174.stdout:3/102: unlink df/l1e 0 2024-05-06T14:04:02.180 INFO:tasks.workunit.client.1.smithi174.stdout:3/103: creat df/f28 x:0 0 0 2024-05-06T14:04:02.180 INFO:tasks.workunit.client.1.smithi174.stdout:3/104: symlink df/d10/l29 0 2024-05-06T14:04:02.180 INFO:tasks.workunit.client.1.smithi174.stdout:3/105: rename df/d10/c25 to df/d10/c2a 0 2024-05-06T14:04:02.180 INFO:tasks.workunit.client.1.smithi174.stdout:3/106: rename df/d10/d1b/f27 to df/d10/d1b/f2b 0 2024-05-06T14:04:02.180 INFO:tasks.workunit.client.1.smithi174.stdout:4/42: dwrite d1/d9/fe [634880,4096] 0 2024-05-06T14:04:02.180 INFO:tasks.workunit.client.1.smithi174.stdout:3/107: readlink l3 0 2024-05-06T14:04:02.180 INFO:tasks.workunit.client.1.smithi174.stdout:0/66: dwrite d0/d4/d8/d9/f13 [933888,102400] 0 2024-05-06T14:04:02.180 INFO:tasks.workunit.client.1.smithi174.stdout:5/67: dwrite d1/d6/da/f17 [1064960,81920] 0 2024-05-06T14:04:02.181 INFO:tasks.workunit.client.1.smithi174.stdout:5/68: rmdir d1 39 2024-05-06T14:04:02.181 INFO:tasks.workunit.client.1.smithi174.stdout:5/69: chown d1/d6/da/db/f16 110054 1 2024-05-06T14:04:02.183 INFO:tasks.workunit.client.1.smithi174.stdout:8/123: sync 2024-05-06T14:04:02.183 INFO:tasks.workunit.client.1.smithi174.stdout:0/67: rename d0/f10 to d0/d4/d8/db/f15 0 2024-05-06T14:04:02.183 INFO:tasks.workunit.client.1.smithi174.stdout:4/43: link d1/l8 d1/l11 0 2024-05-06T14:04:02.183 INFO:tasks.workunit.client.1.smithi174.stdout:8/124: mknod d4/de/d24/c26 0 2024-05-06T14:04:02.183 INFO:tasks.workunit.client.1.smithi174.stdout:9/61: mknod dc/de/c15 0 2024-05-06T14:04:02.184 INFO:tasks.workunit.client.1.smithi174.stdout:8/125: dread - d4/d15/f1e zero size 2024-05-06T14:04:02.184 INFO:tasks.workunit.client.1.smithi174.stdout:6/93: symlink d0/df/l1e 0 2024-05-06T14:04:02.184 INFO:tasks.workunit.client.1.smithi174.stdout:9/62: dread f1 [425984,4096] 0 2024-05-06T14:04:02.184 INFO:tasks.workunit.client.1.smithi174.stdout:4/44: creat d1/d9/f12 x:0 0 0 2024-05-06T14:04:02.184 INFO:tasks.workunit.client.1.smithi174.stdout:4/45: read - d1/d9/f12 zero size 2024-05-06T14:04:02.184 INFO:tasks.workunit.client.1.smithi174.stdout:0/68: mkdir d0/d16 0 2024-05-06T14:04:02.184 INFO:tasks.workunit.client.1.smithi174.stdout:9/63: creat dc/d14/f16 x:0 0 0 2024-05-06T14:04:02.184 INFO:tasks.workunit.client.1.smithi174.stdout:4/46: mknod d1/c13 0 2024-05-06T14:04:02.185 INFO:tasks.workunit.client.1.smithi174.stdout:8/126: symlink d4/de/d23/l27 0 2024-05-06T14:04:02.185 INFO:tasks.workunit.client.1.smithi174.stdout:8/127: chown d4/de/c1a 15 1 2024-05-06T14:04:02.185 INFO:tasks.workunit.client.1.smithi174.stdout:0/69: dread d0/d4/d8/d9/f13 [430080,106496] 0 2024-05-06T14:04:02.185 INFO:tasks.workunit.client.1.smithi174.stdout:8/128: rmdir d4 39 2024-05-06T14:04:02.185 INFO:tasks.workunit.client.1.smithi174.stdout:8/129: chown d4/ld 2216165 1 2024-05-06T14:04:02.185 INFO:tasks.workunit.client.1.smithi174.stdout:9/64: mkdir dc/d17 0 2024-05-06T14:04:02.185 INFO:tasks.workunit.client.1.smithi174.stdout:0/70: getdents d0/d3 0 2024-05-06T14:04:02.185 INFO:tasks.workunit.client.1.smithi174.stdout:5/70: dwrite d1/d6/da/db/f1a [618496,65536] 0 2024-05-06T14:04:02.185 INFO:tasks.workunit.client.1.smithi174.stdout:5/71: chown d1/d6/d7 197060179 1 2024-05-06T14:04:02.186 INFO:tasks.workunit.client.1.smithi174.stdout:3/108: dwrite df/f28 [364544,98304] 0 2024-05-06T14:04:02.186 INFO:tasks.workunit.client.1.smithi174.stdout:3/109: rmdir df 39 2024-05-06T14:04:02.186 INFO:tasks.workunit.client.1.smithi174.stdout:3/110: write df/f28 [35859,28540] 0 2024-05-06T14:04:02.186 INFO:tasks.workunit.client.1.smithi174.stdout:3/111: write f9 [696162,25724] 0 2024-05-06T14:04:02.186 INFO:tasks.workunit.client.1.smithi174.stdout:3/112: write df/d10/f1a [213682,66874] 0 2024-05-06T14:04:02.186 INFO:tasks.workunit.client.1.smithi174.stdout:3/113: creat df/d10/f2c x:0 0 0 2024-05-06T14:04:02.186 INFO:tasks.workunit.client.1.smithi174.stdout:3/114: mkdir df/d2d 0 2024-05-06T14:04:02.186 INFO:tasks.workunit.client.1.smithi174.stdout:3/115: symlink df/d2d/l2e 0 2024-05-06T14:04:02.187 INFO:tasks.workunit.client.1.smithi174.stdout:3/116: creat df/d10/f2f x:0 0 0 2024-05-06T14:04:02.251 INFO:tasks.workunit.client.1.smithi174.stdout:5/72: dwrite d1/d6/da/db/f16 [131072,106496] 0 2024-05-06T14:04:02.252 INFO:tasks.workunit.client.1.smithi174.stdout:5/73: mknod d1/d6/da/c1c 0 2024-05-06T14:04:02.252 INFO:tasks.workunit.client.1.smithi174.stdout:5/74: creat d1/d6/da/db/f1d x:0 0 0 2024-05-06T14:04:02.256 INFO:tasks.workunit.client.1.smithi174.stdout:8/130: dwrite d4/fb [69632,122880] 0 2024-05-06T14:04:02.256 INFO:tasks.workunit.client.1.smithi174.stdout:3/117: dwrite df/f28 [356352,16384] 0 2024-05-06T14:04:02.256 INFO:tasks.workunit.client.1.smithi174.stdout:8/131: creat d4/f28 x:0 0 0 2024-05-06T14:04:02.256 INFO:tasks.workunit.client.1.smithi174.stdout:8/132: mknod d4/c29 0 2024-05-06T14:04:02.256 INFO:tasks.workunit.client.1.smithi174.stdout:8/133: truncate d4/d15/f16 1673531 0 2024-05-06T14:04:02.257 INFO:tasks.workunit.client.1.smithi174.stdout:6/94: dwrite d0/df/f18 [1437696,65536] 0 2024-05-06T14:04:02.257 INFO:tasks.workunit.client.1.smithi174.stdout:8/134: truncate d4/fb 2236982 0 2024-05-06T14:04:02.257 INFO:tasks.workunit.client.1.smithi174.stdout:3/118: write f5 [1382868,84745] 0 2024-05-06T14:04:02.257 INFO:tasks.workunit.client.1.smithi174.stdout:6/95: rmdir d0/df 39 2024-05-06T14:04:02.257 INFO:tasks.workunit.client.1.smithi174.stdout:3/119: rmdir df/d2d 39 2024-05-06T14:04:02.257 INFO:tasks.workunit.client.1.smithi174.stdout:8/135: mknod d4/c2a 0 2024-05-06T14:04:02.257 INFO:tasks.workunit.client.1.smithi174.stdout:6/96: link d0/df/f14 d0/df/f1f 0 2024-05-06T14:04:02.257 INFO:tasks.workunit.client.1.smithi174.stdout:3/120: dread df/f17 [167936,118784] 0 2024-05-06T14:04:02.258 INFO:tasks.workunit.client.1.smithi174.stdout:6/97: dread d0/f16 [618496,40960] 0 2024-05-06T14:04:02.258 INFO:tasks.workunit.client.1.smithi174.stdout:6/98: chown d0/df 0 1 2024-05-06T14:04:02.258 INFO:tasks.workunit.client.1.smithi174.stdout:3/121: symlink df/d2d/l30 0 2024-05-06T14:04:02.258 INFO:tasks.workunit.client.1.smithi174.stdout:3/122: dread f2 [4096,86016] 0 2024-05-06T14:04:02.258 INFO:tasks.workunit.client.1.smithi174.stdout:3/123: creat df/d2d/f31 x:0 0 0 2024-05-06T14:04:02.258 INFO:tasks.workunit.client.1.smithi174.stdout:6/99: write d0/f15 [481318,56101] 0 2024-05-06T14:04:02.258 INFO:tasks.workunit.client.1.smithi174.stdout:6/100: creat d0/df/f20 x:0 0 0 2024-05-06T14:04:02.258 INFO:tasks.workunit.client.1.smithi174.stdout:6/101: creat d0/df/f21 x:0 0 0 2024-05-06T14:04:02.259 INFO:tasks.workunit.client.1.smithi174.stdout:6/102: write d0/f15 [1398409,111390] 0 2024-05-06T14:04:02.259 INFO:tasks.workunit.client.1.smithi174.stdout:6/103: write d0/df/f1f [158811,23457] 0 2024-05-06T14:04:02.259 INFO:tasks.workunit.client.1.smithi174.stdout:6/104: truncate d0/f15 1707292 0 2024-05-06T14:04:02.259 INFO:tasks.workunit.client.1.smithi174.stdout:6/105: unlink d0/df/f21 0 2024-05-06T14:04:02.259 INFO:tasks.workunit.client.1.smithi174.stdout:6/106: stat d0/df/l1e 0 2024-05-06T14:04:02.259 INFO:tasks.workunit.client.1.smithi174.stdout:6/107: mkdir d0/df/d22 0 2024-05-06T14:04:02.259 INFO:tasks.workunit.client.1.smithi174.stdout:6/108: mknod d0/df/d22/c23 0 2024-05-06T14:04:02.259 INFO:tasks.workunit.client.1.smithi174.stdout:6/109: truncate d0/f1a 1035366 0 2024-05-06T14:04:02.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/110: write d0/df/f1f [880181,80099] 0 2024-05-06T14:04:02.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/111: creat d0/df/f24 x:0 0 0 2024-05-06T14:04:02.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/112: write d0/df/f20 [63022,115436] 0 2024-05-06T14:04:02.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/113: mkdir d0/d25 0 2024-05-06T14:04:02.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/114: chown d0/df/f24 9626922 1 2024-05-06T14:04:02.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/115: creat d0/f26 x:0 0 0 2024-05-06T14:04:02.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/116: write d0/df/f18 [1246807,26711] 0 2024-05-06T14:04:02.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/117: chown d0/f26 0 1 2024-05-06T14:04:02.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/118: stat d0/l1c 0 2024-05-06T14:04:02.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/119: truncate d0/df/f24 1040466 0 2024-05-06T14:04:02.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/120: symlink d0/l27 0 2024-05-06T14:04:02.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/121: stat d0/f1a 0 2024-05-06T14:04:02.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/122: unlink d0/f1a 0 2024-05-06T14:04:02.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/123: rename d0/df to d0/df/d28 22 2024-05-06T14:04:02.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/124: getdents d0 0 2024-05-06T14:04:02.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/125: write d0/df/f20 [2374,26803] 0 2024-05-06T14:04:02.262 INFO:tasks.workunit.client.1.smithi174.stdout:6/126: creat d0/df/f29 x:0 0 0 2024-05-06T14:04:02.298 INFO:tasks.workunit.client.1.smithi174.stdout:1/46: fdatasync fb 0 2024-05-06T14:04:02.312 INFO:tasks.workunit.client.1.smithi174.stdout:5/75: fdatasync d1/d6/da/db/f1b 0 2024-05-06T14:04:02.312 INFO:tasks.workunit.client.1.smithi174.stdout:1/47: fsync fe 0 2024-05-06T14:04:02.315 INFO:tasks.workunit.client.1.smithi174.stdout:6/127: dwrite d0/df/f24 [1679360,102400] 0 2024-05-06T14:04:02.315 INFO:tasks.workunit.client.1.smithi174.stdout:6/128: truncate d0/df/f29 823311 0 2024-05-06T14:04:02.315 INFO:tasks.workunit.client.1.smithi174.stdout:8/136: dwrite d4/de/f1f [1986560,61440] 0 2024-05-06T14:04:02.315 INFO:tasks.workunit.client.1.smithi174.stdout:6/129: mknod d0/c2a 0 2024-05-06T14:04:02.316 INFO:tasks.workunit.client.1.smithi174.stdout:6/130: chown d0/df/c19 44 1 2024-05-06T14:04:02.316 INFO:tasks.workunit.client.1.smithi174.stdout:6/131: chown d0/df/d22/c23 405818 1 2024-05-06T14:04:02.316 INFO:tasks.workunit.client.1.smithi174.stdout:6/132: mknod d0/d25/c2b 0 2024-05-06T14:04:02.316 INFO:tasks.workunit.client.1.smithi174.stdout:5/76: write d1/d6/f9 [1418625,130113] 0 2024-05-06T14:04:02.316 INFO:tasks.workunit.client.1.smithi174.stdout:6/133: mkdir d0/df/d22/d2c 0 2024-05-06T14:04:02.316 INFO:tasks.workunit.client.1.smithi174.stdout:8/137: write d4/de/d23/f25 [703959,67720] 0 2024-05-06T14:04:02.316 INFO:tasks.workunit.client.1.smithi174.stdout:5/77: dread - d1/d6/f18 zero size 2024-05-06T14:04:02.316 INFO:tasks.workunit.client.1.smithi174.stdout:5/78: truncate d1/d6/f13 1595311 0 2024-05-06T14:04:02.316 INFO:tasks.workunit.client.1.smithi174.stdout:6/134: write d0/df/f20 [350823,8934] 0 2024-05-06T14:04:02.317 INFO:tasks.workunit.client.1.smithi174.stdout:8/138: mknod d4/de/c2b 0 2024-05-06T14:04:02.317 INFO:tasks.workunit.client.1.smithi174.stdout:8/139: truncate d4/d15/f1e 638280 0 2024-05-06T14:04:02.317 INFO:tasks.workunit.client.1.smithi174.stdout:5/79: mkdir d1/d6/da/db/d1e 0 2024-05-06T14:04:02.317 INFO:tasks.workunit.client.1.smithi174.stdout:8/140: dread d4/de/f17 [1097728,102400] 0 2024-05-06T14:04:02.317 INFO:tasks.workunit.client.1.smithi174.stdout:5/80: creat d1/d6/d7/f1f x:0 0 0 2024-05-06T14:04:02.317 INFO:tasks.workunit.client.1.smithi174.stdout:8/141: mknod d4/c2c 0 2024-05-06T14:04:02.317 INFO:tasks.workunit.client.1.smithi174.stdout:5/81: symlink d1/d6/df/l20 0 2024-05-06T14:04:02.317 INFO:tasks.workunit.client.1.smithi174.stdout:8/142: getdents d4/d15/d20 0 2024-05-06T14:04:02.318 INFO:tasks.workunit.client.1.smithi174.stdout:5/82: chown d1/d6/da/db/f16 888119080 1 2024-05-06T14:04:02.318 INFO:tasks.workunit.client.1.smithi174.stdout:5/83: mkdir d1/d6/d21 0 2024-05-06T14:04:02.318 INFO:tasks.workunit.client.1.smithi174.stdout:5/84: read d1/d6/fc [336042,13216] 0 2024-05-06T14:04:02.318 INFO:tasks.workunit.client.1.smithi174.stdout:5/85: rename d1/d6/da/f17 to d1/d6/da/f22 0 2024-05-06T14:04:02.318 INFO:tasks.workunit.client.1.smithi174.stdout:5/86: unlink d1/d6/da/db/l11 0 2024-05-06T14:04:02.318 INFO:tasks.workunit.client.1.smithi174.stdout:5/87: write d1/d6/f18 [245013,52918] 0 2024-05-06T14:04:02.318 INFO:tasks.workunit.client.1.smithi174.stdout:5/88: write d1/d6/f13 [286281,58623] 0 2024-05-06T14:04:02.328 INFO:tasks.workunit.client.1.smithi174.stdout:1/48: dwrite f1 [487424,114688] 0 2024-05-06T14:04:02.329 INFO:tasks.workunit.client.1.smithi174.stdout:1/49: symlink d11/l17 0 2024-05-06T14:04:02.329 INFO:tasks.workunit.client.1.smithi174.stdout:1/50: chown d11/l17 1819062 1 2024-05-06T14:04:02.329 INFO:tasks.workunit.client.1.smithi174.stdout:1/51: truncate fe 1038942 0 2024-05-06T14:04:02.429 INFO:tasks.workunit.client.1.smithi174.stdout:4/47: fdatasync d1/d9/f12 0 2024-05-06T14:04:02.429 INFO:tasks.workunit.client.1.smithi174.stdout:2/44: fsync d0/d1/d2/d4/d6/f7 0 2024-05-06T14:04:02.429 INFO:tasks.workunit.client.1.smithi174.stdout:2/45: chown d0/d1 59 1 2024-05-06T14:04:02.432 INFO:tasks.workunit.client.1.smithi174.stdout:7/59: sync 2024-05-06T14:04:02.432 INFO:tasks.workunit.client.1.smithi174.stdout:0/71: sync 2024-05-06T14:04:02.432 INFO:tasks.workunit.client.1.smithi174.stdout:9/65: sync 2024-05-06T14:04:02.433 INFO:tasks.workunit.client.1.smithi174.stdout:0/72: truncate d0/d3/dc/f12 2488585 0 2024-05-06T14:04:02.433 INFO:tasks.workunit.client.1.smithi174.stdout:1/52: dwrite f5 [1486848,106496] 0 2024-05-06T14:04:02.434 INFO:tasks.workunit.client.1.smithi174.stdout:2/46: write d0/d1/f5 [1148649,4110] 0 2024-05-06T14:04:02.434 INFO:tasks.workunit.client.1.smithi174.stdout:0/73: rename d0/d4/d8/db to d0/d4/d8/d9/d17 0 2024-05-06T14:04:02.434 INFO:tasks.workunit.client.1.smithi174.stdout:4/48: symlink d1/l14 0 2024-05-06T14:04:02.434 INFO:tasks.workunit.client.1.smithi174.stdout:9/66: symlink dc/d17/l18 0 2024-05-06T14:04:02.434 INFO:tasks.workunit.client.1.smithi174.stdout:0/74: mknod d0/d3/dc/c18 0 2024-05-06T14:04:02.434 INFO:tasks.workunit.client.1.smithi174.stdout:9/67: link l6 dc/l19 0 2024-05-06T14:04:02.434 INFO:tasks.workunit.client.1.smithi174.stdout:4/49: mkdir d1/d9/d15 0 2024-05-06T14:04:02.434 INFO:tasks.workunit.client.1.smithi174.stdout:9/68: mkdir dc/d1a 0 2024-05-06T14:04:02.435 INFO:tasks.workunit.client.1.smithi174.stdout:4/50: link d1/f6 d1/d9/f16 0 2024-05-06T14:04:02.435 INFO:tasks.workunit.client.1.smithi174.stdout:7/60: write d0/d3/f7 [1356947,125463] 0 2024-05-06T14:04:02.435 INFO:tasks.workunit.client.1.smithi174.stdout:0/75: write d0/d4/d8/d9/d17/ff [1046620,56666] 0 2024-05-06T14:04:02.435 INFO:tasks.workunit.client.1.smithi174.stdout:4/51: link d1/f6 d1/d9/d15/f17 0 2024-05-06T14:04:02.435 INFO:tasks.workunit.client.1.smithi174.stdout:4/52: dread - d1/f10 zero size 2024-05-06T14:04:02.467 INFO:tasks.workunit.client.1.smithi174.stdout:2/47: dread d0/d1/f5 [1196032,65536] 0 2024-05-06T14:04:02.469 INFO:tasks.workunit.client.1.smithi174.stdout:7/61: dwrite d0/da/fb [73728,16384] 0 2024-05-06T14:04:02.469 INFO:tasks.workunit.client.1.smithi174.stdout:9/69: dwrite f2 [1605632,65536] 0 2024-05-06T14:04:02.469 INFO:tasks.workunit.client.1.smithi174.stdout:7/62: symlink d0/da/d11/l12 0 2024-05-06T14:04:02.469 INFO:tasks.workunit.client.1.smithi174.stdout:9/70: rmdir dc/d17 39 2024-05-06T14:04:02.470 INFO:tasks.workunit.client.1.smithi174.stdout:9/71: write dc/df/f11 [782117,25092] 0 2024-05-06T14:04:02.470 INFO:tasks.workunit.client.1.smithi174.stdout:9/72: chown l6 658 1 2024-05-06T14:04:02.470 INFO:tasks.workunit.client.1.smithi174.stdout:9/73: chown dc 1305714 1 2024-05-06T14:04:02.470 INFO:tasks.workunit.client.1.smithi174.stdout:9/74: getdents dc/d17 0 2024-05-06T14:04:02.470 INFO:tasks.workunit.client.1.smithi174.stdout:4/53: dwrite d1/fd [507904,126976] 0 2024-05-06T14:04:02.470 INFO:tasks.workunit.client.1.smithi174.stdout:4/54: creat d1/d9/f18 x:0 0 0 2024-05-06T14:04:02.470 INFO:tasks.workunit.client.1.smithi174.stdout:0/76: dwrite d0/d3/dc/f12 [188416,81920] 0 2024-05-06T14:04:02.534 INFO:tasks.workunit.client.1.smithi174.stdout:3/124: fdatasync df/f28 0 2024-05-06T14:04:02.535 INFO:tasks.workunit.client.1.smithi174.stdout:1/53: fdatasync f1 0 2024-05-06T14:04:02.535 INFO:tasks.workunit.client.1.smithi174.stdout:8/143: fdatasync d4/de/d23/f25 0 2024-05-06T14:04:02.535 INFO:tasks.workunit.client.1.smithi174.stdout:1/54: rmdir d11 39 2024-05-06T14:04:02.535 INFO:tasks.workunit.client.1.smithi174.stdout:3/125: read - df/d10/d1b/f24 zero size 2024-05-06T14:04:02.539 INFO:tasks.workunit.client.1.smithi174.stdout:1/55: dread f5 [344064,106496] 0 2024-05-06T14:04:02.539 INFO:tasks.workunit.client.1.smithi174.stdout:9/75: dwrite f3 [217088,114688] 0 2024-05-06T14:04:02.540 INFO:tasks.workunit.client.1.smithi174.stdout:3/126: write df/d10/f14 [400494,10567] 0 2024-05-06T14:04:02.540 INFO:tasks.workunit.client.1.smithi174.stdout:4/55: dwrite d1/d9/fe [327680,65536] 0 2024-05-06T14:04:02.540 INFO:tasks.workunit.client.1.smithi174.stdout:3/127: dread - df/d10/d1b/f20 zero size 2024-05-06T14:04:02.540 INFO:tasks.workunit.client.1.smithi174.stdout:3/128: dread fd [192512,90112] 0 2024-05-06T14:04:02.540 INFO:tasks.workunit.client.1.smithi174.stdout:9/76: mknod dc/c1b 0 2024-05-06T14:04:02.540 INFO:tasks.workunit.client.1.smithi174.stdout:9/77: readlink l0 0 2024-05-06T14:04:02.540 INFO:tasks.workunit.client.1.smithi174.stdout:3/129: symlink df/l32 0 2024-05-06T14:04:02.540 INFO:tasks.workunit.client.1.smithi174.stdout:9/78: truncate fa 365371 0 2024-05-06T14:04:02.541 INFO:tasks.workunit.client.1.smithi174.stdout:9/79: rename dc/d1a to dc/d1c 0 2024-05-06T14:04:02.541 INFO:tasks.workunit.client.1.smithi174.stdout:8/144: creat d4/de/f2d x:0 0 0 2024-05-06T14:04:02.541 INFO:tasks.workunit.client.1.smithi174.stdout:8/145: creat d4/de/d24/f2e x:0 0 0 2024-05-06T14:04:02.541 INFO:tasks.workunit.client.1.smithi174.stdout:6/135: sync 2024-05-06T14:04:02.541 INFO:tasks.workunit.client.1.smithi174.stdout:5/89: sync 2024-05-06T14:04:02.541 INFO:tasks.workunit.client.1.smithi174.stdout:6/136: getdents d0/df/d22/d2c 0 2024-05-06T14:04:02.541 INFO:tasks.workunit.client.1.smithi174.stdout:5/90: mknod d1/d6/d7/c23 0 2024-05-06T14:04:02.541 INFO:tasks.workunit.client.1.smithi174.stdout:5/91: read - d1/d6/da/db/f1b zero size 2024-05-06T14:04:02.542 INFO:tasks.workunit.client.1.smithi174.stdout:6/137: rename d0/df/c19 to d0/df/d22/d2c/c2d 0 2024-05-06T14:04:02.542 INFO:tasks.workunit.client.1.smithi174.stdout:5/92: getdents d1/d6/da/db 0 2024-05-06T14:04:02.542 INFO:tasks.workunit.client.1.smithi174.stdout:6/138: link d0/c2a d0/df/d22/d2c/c2e 0 2024-05-06T14:04:02.542 INFO:tasks.workunit.client.1.smithi174.stdout:5/93: unlink d1/d6/da/db/c15 0 2024-05-06T14:04:02.542 INFO:tasks.workunit.client.1.smithi174.stdout:5/94: rename d1 to d1/d6/d24 22 2024-05-06T14:04:02.542 INFO:tasks.workunit.client.1.smithi174.stdout:5/95: write d1/d6/f13 [2003627,6364] 0 2024-05-06T14:04:02.542 INFO:tasks.workunit.client.1.smithi174.stdout:5/96: truncate d1/d6/da/db/f16 1050038 0 2024-05-06T14:04:02.542 INFO:tasks.workunit.client.1.smithi174.stdout:5/97: rename d1/d6/da/f22 to d1/d6/da/f25 0 2024-05-06T14:04:02.543 INFO:tasks.workunit.client.1.smithi174.stdout:5/98: write d1/d6/fc [2134594,84181] 0 2024-05-06T14:04:02.594 INFO:tasks.workunit.client.1.smithi174.stdout:1/56: dwrite f5 [1232896,81920] 0 2024-05-06T14:04:02.596 INFO:tasks.workunit.client.1.smithi174.stdout:9/80: dwrite f2 [90112,49152] 0 2024-05-06T14:04:02.596 INFO:tasks.workunit.client.1.smithi174.stdout:9/81: dread f1 [929792,81920] 0 2024-05-06T14:04:02.597 INFO:tasks.workunit.client.1.smithi174.stdout:4/56: dwrite d1/d9/f16 [528384,106496] 0 2024-05-06T14:04:02.597 INFO:tasks.workunit.client.1.smithi174.stdout:4/57: rename d1/f6 to d1/f19 0 2024-05-06T14:04:02.597 INFO:tasks.workunit.client.1.smithi174.stdout:4/58: mkdir d1/d1a 0 2024-05-06T14:04:02.597 INFO:tasks.workunit.client.1.smithi174.stdout:4/59: stat d1/c3 0 2024-05-06T14:04:02.597 INFO:tasks.workunit.client.1.smithi174.stdout:8/146: dwrite d4/de/f2d [520192,53248] 0 2024-05-06T14:04:02.597 INFO:tasks.workunit.client.1.smithi174.stdout:1/57: dwrite fe [1740800,36864] 0 2024-05-06T14:04:02.597 INFO:tasks.workunit.client.1.smithi174.stdout:1/58: link la d11/l18 0 2024-05-06T14:04:02.611 INFO:tasks.workunit.client.1.smithi174.stdout:6/139: dread d0/df/f20 [135168,28672] 0 2024-05-06T14:04:02.612 INFO:tasks.workunit.client.1.smithi174.stdout:6/140: read d0/f16 [262492,117704] 0 2024-05-06T14:04:02.612 INFO:tasks.workunit.client.1.smithi174.stdout:6/141: write d0/f15 [619017,66489] 0 2024-05-06T14:04:02.612 INFO:tasks.workunit.client.1.smithi174.stdout:6/142: mknod d0/df/d22/c2f 0 2024-05-06T14:04:02.612 INFO:tasks.workunit.client.1.smithi174.stdout:6/143: dread d0/df/f20 [253952,45056] 0 2024-05-06T14:04:02.654 INFO:tasks.workunit.client.1.smithi174.stdout:3/130: fsync f2 0 2024-05-06T14:04:02.657 INFO:tasks.workunit.client.1.smithi174.stdout:2/48: sync 2024-05-06T14:04:02.659 INFO:tasks.workunit.client.1.smithi174.stdout:3/131: unlink f4 0 2024-05-06T14:04:02.659 INFO:tasks.workunit.client.1.smithi174.stdout:9/82: dwrite f3 [2068480,24576] 0 2024-05-06T14:04:02.660 INFO:tasks.workunit.client.1.smithi174.stdout:8/147: dwrite d4/de/f2d [16384,53248] 0 2024-05-06T14:04:02.660 INFO:tasks.workunit.client.1.smithi174.stdout:1/59: dwrite fb [1138688,94208] 0 2024-05-06T14:04:02.660 INFO:tasks.workunit.client.1.smithi174.stdout:4/60: dwrite d1/d9/f12 [65536,28672] 0 2024-05-06T14:04:02.660 INFO:tasks.workunit.client.1.smithi174.stdout:6/144: dwrite d0/f16 [262144,98304] 0 2024-05-06T14:04:02.660 INFO:tasks.workunit.client.1.smithi174.stdout:1/60: chown d11/c13 2890 1 2024-05-06T14:04:02.660 INFO:tasks.workunit.client.1.smithi174.stdout:3/132: dread fe [348160,114688] 0 2024-05-06T14:04:02.660 INFO:tasks.workunit.client.1.smithi174.stdout:4/61: dread d1/d9/f16 [745472,69632] 0 2024-05-06T14:04:02.660 INFO:tasks.workunit.client.1.smithi174.stdout:1/61: creat d11/f19 x:0 0 0 2024-05-06T14:04:02.661 INFO:tasks.workunit.client.1.smithi174.stdout:1/62: chown d11/f19 86899927 1 2024-05-06T14:04:02.661 INFO:tasks.workunit.client.1.smithi174.stdout:1/63: creat d11/f1a x:0 0 0 2024-05-06T14:04:02.661 INFO:tasks.workunit.client.1.smithi174.stdout:1/64: chown c10 19594200 1 2024-05-06T14:04:02.661 INFO:tasks.workunit.client.1.smithi174.stdout:1/65: truncate fb 491649 0 2024-05-06T14:04:02.661 INFO:tasks.workunit.client.1.smithi174.stdout:1/66: read - d11/f1a zero size 2024-05-06T14:04:02.661 INFO:tasks.workunit.client.1.smithi174.stdout:2/49: dwrite d0/d1/f5 [688128,4096] 0 2024-05-06T14:04:02.661 INFO:tasks.workunit.client.1.smithi174.stdout:2/50: getdents d0 0 2024-05-06T14:04:02.661 INFO:tasks.workunit.client.1.smithi174.stdout:2/51: getdents d0/d1/d2/d4 0 2024-05-06T14:04:02.662 INFO:tasks.workunit.client.1.smithi174.stdout:2/52: chown d0 0 1 2024-05-06T14:04:02.662 INFO:tasks.workunit.client.1.smithi174.stdout:2/53: rename d0/d1/d2/d4/d6/l8 to d0/d1/l9 0 2024-05-06T14:04:02.662 INFO:tasks.workunit.client.1.smithi174.stdout:2/54: getdents d0/d1/d2/d4 0 2024-05-06T14:04:02.662 INFO:tasks.workunit.client.1.smithi174.stdout:2/55: readlink d0/d1/l9 0 2024-05-06T14:04:02.662 INFO:tasks.workunit.client.1.smithi174.stdout:2/56: mkdir d0/da 0 2024-05-06T14:04:02.662 INFO:tasks.workunit.client.1.smithi174.stdout:2/57: mkdir d0/db 0 2024-05-06T14:04:02.662 INFO:tasks.workunit.client.1.smithi174.stdout:2/58: link d0/d1/l9 d0/da/lc 0 2024-05-06T14:04:02.662 INFO:tasks.workunit.client.1.smithi174.stdout:2/59: chown d0/d1/f5 7031 1 2024-05-06T14:04:02.663 INFO:tasks.workunit.client.1.smithi174.stdout:2/60: symlink d0/d1/d2/ld 0 2024-05-06T14:04:02.663 INFO:tasks.workunit.client.1.smithi174.stdout:2/61: stat d0 0 2024-05-06T14:04:02.663 INFO:tasks.workunit.client.1.smithi174.stdout:2/62: creat d0/d1/d2/d4/d6/fe x:0 0 0 2024-05-06T14:04:02.711 INFO:tasks.workunit.client.1.smithi174.stdout:8/148: dwrite d4/de/d24/f2e [692224,4096] 0 2024-05-06T14:04:02.712 INFO:tasks.workunit.client.1.smithi174.stdout:8/149: dread d4/de/d23/f25 [118784,40960] 0 2024-05-06T14:04:02.712 INFO:tasks.workunit.client.1.smithi174.stdout:8/150: dread d4/d15/f16 [1101824,24576] 0 2024-05-06T14:04:02.716 INFO:tasks.workunit.client.1.smithi174.stdout:9/83: dwrite f3 [1134592,90112] 0 2024-05-06T14:04:02.716 INFO:tasks.workunit.client.1.smithi174.stdout:9/84: creat dc/d1c/f1d x:0 0 0 2024-05-06T14:04:02.716 INFO:tasks.workunit.client.1.smithi174.stdout:9/85: creat dc/d14/f1e x:0 0 0 2024-05-06T14:04:02.716 INFO:tasks.workunit.client.1.smithi174.stdout:9/86: dread - dc/d14/f16 zero size 2024-05-06T14:04:02.716 INFO:tasks.workunit.client.1.smithi174.stdout:9/87: dread f2 [344064,98304] 0 2024-05-06T14:04:02.716 INFO:tasks.workunit.client.1.smithi174.stdout:9/88: chown f3 1212713 1 2024-05-06T14:04:02.716 INFO:tasks.workunit.client.1.smithi174.stdout:9/89: stat f2 0 2024-05-06T14:04:02.717 INFO:tasks.workunit.client.1.smithi174.stdout:2/63: dwrite d0/d1/d2/d4/d6/f7 [524288,28672] 0 2024-05-06T14:04:02.717 INFO:tasks.workunit.client.1.smithi174.stdout:9/90: symlink dc/d14/l1f 0 2024-05-06T14:04:02.717 INFO:tasks.workunit.client.1.smithi174.stdout:2/64: creat d0/d1/d2/ff x:0 0 0 2024-05-06T14:04:02.717 INFO:tasks.workunit.client.1.smithi174.stdout:2/65: mknod d0/c10 0 2024-05-06T14:04:02.717 INFO:tasks.workunit.client.1.smithi174.stdout:2/66: link d0/d1/d2/ld d0/da/l11 0 2024-05-06T14:04:02.717 INFO:tasks.workunit.client.1.smithi174.stdout:2/67: read - d0/d1/d2/ff zero size 2024-05-06T14:04:02.717 INFO:tasks.workunit.client.1.smithi174.stdout:2/68: chown d0/d1/l9 1 1 2024-05-06T14:04:02.717 INFO:tasks.workunit.client.1.smithi174.stdout:2/69: write d0/d1/d2/ff [1021202,8247] 0 2024-05-06T14:04:02.718 INFO:tasks.workunit.client.1.smithi174.stdout:2/70: truncate d0/d1/f5 2239112 0 2024-05-06T14:04:02.718 INFO:tasks.workunit.client.1.smithi174.stdout:2/71: unlink d0/c10 0 2024-05-06T14:04:02.718 INFO:tasks.workunit.client.1.smithi174.stdout:2/72: readlink d0/da/lc 0 2024-05-06T14:04:02.718 INFO:tasks.workunit.client.1.smithi174.stdout:2/73: rename d0/da/l11 to d0/d1/l12 0 2024-05-06T14:04:02.718 INFO:tasks.workunit.client.1.smithi174.stdout:2/74: chown d0/d1/d2/d4/d6/f7 440461 1 2024-05-06T14:04:02.718 INFO:tasks.workunit.client.1.smithi174.stdout:2/75: rename d0/d1/l12 to d0/db/l13 0 2024-05-06T14:04:02.718 INFO:tasks.workunit.client.1.smithi174.stdout:2/76: chown d0/d1/d2/d4 0 1 2024-05-06T14:04:02.718 INFO:tasks.workunit.client.1.smithi174.stdout:1/67: dwrite d11/f1a [913408,90112] 0 2024-05-06T14:04:02.718 INFO:tasks.workunit.client.1.smithi174.stdout:1/68: readlink l6 0 2024-05-06T14:04:02.719 INFO:tasks.workunit.client.1.smithi174.stdout:2/77: write d0/d1/d2/ff [176782,77066] 0 2024-05-06T14:04:02.719 INFO:tasks.workunit.client.1.smithi174.stdout:1/69: truncate f1 807167 0 2024-05-06T14:04:02.719 INFO:tasks.workunit.client.1.smithi174.stdout:1/70: readlink lf 0 2024-05-06T14:04:02.719 INFO:tasks.workunit.client.1.smithi174.stdout:3/133: dread df/f28 [401408,4096] 0 2024-05-06T14:04:02.719 INFO:tasks.workunit.client.1.smithi174.stdout:3/134: chown df/d10/l26 174465147 1 2024-05-06T14:04:02.719 INFO:tasks.workunit.client.1.smithi174.stdout:3/135: dread - df/d10/d1b/f22 zero size 2024-05-06T14:04:02.719 INFO:tasks.workunit.client.1.smithi174.stdout:3/136: chown df/d10/l29 105471995 1 2024-05-06T14:04:02.719 INFO:tasks.workunit.client.1.smithi174.stdout:3/137: stat fc 0 2024-05-06T14:04:02.719 INFO:tasks.workunit.client.1.smithi174.stdout:3/138: chown df/d10/l29 798 1 2024-05-06T14:04:02.720 INFO:tasks.workunit.client.1.smithi174.stdout:4/62: dread d1/d9/f12 [77824,77824] 0 2024-05-06T14:04:02.720 INFO:tasks.workunit.client.1.smithi174.stdout:4/63: rmdir d1/d9/d15 39 2024-05-06T14:04:02.720 INFO:tasks.workunit.client.1.smithi174.stdout:4/64: read d1/d9/f16 [1189243,73671] 0 2024-05-06T14:04:02.720 INFO:tasks.workunit.client.1.smithi174.stdout:8/151: dwrite d4/de/f2d [790528,36864] 0 2024-05-06T14:04:02.720 INFO:tasks.workunit.client.1.smithi174.stdout:8/152: readlink d4/ld 0 2024-05-06T14:04:02.720 INFO:tasks.workunit.client.1.smithi174.stdout:8/153: creat d4/de/d24/f2f x:0 0 0 2024-05-06T14:04:02.720 INFO:tasks.workunit.client.1.smithi174.stdout:8/154: getdents d4/d15/d20 0 2024-05-06T14:04:02.720 INFO:tasks.workunit.client.1.smithi174.stdout:8/155: rmdir d4 39 2024-05-06T14:04:02.745 INFO:tasks.workunit.client.1.smithi174.stdout:6/145: fdatasync d0/df/f1f 0 2024-05-06T14:04:02.745 INFO:tasks.workunit.client.1.smithi174.stdout:3/139: fdatasync df/d10/f16 0 2024-05-06T14:04:02.746 INFO:tasks.workunit.client.1.smithi174.stdout:2/78: dwrite d0/d1/d2/d4/d6/f7 [1339392,4096] 0 2024-05-06T14:04:02.746 INFO:tasks.workunit.client.1.smithi174.stdout:2/79: mknod d0/d1/d2/d4/c14 0 2024-05-06T14:04:02.749 INFO:tasks.workunit.client.1.smithi174.stdout:1/71: dwrite fc [1490944,45056] 0 2024-05-06T14:04:02.749 INFO:tasks.workunit.client.1.smithi174.stdout:1/72: symlink d11/l1b 0 2024-05-06T14:04:02.749 INFO:tasks.workunit.client.1.smithi174.stdout:4/65: dwrite d1/fc [290816,57344] 0 2024-05-06T14:04:02.749 INFO:tasks.workunit.client.1.smithi174.stdout:1/73: symlink d11/l1c 0 2024-05-06T14:04:02.749 INFO:tasks.workunit.client.1.smithi174.stdout:1/74: chown c0 17933 1 2024-05-06T14:04:02.749 INFO:tasks.workunit.client.1.smithi174.stdout:1/75: write f1 [951957,56734] 0 2024-05-06T14:04:02.749 INFO:tasks.workunit.client.1.smithi174.stdout:8/156: dwrite d4/de/f11 [2629632,61440] 0 2024-05-06T14:04:02.750 INFO:tasks.workunit.client.1.smithi174.stdout:1/76: write fe [1279997,51289] 0 2024-05-06T14:04:02.750 INFO:tasks.workunit.client.1.smithi174.stdout:8/157: creat d4/d15/f30 x:0 0 0 2024-05-06T14:04:02.750 INFO:tasks.workunit.client.1.smithi174.stdout:6/146: dread d0/df/f20 [118784,36864] 0 2024-05-06T14:04:02.751 INFO:tasks.workunit.client.1.smithi174.stdout:9/91: dwrite f3 [1593344,12288] 0 2024-05-06T14:04:02.751 INFO:tasks.workunit.client.1.smithi174.stdout:6/147: creat d0/d25/f30 x:0 0 0 2024-05-06T14:04:02.751 INFO:tasks.workunit.client.1.smithi174.stdout:6/148: rename d0 to d0/df/d22/d2c/d31 22 2024-05-06T14:04:02.751 INFO:tasks.workunit.client.1.smithi174.stdout:5/99: sync 2024-05-06T14:04:02.751 INFO:tasks.workunit.client.1.smithi174.stdout:0/77: sync 2024-05-06T14:04:02.751 INFO:tasks.workunit.client.1.smithi174.stdout:7/63: sync 2024-05-06T14:04:02.753 INFO:tasks.workunit.client.1.smithi174.stdout:7/64: creat d0/da/d11/f13 x:0 0 0 2024-05-06T14:04:02.753 INFO:tasks.workunit.client.1.smithi174.stdout:3/140: dwrite df/d10/d1b/f22 [602112,73728] 0 2024-05-06T14:04:02.753 INFO:tasks.workunit.client.1.smithi174.stdout:1/77: dwrite d11/f19 [466944,118784] 0 2024-05-06T14:04:02.753 INFO:tasks.workunit.client.1.smithi174.stdout:6/149: symlink d0/df/d22/l32 0 2024-05-06T14:04:02.753 INFO:tasks.workunit.client.1.smithi174.stdout:9/92: link dc/de/l10 dc/l20 0 2024-05-06T14:04:02.753 INFO:tasks.workunit.client.1.smithi174.stdout:9/93: chown dc/d17 214932 1 2024-05-06T14:04:02.753 INFO:tasks.workunit.client.1.smithi174.stdout:3/141: truncate f9 1514969 0 2024-05-06T14:04:02.753 INFO:tasks.workunit.client.1.smithi174.stdout:0/78: mkdir d0/d19 0 2024-05-06T14:04:02.754 INFO:tasks.workunit.client.1.smithi174.stdout:6/150: dread d0/df/f29 [638976,65536] 0 2024-05-06T14:04:02.754 INFO:tasks.workunit.client.1.smithi174.stdout:9/94: dread - dc/d14/f16 zero size 2024-05-06T14:04:02.754 INFO:tasks.workunit.client.1.smithi174.stdout:1/78: link l2 d11/l1d 0 2024-05-06T14:04:02.754 INFO:tasks.workunit.client.1.smithi174.stdout:7/65: mkdir d0/d3/d14 0 2024-05-06T14:04:02.754 INFO:tasks.workunit.client.1.smithi174.stdout:6/151: unlink d0/df/c1d 0 2024-05-06T14:04:02.754 INFO:tasks.workunit.client.1.smithi174.stdout:2/80: dwrite d0/d1/f5 [1560576,16384] 0 2024-05-06T14:04:02.754 INFO:tasks.workunit.client.1.smithi174.stdout:3/142: creat df/d10/d1b/f33 x:0 0 0 2024-05-06T14:04:02.754 INFO:tasks.workunit.client.1.smithi174.stdout:6/152: chown d0/df 16195044 1 2024-05-06T14:04:02.755 INFO:tasks.workunit.client.1.smithi174.stdout:7/66: rename d0/d3/fd to d0/da/d11/f15 0 2024-05-06T14:04:02.755 INFO:tasks.workunit.client.1.smithi174.stdout:0/79: unlink d0/d3/dc/f12 0 2024-05-06T14:04:02.755 INFO:tasks.workunit.client.1.smithi174.stdout:7/67: chown d0/da/d11 24208145 1 2024-05-06T14:04:02.755 INFO:tasks.workunit.client.1.smithi174.stdout:6/153: mknod d0/d25/c33 0 2024-05-06T14:04:02.755 INFO:tasks.workunit.client.1.smithi174.stdout:3/143: getdents df 0 2024-05-06T14:04:02.755 INFO:tasks.workunit.client.1.smithi174.stdout:7/68: link d0/d3/f10 d0/da/f16 0 2024-05-06T14:04:02.755 INFO:tasks.workunit.client.1.smithi174.stdout:3/144: truncate df/d10/d1b/f2b 327949 0 2024-05-06T14:04:02.755 INFO:tasks.workunit.client.1.smithi174.stdout:7/69: dread - d0/f6 zero size 2024-05-06T14:04:02.755 INFO:tasks.workunit.client.1.smithi174.stdout:2/81: mkdir d0/db/d15 0 2024-05-06T14:04:02.756 INFO:tasks.workunit.client.1.smithi174.stdout:3/145: readlink df/d2d/l30 0 2024-05-06T14:04:02.756 INFO:tasks.workunit.client.1.smithi174.stdout:7/70: read - d0/f6 zero size 2024-05-06T14:04:02.756 INFO:tasks.workunit.client.1.smithi174.stdout:5/100: creat d1/d6/da/de/f26 x:0 0 0 2024-05-06T14:04:02.756 INFO:tasks.workunit.client.1.smithi174.stdout:3/146: rename df/d2d/l2e to df/d10/l34 0 2024-05-06T14:04:02.756 INFO:tasks.workunit.client.1.smithi174.stdout:9/95: write f1 [237011,104724] 0 2024-05-06T14:04:02.756 INFO:tasks.workunit.client.1.smithi174.stdout:7/71: write d0/f6 [159916,12265] 0 2024-05-06T14:04:02.756 INFO:tasks.workunit.client.1.smithi174.stdout:2/82: write d0/d1/d2/d4/d6/f7 [915771,22534] 0 2024-05-06T14:04:02.756 INFO:tasks.workunit.client.1.smithi174.stdout:9/96: symlink dc/df/l21 0 2024-05-06T14:04:02.757 INFO:tasks.workunit.client.1.smithi174.stdout:3/147: read df/d10/f14 [522249,127196] 0 2024-05-06T14:04:02.757 INFO:tasks.workunit.client.1.smithi174.stdout:7/72: write d0/f6 [1194895,105862] 0 2024-05-06T14:04:02.757 INFO:tasks.workunit.client.1.smithi174.stdout:3/148: symlink df/d2d/l35 0 2024-05-06T14:04:02.848 INFO:tasks.workunit.client.1.smithi174.stdout:1/79: fdatasync f5 0 2024-05-06T14:04:02.848 INFO:tasks.workunit.client.1.smithi174.stdout:1/80: write f1 [870806,119650] 0 2024-05-06T14:04:02.848 INFO:tasks.workunit.client.1.smithi174.stdout:1/81: rename lf to d11/l1e 0 2024-05-06T14:04:02.848 INFO:tasks.workunit.client.1.smithi174.stdout:0/80: fdatasync d0/d4/d8/d9/d17/f15 0 2024-05-06T14:04:02.848 INFO:tasks.workunit.client.1.smithi174.stdout:1/82: getdents d11 0 2024-05-06T14:04:02.848 INFO:tasks.workunit.client.1.smithi174.stdout:7/73: dwrite d0/d3/f10 [1060864,73728] 0 2024-05-06T14:04:02.848 INFO:tasks.workunit.client.1.smithi174.stdout:7/74: creat d0/da/f17 x:0 0 0 2024-05-06T14:04:02.849 INFO:tasks.workunit.client.1.smithi174.stdout:7/75: chown d0/d3/f10 2 1 2024-05-06T14:04:02.849 INFO:tasks.workunit.client.1.smithi174.stdout:7/76: chown d0/da/d11/l12 253 1 2024-05-06T14:04:02.851 INFO:tasks.workunit.client.1.smithi174.stdout:6/154: dwrite d0/df/f18 [1245184,32768] 0 2024-05-06T14:04:02.851 INFO:tasks.workunit.client.1.smithi174.stdout:2/83: dwrite d0/d1/d2/d4/d6/fe [339968,45056] 0 2024-05-06T14:04:02.852 INFO:tasks.workunit.client.1.smithi174.stdout:2/84: stat d0/d1/d2/ld 0 2024-05-06T14:04:02.852 INFO:tasks.workunit.client.1.smithi174.stdout:2/85: mkdir d0/d16 0 2024-05-06T14:04:02.852 INFO:tasks.workunit.client.1.smithi174.stdout:2/86: creat d0/d1/d2/f17 x:0 0 0 2024-05-06T14:04:02.852 INFO:tasks.workunit.client.1.smithi174.stdout:3/149: dwrite df/d10/d1b/f33 [253952,49152] 0 2024-05-06T14:04:02.852 INFO:tasks.workunit.client.1.smithi174.stdout:9/97: truncate fa 301922 0 2024-05-06T14:04:02.852 INFO:tasks.workunit.client.1.smithi174.stdout:0/81: dread d0/d4/d8/d9/f13 [958464,57344] 0 2024-05-06T14:04:02.852 INFO:tasks.workunit.client.1.smithi174.stdout:0/82: rename d0/d4/d8/d9 to d0/d1a 0 2024-05-06T14:04:02.852 INFO:tasks.workunit.client.1.smithi174.stdout:7/77: dread d0/fe [1306624,110592] 0 2024-05-06T14:04:02.853 INFO:tasks.workunit.client.1.smithi174.stdout:7/78: truncate d0/da/d11/f13 523810 0 2024-05-06T14:04:02.853 INFO:tasks.workunit.client.1.smithi174.stdout:7/79: creat d0/d3/d14/f18 x:0 0 0 2024-05-06T14:04:02.853 INFO:tasks.workunit.client.1.smithi174.stdout:7/80: mkdir d0/da/d19 0 2024-05-06T14:04:02.853 INFO:tasks.workunit.client.1.smithi174.stdout:7/81: creat d0/d3/f1a x:0 0 0 2024-05-06T14:04:02.853 INFO:tasks.workunit.client.1.smithi174.stdout:7/82: dread d0/d3/f10 [36864,57344] 0 2024-05-06T14:04:02.853 INFO:tasks.workunit.client.1.smithi174.stdout:7/83: write d0/d3/f10 [2172223,63730] 0 2024-05-06T14:04:02.853 INFO:tasks.workunit.client.1.smithi174.stdout:7/84: write d0/da/d11/f15 [1496368,101824] 0 2024-05-06T14:04:02.853 INFO:tasks.workunit.client.1.smithi174.stdout:7/85: read d0/f5 [1098540,123069] 0 2024-05-06T14:04:02.854 INFO:tasks.workunit.client.1.smithi174.stdout:7/86: dread - d0/d3/d14/f18 zero size 2024-05-06T14:04:02.854 INFO:tasks.workunit.client.1.smithi174.stdout:7/87: link d0/f5 d0/d3/f1b 0 2024-05-06T14:04:02.904 INFO:tasks.workunit.client.1.smithi174.stdout:8/158: fsync d4/de/d24/f2e 0 2024-05-06T14:04:02.904 INFO:tasks.workunit.client.1.smithi174.stdout:3/150: fsync fc 0 2024-05-06T14:04:02.904 INFO:tasks.workunit.client.1.smithi174.stdout:3/151: stat df/d10/f14 0 2024-05-06T14:04:02.907 INFO:tasks.workunit.client.1.smithi174.stdout:6/155: dwrite d0/df/f29 [421888,110592] 0 2024-05-06T14:04:02.907 INFO:tasks.workunit.client.1.smithi174.stdout:7/88: dwrite d0/d3/f7 [876544,81920] 0 2024-05-06T14:04:02.907 INFO:tasks.workunit.client.1.smithi174.stdout:0/83: dwrite d0/d1a/d17/ff [114688,12288] 0 2024-05-06T14:04:02.908 INFO:tasks.workunit.client.1.smithi174.stdout:1/83: dread f1 [897024,53248] 0 2024-05-06T14:04:02.908 INFO:tasks.workunit.client.1.smithi174.stdout:7/89: chown d0/d3/lc 6524763 1 2024-05-06T14:04:02.908 INFO:tasks.workunit.client.1.smithi174.stdout:0/84: chown d0/fa 22012 1 2024-05-06T14:04:02.908 INFO:tasks.workunit.client.1.smithi174.stdout:1/84: chown d11/l1e 14 1 2024-05-06T14:04:02.908 INFO:tasks.workunit.client.1.smithi174.stdout:1/85: readlink d11/l1c 0 2024-05-06T14:04:02.908 INFO:tasks.workunit.client.1.smithi174.stdout:0/85: link d0/d1a/d17/f15 d0/d1a/f1b 0 2024-05-06T14:04:02.908 INFO:tasks.workunit.client.1.smithi174.stdout:0/86: rmdir d0 39 2024-05-06T14:04:02.909 INFO:tasks.workunit.client.1.smithi174.stdout:0/87: read - d0/d1a/d17/f15 zero size 2024-05-06T14:04:02.909 INFO:tasks.workunit.client.1.smithi174.stdout:1/86: dread d11/f1a [688128,4096] 0 2024-05-06T14:04:02.909 INFO:tasks.workunit.client.1.smithi174.stdout:6/156: symlink d0/df/d22/l34 0 2024-05-06T14:04:02.909 INFO:tasks.workunit.client.1.smithi174.stdout:3/152: write f5 [72023,125312] 0 2024-05-06T14:04:02.909 INFO:tasks.workunit.client.1.smithi174.stdout:6/157: mkdir d0/d25/d35 0 2024-05-06T14:04:02.909 INFO:tasks.workunit.client.1.smithi174.stdout:3/153: dread - df/d10/d1b/f24 zero size 2024-05-06T14:04:02.909 INFO:tasks.workunit.client.1.smithi174.stdout:6/158: rmdir d0 39 2024-05-06T14:04:02.909 INFO:tasks.workunit.client.1.smithi174.stdout:8/159: write d4/f28 [255969,111874] 0 2024-05-06T14:04:02.909 INFO:tasks.workunit.client.1.smithi174.stdout:6/159: symlink d0/df/d22/d2c/l36 0 2024-05-06T14:04:02.910 INFO:tasks.workunit.client.1.smithi174.stdout:3/154: creat df/d2d/f36 x:0 0 0 2024-05-06T14:04:02.910 INFO:tasks.workunit.client.1.smithi174.stdout:6/160: dread - d0/f26 zero size 2024-05-06T14:04:02.910 INFO:tasks.workunit.client.1.smithi174.stdout:3/155: unlink df/d10/f12 0 2024-05-06T14:04:02.910 INFO:tasks.workunit.client.1.smithi174.stdout:6/161: creat d0/df/d22/d2c/f37 x:0 0 0 2024-05-06T14:04:02.910 INFO:tasks.workunit.client.1.smithi174.stdout:9/98: dwrite fa [299008,49152] 0 2024-05-06T14:04:02.910 INFO:tasks.workunit.client.1.smithi174.stdout:9/99: unlink dc/cd 0 2024-05-06T14:04:02.910 INFO:tasks.workunit.client.1.smithi174.stdout:9/100: rmdir dc 39 2024-05-06T14:04:02.910 INFO:tasks.workunit.client.1.smithi174.stdout:9/101: symlink dc/de/l22 0 2024-05-06T14:04:02.911 INFO:tasks.workunit.client.1.smithi174.stdout:9/102: symlink dc/df/l23 0 2024-05-06T14:04:02.911 INFO:tasks.workunit.client.1.smithi174.stdout:9/103: readlink dc/df/l21 0 2024-05-06T14:04:02.936 INFO:tasks.workunit.client.1.smithi174.stdout:3/156: dwrite df/d10/d1b/f22 [1376256,110592] 0 2024-05-06T14:04:02.937 INFO:tasks.workunit.client.1.smithi174.stdout:7/90: dwrite d0/da/fb [495616,49152] 0 2024-05-06T14:04:02.937 INFO:tasks.workunit.client.1.smithi174.stdout:7/91: rename d0/d3/d14/f18 to d0/da/d19/f1c 0 2024-05-06T14:04:02.937 INFO:tasks.workunit.client.1.smithi174.stdout:7/92: unlink d0/da/f17 0 2024-05-06T14:04:02.937 INFO:tasks.workunit.client.1.smithi174.stdout:7/93: rmdir d0/da 39 2024-05-06T14:04:02.937 INFO:tasks.workunit.client.1.smithi174.stdout:0/88: dread d0/d1a/d17/ff [1052672,61440] 0 2024-05-06T14:04:02.937 INFO:tasks.workunit.client.1.smithi174.stdout:7/94: write d0/f6 [81899,81744] 0 2024-05-06T14:04:02.937 INFO:tasks.workunit.client.1.smithi174.stdout:7/95: mkdir d0/d1d 0 2024-05-06T14:04:02.937 INFO:tasks.workunit.client.1.smithi174.stdout:7/96: dread d0/da/d11/f15 [708608,4096] 0 2024-05-06T14:04:02.938 INFO:tasks.workunit.client.1.smithi174.stdout:7/97: rename d0/da/d11/f13 to d0/d1d/f1e 0 2024-05-06T14:04:02.998 INFO:tasks.workunit.client.1.smithi174.stdout:2/87: fdatasync d0/d1/d2/d4/d6/fe 0 2024-05-06T14:04:03.002 INFO:tasks.workunit.client.1.smithi174.stdout:5/101: sync 2024-05-06T14:04:03.002 INFO:tasks.workunit.client.1.smithi174.stdout:4/66: sync 2024-05-06T14:04:03.004 INFO:tasks.workunit.client.1.smithi174.stdout:3/157: dwrite f2 [606208,118784] 0 2024-05-06T14:04:03.004 INFO:tasks.workunit.client.1.smithi174.stdout:4/67: mknod d1/d1a/c1b 0 2024-05-06T14:04:03.004 INFO:tasks.workunit.client.1.smithi174.stdout:0/89: dwrite d0/d1a/d17/fe [724992,57344] 0 2024-05-06T14:04:03.004 INFO:tasks.workunit.client.1.smithi174.stdout:2/88: unlink d0/d1/d2/ff 0 2024-05-06T14:04:03.005 INFO:tasks.workunit.client.1.smithi174.stdout:2/89: truncate d0/d1/d2/f17 75670 0 2024-05-06T14:04:03.005 INFO:tasks.workunit.client.1.smithi174.stdout:0/90: rename d0/d4/c14 to d0/d1a/d17/c1c 0 2024-05-06T14:04:03.005 INFO:tasks.workunit.client.1.smithi174.stdout:2/90: dread d0/d1/d2/d4/d6/f7 [753664,4096] 0 2024-05-06T14:04:03.005 INFO:tasks.workunit.client.1.smithi174.stdout:5/102: dwrite d1/d6/da/f25 [823296,94208] 0 2024-05-06T14:04:03.005 INFO:tasks.workunit.client.1.smithi174.stdout:5/103: mkdir d1/d6/d7/d27 0 2024-05-06T14:04:03.005 INFO:tasks.workunit.client.1.smithi174.stdout:5/104: creat d1/d6/da/f28 x:0 0 0 2024-05-06T14:04:03.006 INFO:tasks.workunit.client.1.smithi174.stdout:5/105: chown d1/d6/da/db/f1d 69 1 2024-05-06T14:04:03.059 INFO:tasks.workunit.client.1.smithi174.stdout:4/68: fsync d1/d9/fe 0 2024-05-06T14:04:03.059 INFO:tasks.workunit.client.1.smithi174.stdout:4/69: getdents d1/d9/d15 0 2024-05-06T14:04:03.059 INFO:tasks.workunit.client.1.smithi174.stdout:4/70: rename d1/f10 to d1/d1a/f1c 0 2024-05-06T14:04:03.059 INFO:tasks.workunit.client.1.smithi174.stdout:4/71: getdents d1/d1a 0 2024-05-06T14:04:03.059 INFO:tasks.workunit.client.1.smithi174.stdout:4/72: creat d1/f1d x:0 0 0 2024-05-06T14:04:03.060 INFO:tasks.workunit.client.1.smithi174.stdout:5/106: fdatasync d1/d6/da/fd 0 2024-05-06T14:04:03.060 INFO:tasks.workunit.client.1.smithi174.stdout:5/107: chown d1/f10 7663246 1 2024-05-06T14:04:03.060 INFO:tasks.workunit.client.1.smithi174.stdout:5/108: creat d1/d6/da/db/d1e/f29 x:0 0 0 2024-05-06T14:04:03.060 INFO:tasks.workunit.client.1.smithi174.stdout:5/109: mkdir d1/d6/d2a 0 2024-05-06T14:04:03.060 INFO:tasks.workunit.client.1.smithi174.stdout:5/110: read - d1/d6/da/db/f1d zero size 2024-05-06T14:04:03.060 INFO:tasks.workunit.client.1.smithi174.stdout:3/158: dwrite df/d10/f1c [544768,24576] 0 2024-05-06T14:04:03.060 INFO:tasks.workunit.client.1.smithi174.stdout:3/159: rename f9 to df/d2d/f37 0 2024-05-06T14:04:03.060 INFO:tasks.workunit.client.1.smithi174.stdout:3/160: creat df/d2d/f38 x:0 0 0 2024-05-06T14:04:03.061 INFO:tasks.workunit.client.1.smithi174.stdout:3/161: creat df/d2d/f39 x:0 0 0 2024-05-06T14:04:03.061 INFO:tasks.workunit.client.1.smithi174.stdout:3/162: read fe [362382,126359] 0 2024-05-06T14:04:03.061 INFO:tasks.workunit.client.1.smithi174.stdout:3/163: creat df/d10/f3a x:0 0 0 2024-05-06T14:04:03.061 INFO:tasks.workunit.client.1.smithi174.stdout:2/91: dwrite d0/d1/d2/f17 [143360,94208] 0 2024-05-06T14:04:03.061 INFO:tasks.workunit.client.1.smithi174.stdout:4/73: dwrite d1/f1d [1007616,4096] 0 2024-05-06T14:04:03.061 INFO:tasks.workunit.client.1.smithi174.stdout:2/92: mkdir d0/d1/d2/d4/d18 0 2024-05-06T14:04:03.061 INFO:tasks.workunit.client.1.smithi174.stdout:2/93: chown d0/d1/d2/d4/d18 139 1 2024-05-06T14:04:03.061 INFO:tasks.workunit.client.1.smithi174.stdout:2/94: creat d0/d16/f19 x:0 0 0 2024-05-06T14:04:03.062 INFO:tasks.workunit.client.1.smithi174.stdout:0/91: dwrite d0/d1a/d17/f15 [978944,94208] 0 2024-05-06T14:04:03.062 INFO:tasks.workunit.client.1.smithi174.stdout:3/164: dwrite fc [1667072,12288] 0 2024-05-06T14:04:03.062 INFO:tasks.workunit.client.1.smithi174.stdout:3/165: chown df/d10/l29 45625601 1 2024-05-06T14:04:03.062 INFO:tasks.workunit.client.1.smithi174.stdout:3/166: write f5 [567003,82062] 0 2024-05-06T14:04:03.062 INFO:tasks.workunit.client.1.smithi174.stdout:3/167: creat df/d10/f3b x:0 0 0 2024-05-06T14:04:03.062 INFO:tasks.workunit.client.1.smithi174.stdout:3/168: mknod df/d10/c3c 0 2024-05-06T14:04:03.062 INFO:tasks.workunit.client.1.smithi174.stdout:3/169: symlink df/d10/d1b/l3d 0 2024-05-06T14:04:03.062 INFO:tasks.workunit.client.1.smithi174.stdout:3/170: rmdir df 39 2024-05-06T14:04:03.063 INFO:tasks.workunit.client.1.smithi174.stdout:3/171: chown f7 2965 1 2024-05-06T14:04:03.063 INFO:tasks.workunit.client.1.smithi174.stdout:3/172: mknod df/d2d/c3e 0 2024-05-06T14:04:03.063 INFO:tasks.workunit.client.1.smithi174.stdout:3/173: truncate df/d10/d1b/f20 916089 0 2024-05-06T14:04:03.063 INFO:tasks.workunit.client.1.smithi174.stdout:3/174: dread - df/d10/f19 zero size 2024-05-06T14:04:03.063 INFO:tasks.workunit.client.1.smithi174.stdout:3/175: read - df/d10/f3b zero size 2024-05-06T14:04:03.085 INFO:tasks.workunit.client.1.smithi174.stdout:8/160: fsync d4/f28 0 2024-05-06T14:04:03.085 INFO:tasks.workunit.client.1.smithi174.stdout:7/98: fsync d0/fe 0 2024-05-06T14:04:03.085 INFO:tasks.workunit.client.1.smithi174.stdout:8/161: stat d4/ld 0 2024-05-06T14:04:03.085 INFO:tasks.workunit.client.1.smithi174.stdout:3/176: fsync df/d10/f14 0 2024-05-06T14:04:03.085 INFO:tasks.workunit.client.1.smithi174.stdout:3/177: chown df/d10/l23 54 1 2024-05-06T14:04:03.088 INFO:tasks.workunit.client.1.smithi174.stdout:2/95: dread d0/d1/d2/f17 [221184,69632] 0 2024-05-06T14:04:03.088 INFO:tasks.workunit.client.1.smithi174.stdout:7/99: link d0/da/d11/l12 d0/d3/d14/l1f 0 2024-05-06T14:04:03.089 INFO:tasks.workunit.client.1.smithi174.stdout:4/74: dwrite d1/d9/ff [167936,118784] 0 2024-05-06T14:04:03.089 INFO:tasks.workunit.client.1.smithi174.stdout:7/100: chown d0/fe 492551638 1 2024-05-06T14:04:03.089 INFO:tasks.workunit.client.1.smithi174.stdout:7/101: getdents d0/d3 0 2024-05-06T14:04:03.089 INFO:tasks.workunit.client.1.smithi174.stdout:4/75: symlink d1/d9/d15/l1e 0 2024-05-06T14:04:03.089 INFO:tasks.workunit.client.1.smithi174.stdout:7/102: truncate d0/f5 693391 0 2024-05-06T14:04:03.089 INFO:tasks.workunit.client.1.smithi174.stdout:4/76: chown d1/c2 19097336 1 2024-05-06T14:04:03.089 INFO:tasks.workunit.client.1.smithi174.stdout:7/103: dread - d0/d3/f1a zero size 2024-05-06T14:04:03.089 INFO:tasks.workunit.client.1.smithi174.stdout:4/77: dread d1/d9/ff [45056,110592] 0 2024-05-06T14:04:03.090 INFO:tasks.workunit.client.1.smithi174.stdout:4/78: mkdir d1/d1f 0 2024-05-06T14:04:03.090 INFO:tasks.workunit.client.1.smithi174.stdout:4/79: creat d1/d9/f20 x:0 0 0 2024-05-06T14:04:03.090 INFO:tasks.workunit.client.1.smithi174.stdout:4/80: dread - d1/d1a/f1c zero size 2024-05-06T14:04:03.090 INFO:tasks.workunit.client.1.smithi174.stdout:4/81: creat d1/d9/d15/f21 x:0 0 0 2024-05-06T14:04:03.090 INFO:tasks.workunit.client.1.smithi174.stdout:4/82: chown c0 1486 1 2024-05-06T14:04:03.090 INFO:tasks.workunit.client.1.smithi174.stdout:4/83: creat d1/d9/f22 x:0 0 0 2024-05-06T14:04:03.090 INFO:tasks.workunit.client.1.smithi174.stdout:4/84: creat d1/d9/f23 x:0 0 0 2024-05-06T14:04:03.090 INFO:tasks.workunit.client.1.smithi174.stdout:4/85: symlink d1/d9/l24 0 2024-05-06T14:04:03.091 INFO:tasks.workunit.client.1.smithi174.stdout:4/86: mkdir d1/d9/d25 0 2024-05-06T14:04:03.091 INFO:tasks.workunit.client.1.smithi174.stdout:4/87: truncate d1/d9/f23 818344 0 2024-05-06T14:04:03.091 INFO:tasks.workunit.client.1.smithi174.stdout:8/162: dwrite d4/de/d24/f2e [1572864,49152] 0 2024-05-06T14:04:03.091 INFO:tasks.workunit.client.1.smithi174.stdout:4/88: creat d1/d1a/f26 x:0 0 0 2024-05-06T14:04:03.091 INFO:tasks.workunit.client.1.smithi174.stdout:4/89: mkdir d1/d1f/d27 0 2024-05-06T14:04:03.091 INFO:tasks.workunit.client.1.smithi174.stdout:8/163: creat d4/d15/d20/f31 x:0 0 0 2024-05-06T14:04:03.091 INFO:tasks.workunit.client.1.smithi174.stdout:8/164: read - d4/d15/d20/f31 zero size 2024-05-06T14:04:03.091 INFO:tasks.workunit.client.1.smithi174.stdout:8/165: truncate d4/de/f17 2793052 0 2024-05-06T14:04:03.092 INFO:tasks.workunit.client.1.smithi174.stdout:8/166: creat d4/de/d23/f32 x:0 0 0 2024-05-06T14:04:03.092 INFO:tasks.workunit.client.1.smithi174.stdout:8/167: dread - d4/de/d24/f2f zero size 2024-05-06T14:04:03.092 INFO:tasks.workunit.client.1.smithi174.stdout:8/168: unlink d4/d15/d20/f31 0 2024-05-06T14:04:03.092 INFO:tasks.workunit.client.1.smithi174.stdout:8/169: getdents d4/de/d24 0 2024-05-06T14:04:03.092 INFO:tasks.workunit.client.1.smithi174.stdout:8/170: creat d4/de/d24/f33 x:0 0 0 2024-05-06T14:04:03.099 INFO:tasks.workunit.client.1.smithi174.stdout:0/92: read d0/fa [1963175,103117] 0 2024-05-06T14:04:03.100 INFO:tasks.workunit.client.1.smithi174.stdout:0/93: dread d0/d1a/f1b [249856,53248] 0 2024-05-06T14:04:03.128 INFO:tasks.workunit.client.1.smithi174.stdout:7/104: rename d0/d3/f7 to d0/da/d11/f20 0 2024-05-06T14:04:03.128 INFO:tasks.workunit.client.1.smithi174.stdout:0/94: dwrite d0/d1a/d17/f15 [835584,65536] 0 2024-05-06T14:04:03.128 INFO:tasks.workunit.client.1.smithi174.stdout:0/95: write d0/fa [573238,59799] 0 2024-05-06T14:04:03.194 INFO:tasks.workunit.client.1.smithi174.stdout:4/90: fsync d1/fc 0 2024-05-06T14:04:03.194 INFO:tasks.workunit.client.1.smithi174.stdout:4/91: stat d1/d9/f23 0 2024-05-06T14:04:03.194 INFO:tasks.workunit.client.1.smithi174.stdout:5/111: fsync d1/d6/da/f28 0 2024-05-06T14:04:03.194 INFO:tasks.workunit.client.1.smithi174.stdout:4/92: creat d1/d1a/f28 x:0 0 0 2024-05-06T14:04:03.195 INFO:tasks.workunit.client.1.smithi174.stdout:5/112: read d1/d6/da/fd [2168831,17057] 0 2024-05-06T14:04:03.195 INFO:tasks.workunit.client.1.smithi174.stdout:0/96: fdatasync d0/d1a/d17/ff 0 2024-05-06T14:04:03.195 INFO:tasks.workunit.client.1.smithi174.stdout:5/113: dread d1/d6/fc [1572864,45056] 0 2024-05-06T14:04:03.200 INFO:tasks.workunit.client.1.smithi174.stdout:4/93: mknod d1/d9/d15/c29 0 2024-05-06T14:04:03.200 INFO:tasks.workunit.client.1.smithi174.stdout:7/105: dwrite d0/d3/f1a [552960,16384] 0 2024-05-06T14:04:03.201 INFO:tasks.workunit.client.1.smithi174.stdout:4/94: stat d1/d1a/c1b 0 2024-05-06T14:04:03.201 INFO:tasks.workunit.client.1.smithi174.stdout:4/95: getdents d1/d1f/d27 0 2024-05-06T14:04:03.201 INFO:tasks.workunit.client.1.smithi174.stdout:4/96: rmdir d1/d9/d15 39 2024-05-06T14:04:03.201 INFO:tasks.workunit.client.1.smithi174.stdout:5/114: write d1/d6/da/db/f1a [697520,26693] 0 2024-05-06T14:04:03.201 INFO:tasks.workunit.client.1.smithi174.stdout:7/106: creat d0/d3/d14/f21 x:0 0 0 2024-05-06T14:04:03.201 INFO:tasks.workunit.client.1.smithi174.stdout:4/97: symlink d1/l2a 0 2024-05-06T14:04:03.201 INFO:tasks.workunit.client.1.smithi174.stdout:7/107: symlink d0/d1d/l22 0 2024-05-06T14:04:03.201 INFO:tasks.workunit.client.1.smithi174.stdout:7/108: symlink d0/d3/l23 0 2024-05-06T14:04:03.201 INFO:tasks.workunit.client.1.smithi174.stdout:7/109: write d0/fe [1638151,87543] 0 2024-05-06T14:04:03.202 INFO:tasks.workunit.client.1.smithi174.stdout:4/98: write d1/d9/fe [1652092,118956] 0 2024-05-06T14:04:03.202 INFO:tasks.workunit.client.1.smithi174.stdout:4/99: dread - d1/d1a/f28 zero size 2024-05-06T14:04:03.202 INFO:tasks.workunit.client.1.smithi174.stdout:4/100: creat d1/d9/f2b x:0 0 0 2024-05-06T14:04:03.202 INFO:tasks.workunit.client.1.smithi174.stdout:0/97: rename d0/d3/c6 to d0/d3/dc/c1d 0 2024-05-06T14:04:03.202 INFO:tasks.workunit.client.1.smithi174.stdout:5/115: mknod d1/d6/da/c2b 0 2024-05-06T14:04:03.202 INFO:tasks.workunit.client.1.smithi174.stdout:5/116: write d1/f10 [3062079,64085] 0 2024-05-06T14:04:03.202 INFO:tasks.workunit.client.1.smithi174.stdout:6/162: sync 2024-05-06T14:04:03.203 INFO:tasks.workunit.client.1.smithi174.stdout:1/87: sync 2024-05-06T14:04:03.203 INFO:tasks.workunit.client.1.smithi174.stdout:9/104: sync 2024-05-06T14:04:03.203 INFO:tasks.workunit.client.1.smithi174.stdout:1/88: chown f1 1988 1 2024-05-06T14:04:03.203 INFO:tasks.workunit.client.1.smithi174.stdout:1/89: chown fb 340 1 2024-05-06T14:04:03.203 INFO:tasks.workunit.client.1.smithi174.stdout:9/105: dread dc/df/f11 [315392,40960] 0 2024-05-06T14:04:03.203 INFO:tasks.workunit.client.1.smithi174.stdout:6/163: symlink d0/df/d22/l38 0 2024-05-06T14:04:03.203 INFO:tasks.workunit.client.1.smithi174.stdout:6/164: chown d0/df/f20 427654 1 2024-05-06T14:04:03.203 INFO:tasks.workunit.client.1.smithi174.stdout:1/90: mkdir d11/d1f 0 2024-05-06T14:04:03.204 INFO:tasks.workunit.client.1.smithi174.stdout:1/91: creat d11/f20 x:0 0 0 2024-05-06T14:04:03.204 INFO:tasks.workunit.client.1.smithi174.stdout:1/92: mknod d11/c21 0 2024-05-06T14:04:03.204 INFO:tasks.workunit.client.1.smithi174.stdout:6/165: dread d0/df/f24 [937984,126976] 0 2024-05-06T14:04:03.204 INFO:tasks.workunit.client.1.smithi174.stdout:1/93: creat d11/f22 x:0 0 0 2024-05-06T14:04:03.204 INFO:tasks.workunit.client.1.smithi174.stdout:6/166: getdents d0/d25 0 2024-05-06T14:04:03.204 INFO:tasks.workunit.client.1.smithi174.stdout:6/167: link d0/df/d22/l32 d0/df/d22/l39 0 2024-05-06T14:04:03.204 INFO:tasks.workunit.client.1.smithi174.stdout:1/94: symlink d11/l23 0 2024-05-06T14:04:03.204 INFO:tasks.workunit.client.1.smithi174.stdout:6/168: creat d0/f3a x:0 0 0 2024-05-06T14:04:03.204 INFO:tasks.workunit.client.1.smithi174.stdout:1/95: creat d11/f24 x:0 0 0 2024-05-06T14:04:03.205 INFO:tasks.workunit.client.1.smithi174.stdout:6/169: mkdir d0/df/d22/d3b 0 2024-05-06T14:04:03.205 INFO:tasks.workunit.client.1.smithi174.stdout:6/170: stat d0/df/d22/d2c/l36 0 2024-05-06T14:04:03.205 INFO:tasks.workunit.client.1.smithi174.stdout:1/96: symlink d11/d1f/l25 0 2024-05-06T14:04:03.205 INFO:tasks.workunit.client.1.smithi174.stdout:1/97: rename d11/l1e to d11/l26 0 2024-05-06T14:04:03.205 INFO:tasks.workunit.client.1.smithi174.stdout:6/171: mkdir d0/df/d3c 0 2024-05-06T14:04:03.205 INFO:tasks.workunit.client.1.smithi174.stdout:1/98: getdents d11/d1f 0 2024-05-06T14:04:03.205 INFO:tasks.workunit.client.1.smithi174.stdout:6/172: dread d0/df/f24 [729088,106496] 0 2024-05-06T14:04:03.205 INFO:tasks.workunit.client.1.smithi174.stdout:1/99: mkdir d11/d1f/d27 0 2024-05-06T14:04:03.206 INFO:tasks.workunit.client.1.smithi174.stdout:1/100: mknod d11/d1f/c28 0 2024-05-06T14:04:03.206 INFO:tasks.workunit.client.1.smithi174.stdout:1/101: link d11/l17 d11/d1f/l29 0 2024-05-06T14:04:03.206 INFO:tasks.workunit.client.1.smithi174.stdout:1/102: chown d11/d1f/l25 1 1 2024-05-06T14:04:03.206 INFO:tasks.workunit.client.1.smithi174.stdout:6/173: write d0/df/f20 [490704,88699] 0 2024-05-06T14:04:03.206 INFO:tasks.workunit.client.1.smithi174.stdout:1/103: symlink d11/d1f/l2a 0 2024-05-06T14:04:03.206 INFO:tasks.workunit.client.1.smithi174.stdout:1/104: chown d11/f24 1351 1 2024-05-06T14:04:03.206 INFO:tasks.workunit.client.1.smithi174.stdout:1/105: dread - d11/f24 zero size 2024-05-06T14:04:03.206 INFO:tasks.workunit.client.1.smithi174.stdout:1/106: write fb [517673,117771] 0 2024-05-06T14:04:03.207 INFO:tasks.workunit.client.1.smithi174.stdout:1/107: creat d11/d1f/d27/f2b x:0 0 0 2024-05-06T14:04:03.244 INFO:tasks.workunit.client.1.smithi174.stdout:7/110: dwrite d0/da/d11/f20 [2121728,45056] 0 2024-05-06T14:04:03.244 INFO:tasks.workunit.client.1.smithi174.stdout:7/111: truncate d0/da/fb 716465 0 2024-05-06T14:04:03.244 INFO:tasks.workunit.client.1.smithi174.stdout:7/112: rename d0/d3 to d0/da/d19/d24 0 2024-05-06T14:04:03.244 INFO:tasks.workunit.client.1.smithi174.stdout:7/113: write d0/fe [2671000,47579] 0 2024-05-06T14:04:03.244 INFO:tasks.workunit.client.1.smithi174.stdout:7/114: rename d0/da/d19/d24/lc to d0/da/l25 0 2024-05-06T14:04:03.244 INFO:tasks.workunit.client.1.smithi174.stdout:7/115: link d0/da/d19/d24/d14/l1f d0/l26 0 2024-05-06T14:04:03.244 INFO:tasks.workunit.client.1.smithi174.stdout:7/116: write d0/da/d19/f1c [736904,117443] 0 2024-05-06T14:04:03.246 INFO:tasks.workunit.client.1.smithi174.stdout:4/101: dwrite d1/d9/fe [2326528,118784] 0 2024-05-06T14:04:03.246 INFO:tasks.workunit.client.1.smithi174.stdout:4/102: rmdir d1/d9/d15 39 2024-05-06T14:04:03.246 INFO:tasks.workunit.client.1.smithi174.stdout:4/103: mkdir d1/d1f/d27/d2c 0 2024-05-06T14:04:03.246 INFO:tasks.workunit.client.1.smithi174.stdout:0/98: dwrite d0/d1a/f13 [2015232,106496] 0 2024-05-06T14:04:03.246 INFO:tasks.workunit.client.1.smithi174.stdout:0/99: chown d0/d1a/f13 6 1 2024-05-06T14:04:03.246 INFO:tasks.workunit.client.1.smithi174.stdout:0/100: chown d0/d1a 0 1 2024-05-06T14:04:03.247 INFO:tasks.workunit.client.1.smithi174.stdout:0/101: chown d0/d4/d8 30685766 1 2024-05-06T14:04:03.247 INFO:tasks.workunit.client.1.smithi174.stdout:0/102: creat d0/d1a/f1e x:0 0 0 2024-05-06T14:04:03.247 INFO:tasks.workunit.client.1.smithi174.stdout:0/103: read d0/d1a/d17/fe [33525,63752] 0 2024-05-06T14:04:03.247 INFO:tasks.workunit.client.1.smithi174.stdout:0/104: link d0/d1a/f13 d0/d1a/f1f 0 2024-05-06T14:04:03.247 INFO:tasks.workunit.client.1.smithi174.stdout:0/105: stat d0/d1a/f1f 0 2024-05-06T14:04:03.247 INFO:tasks.workunit.client.1.smithi174.stdout:0/106: creat d0/d16/f20 x:0 0 0 2024-05-06T14:04:03.247 INFO:tasks.workunit.client.1.smithi174.stdout:0/107: stat d0/c1 0 2024-05-06T14:04:03.250 INFO:tasks.workunit.client.1.smithi174.stdout:5/117: write d1/d6/da/db/f1a [595945,31576] 0 2024-05-06T14:04:03.250 INFO:tasks.workunit.client.1.smithi174.stdout:5/118: link d1/d6/f13 d1/d6/d21/f2c 0 2024-05-06T14:04:03.250 INFO:tasks.workunit.client.1.smithi174.stdout:5/119: write d1/d6/da/fd [1959071,43204] 0 2024-05-06T14:04:03.250 INFO:tasks.workunit.client.1.smithi174.stdout:5/120: chown d1/d6/da/de 392706 1 2024-05-06T14:04:03.250 INFO:tasks.workunit.client.1.smithi174.stdout:5/121: readlink d1/d6/df/l20 0 2024-05-06T14:04:03.250 INFO:tasks.workunit.client.1.smithi174.stdout:5/122: link d1/d6/d21/f2c d1/d6/d2a/f2d 0 2024-05-06T14:04:03.251 INFO:tasks.workunit.client.1.smithi174.stdout:5/123: creat d1/d6/d7/f2e x:0 0 0 2024-05-06T14:04:03.251 INFO:tasks.workunit.client.1.smithi174.stdout:5/124: truncate d1/d6/da/db/f1d 730992 0 2024-05-06T14:04:03.251 INFO:tasks.workunit.client.1.smithi174.stdout:5/125: rmdir d1/d6 39 2024-05-06T14:04:03.251 INFO:tasks.workunit.client.1.smithi174.stdout:5/126: rmdir d1/d6/d7/d27 0 2024-05-06T14:04:03.251 INFO:tasks.workunit.client.1.smithi174.stdout:5/127: mknod d1/d6/df/c2f 0 2024-05-06T14:04:03.251 INFO:tasks.workunit.client.1.smithi174.stdout:5/128: chown d1/d6/df 290831297 1 2024-05-06T14:04:03.251 INFO:tasks.workunit.client.1.smithi174.stdout:5/129: creat d1/d6/df/f30 x:0 0 0 2024-05-06T14:04:03.251 INFO:tasks.workunit.client.1.smithi174.stdout:5/130: write d1/d6/d7/f1f [1016146,9883] 0 2024-05-06T14:04:03.251 INFO:tasks.workunit.client.1.smithi174.stdout:5/131: mknod d1/d6/d7/c31 0 2024-05-06T14:04:03.252 INFO:tasks.workunit.client.1.smithi174.stdout:5/132: unlink d1/d6/da/db/f16 0 2024-05-06T14:04:03.252 INFO:tasks.workunit.client.1.smithi174.stdout:5/133: stat d1/d6/df/f30 0 2024-05-06T14:04:03.252 INFO:tasks.workunit.client.1.smithi174.stdout:5/134: mknod d1/d6/d2a/c32 0 2024-05-06T14:04:03.252 INFO:tasks.workunit.client.1.smithi174.stdout:5/135: dread - d1/d6/da/db/f1b zero size 2024-05-06T14:04:03.252 INFO:tasks.workunit.client.1.smithi174.stdout:5/136: creat d1/d6/da/f33 x:0 0 0 2024-05-06T14:04:03.252 INFO:tasks.workunit.client.1.smithi174.stdout:5/137: creat d1/d6/f34 x:0 0 0 2024-05-06T14:04:03.252 INFO:tasks.workunit.client.1.smithi174.stdout:5/138: mkdir d1/d6/df/d35 0 2024-05-06T14:04:03.252 INFO:tasks.workunit.client.1.smithi174.stdout:5/139: rename d1/d6/d21 to d1/d6/d7/d36 0 2024-05-06T14:04:03.266 INFO:tasks.workunit.client.1.smithi174.stdout:9/106: fsync f1 0 2024-05-06T14:04:03.266 INFO:tasks.workunit.client.1.smithi174.stdout:6/174: fdatasync d0/df/f18 0 2024-05-06T14:04:03.266 INFO:tasks.workunit.client.1.smithi174.stdout:6/175: rmdir d0 39 2024-05-06T14:04:03.266 INFO:tasks.workunit.client.1.smithi174.stdout:6/176: chown d0/df/l17 1044572 1 2024-05-06T14:04:03.266 INFO:tasks.workunit.client.1.smithi174.stdout:8/171: fsync d4/de/d23/f32 0 2024-05-06T14:04:03.266 INFO:tasks.workunit.client.1.smithi174.stdout:6/177: rename d0/df/d22/d2c/c2d to d0/df/d22/d2c/c3d 0 2024-05-06T14:04:03.267 INFO:tasks.workunit.client.1.smithi174.stdout:8/172: creat d4/d15/d20/f34 x:0 0 0 2024-05-06T14:04:03.267 INFO:tasks.workunit.client.1.smithi174.stdout:8/173: dread - d4/de/d24/f33 zero size 2024-05-06T14:04:03.268 INFO:tasks.workunit.client.1.smithi174.stdout:5/140: dread d1/d6/d7/d36/f2c [786432,98304] 0 2024-05-06T14:04:03.268 INFO:tasks.workunit.client.1.smithi174.stdout:5/141: symlink d1/d6/da/db/d1e/l37 0 2024-05-06T14:04:03.268 INFO:tasks.workunit.client.1.smithi174.stdout:5/142: creat d1/d6/da/de/f38 x:0 0 0 2024-05-06T14:04:03.268 INFO:tasks.workunit.client.1.smithi174.stdout:5/143: chown d1/d6 33 1 2024-05-06T14:04:03.268 INFO:tasks.workunit.client.1.smithi174.stdout:5/144: chown d1/d6/df/d35 47 1 2024-05-06T14:04:03.268 INFO:tasks.workunit.client.1.smithi174.stdout:5/145: write d1/d6/da/de/f38 [351349,38680] 0 2024-05-06T14:04:03.269 INFO:tasks.workunit.client.1.smithi174.stdout:5/146: unlink d1/d6/d7/c31 0 2024-05-06T14:04:03.269 INFO:tasks.workunit.client.1.smithi174.stdout:5/147: mknod d1/d6/d7/c39 0 2024-05-06T14:04:03.269 INFO:tasks.workunit.client.1.smithi174.stdout:6/178: dwrite d0/df/d22/d2c/f37 [643072,73728] 0 2024-05-06T14:04:03.272 INFO:tasks.workunit.client.1.smithi174.stdout:8/174: dread d4/de/f12 [712704,57344] 0 2024-05-06T14:04:03.273 INFO:tasks.workunit.client.1.smithi174.stdout:8/175: readlink d4/l1c 0 2024-05-06T14:04:03.300 INFO:tasks.workunit.client.1.smithi174.stdout:4/104: fsync d1/d9/f23 0 2024-05-06T14:04:03.301 INFO:tasks.workunit.client.1.smithi174.stdout:7/117: fdatasync d0/da/d19/d24/f1b 0 2024-05-06T14:04:03.301 INFO:tasks.workunit.client.1.smithi174.stdout:9/107: fdatasync dc/df/f11 0 2024-05-06T14:04:03.302 INFO:tasks.workunit.client.1.smithi174.stdout:2/96: sync 2024-05-06T14:04:03.302 INFO:tasks.workunit.client.1.smithi174.stdout:3/178: sync 2024-05-06T14:04:03.305 INFO:tasks.workunit.client.1.smithi174.stdout:3/179: creat df/d10/f3f x:0 0 0 2024-05-06T14:04:03.305 INFO:tasks.workunit.client.1.smithi174.stdout:7/118: rename d0/da/d19/d24/d14/f21 to d0/da/f27 0 2024-05-06T14:04:03.305 INFO:tasks.workunit.client.1.smithi174.stdout:7/119: getdents d0/da/d11 0 2024-05-06T14:04:03.306 INFO:tasks.workunit.client.1.smithi174.stdout:8/176: creat d4/f35 x:0 0 0 2024-05-06T14:04:03.306 INFO:tasks.workunit.client.1.smithi174.stdout:7/120: chown d0/cf 472119892 1 2024-05-06T14:04:03.306 INFO:tasks.workunit.client.1.smithi174.stdout:9/108: dread f2 [1658880,122880] 0 2024-05-06T14:04:03.306 INFO:tasks.workunit.client.1.smithi174.stdout:8/177: rmdir d4/de/d24 39 2024-05-06T14:04:03.307 INFO:tasks.workunit.client.1.smithi174.stdout:9/109: chown dc/d14 11818 1 2024-05-06T14:04:03.307 INFO:tasks.workunit.client.1.smithi174.stdout:8/178: truncate d4/de/f2d 324950 0 2024-05-06T14:04:03.307 INFO:tasks.workunit.client.1.smithi174.stdout:9/110: truncate fa 198804 0 2024-05-06T14:04:03.307 INFO:tasks.workunit.client.1.smithi174.stdout:2/97: write d0/d1/d2/f17 [1268763,106993] 0 2024-05-06T14:04:03.307 INFO:tasks.workunit.client.1.smithi174.stdout:2/98: stat d0/da/lc 0 2024-05-06T14:04:03.307 INFO:tasks.workunit.client.1.smithi174.stdout:9/111: truncate fa 942093 0 2024-05-06T14:04:03.307 INFO:tasks.workunit.client.1.smithi174.stdout:9/112: rmdir dc/de 39 2024-05-06T14:04:03.307 INFO:tasks.workunit.client.1.smithi174.stdout:2/99: creat d0/d1/d2/f1a x:0 0 0 2024-05-06T14:04:03.308 INFO:tasks.workunit.client.1.smithi174.stdout:2/100: chown d0/d1/l9 300819 1 2024-05-06T14:04:03.308 INFO:tasks.workunit.client.1.smithi174.stdout:9/113: creat dc/d1c/f24 x:0 0 0 2024-05-06T14:04:03.308 INFO:tasks.workunit.client.1.smithi174.stdout:2/101: chown d0/d1/d2/f17 3971009 1 2024-05-06T14:04:03.308 INFO:tasks.workunit.client.1.smithi174.stdout:2/102: stat d0 0 2024-05-06T14:04:03.308 INFO:tasks.workunit.client.1.smithi174.stdout:9/114: chown dc/d14 10 1 2024-05-06T14:04:03.308 INFO:tasks.workunit.client.1.smithi174.stdout:2/103: truncate d0/d16/f19 763064 0 2024-05-06T14:04:03.308 INFO:tasks.workunit.client.1.smithi174.stdout:9/115: creat dc/f25 x:0 0 0 2024-05-06T14:04:03.308 INFO:tasks.workunit.client.1.smithi174.stdout:9/116: truncate dc/d14/f1e 548993 0 2024-05-06T14:04:03.309 INFO:tasks.workunit.client.1.smithi174.stdout:2/104: mkdir d0/d1/d2/d1b 0 2024-05-06T14:04:03.309 INFO:tasks.workunit.client.1.smithi174.stdout:9/117: stat dc/d14/f16 0 2024-05-06T14:04:03.309 INFO:tasks.workunit.client.1.smithi174.stdout:9/118: write dc/df/f12 [1806375,116134] 0 2024-05-06T14:04:03.309 INFO:tasks.workunit.client.1.smithi174.stdout:9/119: write dc/df/f12 [2256058,73652] 0 2024-05-06T14:04:03.309 INFO:tasks.workunit.client.1.smithi174.stdout:9/120: write dc/df/f12 [3237415,74436] 0 2024-05-06T14:04:03.347 INFO:tasks.workunit.client.1.smithi174.stdout:3/180: fsync f2 0 2024-05-06T14:04:03.347 INFO:tasks.workunit.client.1.smithi174.stdout:3/181: dread - df/d10/f2c zero size 2024-05-06T14:04:03.347 INFO:tasks.workunit.client.1.smithi174.stdout:3/182: symlink df/d10/d1b/l40 0 2024-05-06T14:04:03.348 INFO:tasks.workunit.client.1.smithi174.stdout:8/179: fdatasync d4/de/f1f 0 2024-05-06T14:04:03.348 INFO:tasks.workunit.client.1.smithi174.stdout:5/148: fsync d1/d6/f18 0 2024-05-06T14:04:03.348 INFO:tasks.workunit.client.1.smithi174.stdout:8/180: symlink d4/l36 0 2024-05-06T14:04:03.348 INFO:tasks.workunit.client.1.smithi174.stdout:5/149: write d1/d6/d7/f1f [447598,95727] 0 2024-05-06T14:04:03.348 INFO:tasks.workunit.client.1.smithi174.stdout:8/181: unlink d4/f28 0 2024-05-06T14:04:03.348 INFO:tasks.workunit.client.1.smithi174.stdout:5/150: write d1/d6/d7/f1f [1115000,29577] 0 2024-05-06T14:04:03.348 INFO:tasks.workunit.client.1.smithi174.stdout:8/182: dread d4/de/d23/f25 [12288,16384] 0 2024-05-06T14:04:03.348 INFO:tasks.workunit.client.1.smithi174.stdout:5/151: rmdir d1/d6/da/db/d1e 39 2024-05-06T14:04:03.349 INFO:tasks.workunit.client.1.smithi174.stdout:5/152: stat d1/d6/f9 0 2024-05-06T14:04:03.349 INFO:tasks.workunit.client.1.smithi174.stdout:5/153: stat d1 0 2024-05-06T14:04:03.349 INFO:tasks.workunit.client.1.smithi174.stdout:8/183: truncate d4/de/d23/f32 112919 0 2024-05-06T14:04:03.349 INFO:tasks.workunit.client.1.smithi174.stdout:5/154: rename d1/d6/da to d1/d6/df/d35/d3a 0 2024-05-06T14:04:03.349 INFO:tasks.workunit.client.1.smithi174.stdout:8/184: symlink d4/de/d24/l37 0 2024-05-06T14:04:03.349 INFO:tasks.workunit.client.1.smithi174.stdout:8/185: rmdir d4/de 39 2024-05-06T14:04:03.349 INFO:tasks.workunit.client.1.smithi174.stdout:5/155: symlink d1/d6/df/d35/d3a/de/l3b 0 2024-05-06T14:04:03.349 INFO:tasks.workunit.client.1.smithi174.stdout:4/105: dwrite d1/d9/f12 [208896,4096] 0 2024-05-06T14:04:03.349 INFO:tasks.workunit.client.1.smithi174.stdout:5/156: truncate d1/d6/d2a/f2d 2017777 0 2024-05-06T14:04:03.350 INFO:tasks.workunit.client.1.smithi174.stdout:5/157: chown d1/d6/df/f30 531497 1 2024-05-06T14:04:03.350 INFO:tasks.workunit.client.1.smithi174.stdout:4/106: link d1/d9/f12 d1/d9/f2d 0 2024-05-06T14:04:03.350 INFO:tasks.workunit.client.1.smithi174.stdout:4/107: dread d1/f1d [552960,73728] 0 2024-05-06T14:04:03.350 INFO:tasks.workunit.client.1.smithi174.stdout:5/158: read d1/d6/d2a/f2d [1261705,85036] 0 2024-05-06T14:04:03.350 INFO:tasks.workunit.client.1.smithi174.stdout:4/108: mkdir d1/d2e 0 2024-05-06T14:04:03.350 INFO:tasks.workunit.client.1.smithi174.stdout:4/109: dread d1/f5 [147456,4096] 0 2024-05-06T14:04:03.350 INFO:tasks.workunit.client.1.smithi174.stdout:5/159: truncate d1/d6/df/d35/d3a/f33 812971 0 2024-05-06T14:04:03.350 INFO:tasks.workunit.client.1.smithi174.stdout:4/110: readlink d1/l8 0 2024-05-06T14:04:03.351 INFO:tasks.workunit.client.1.smithi174.stdout:4/111: dread d1/d9/fe [1347584,86016] 0 2024-05-06T14:04:03.351 INFO:tasks.workunit.client.1.smithi174.stdout:4/112: dread - d1/d1a/f28 zero size 2024-05-06T14:04:03.351 INFO:tasks.workunit.client.1.smithi174.stdout:4/113: rename d1/d9/l24 to d1/d2e/l2f 0 2024-05-06T14:04:03.351 INFO:tasks.workunit.client.1.smithi174.stdout:5/160: creat d1/d6/df/d35/d3a/f3c x:0 0 0 2024-05-06T14:04:03.351 INFO:tasks.workunit.client.1.smithi174.stdout:4/114: dread - d1/d9/f2b zero size 2024-05-06T14:04:03.351 INFO:tasks.workunit.client.1.smithi174.stdout:5/161: truncate d1/d6/df/d35/d3a/db/f1a 1278265 0 2024-05-06T14:04:03.351 INFO:tasks.workunit.client.1.smithi174.stdout:2/105: dwrite d0/d16/f19 [221184,16384] 0 2024-05-06T14:04:03.352 INFO:tasks.workunit.client.1.smithi174.stdout:2/106: creat d0/d1/d2/f1c x:0 0 0 2024-05-06T14:04:03.352 INFO:tasks.workunit.client.1.smithi174.stdout:9/121: dread f1 [311296,106496] 0 2024-05-06T14:04:03.352 INFO:tasks.workunit.client.1.smithi174.stdout:9/122: dread fa [585728,118784] 0 2024-05-06T14:04:03.352 INFO:tasks.workunit.client.1.smithi174.stdout:9/123: link f7 dc/de/f26 0 2024-05-06T14:04:03.352 INFO:tasks.workunit.client.1.smithi174.stdout:8/186: dwrite d4/de/f19 [573440,24576] 0 2024-05-06T14:04:03.352 INFO:tasks.workunit.client.1.smithi174.stdout:9/124: write dc/d1c/f1d [1013268,63535] 0 2024-05-06T14:04:03.352 INFO:tasks.workunit.client.1.smithi174.stdout:8/187: mknod d4/de/c38 0 2024-05-06T14:04:03.352 INFO:tasks.workunit.client.1.smithi174.stdout:9/125: dread f1 [843776,118784] 0 2024-05-06T14:04:03.353 INFO:tasks.workunit.client.1.smithi174.stdout:8/188: symlink d4/d15/d20/l39 0 2024-05-06T14:04:03.353 INFO:tasks.workunit.client.1.smithi174.stdout:9/126: mkdir dc/d27 0 2024-05-06T14:04:03.353 INFO:tasks.workunit.client.1.smithi174.stdout:8/189: write d4/d15/d20/f34 [937098,78377] 0 2024-05-06T14:04:03.353 INFO:tasks.workunit.client.1.smithi174.stdout:8/190: symlink d4/d15/d20/l3a 0 2024-05-06T14:04:03.353 INFO:tasks.workunit.client.1.smithi174.stdout:8/191: getdents d4/de/d24 0 2024-05-06T14:04:03.353 INFO:tasks.workunit.client.1.smithi174.stdout:8/192: dread d4/de/f19 [53248,36864] 0 2024-05-06T14:04:03.353 INFO:tasks.workunit.client.1.smithi174.stdout:8/193: rename d4/de/l22 to d4/de/d23/l3b 0 2024-05-06T14:04:03.353 INFO:tasks.workunit.client.1.smithi174.stdout:8/194: chown d4/de/d24 506020317 1 2024-05-06T14:04:03.353 INFO:tasks.workunit.client.1.smithi174.stdout:8/195: mkdir d4/de/d23/d3c 0 2024-05-06T14:04:03.354 INFO:tasks.workunit.client.1.smithi174.stdout:8/196: rename d4/c5 to d4/de/d23/d3c/c3d 0 2024-05-06T14:04:03.354 INFO:tasks.workunit.client.1.smithi174.stdout:8/197: mkdir d4/d15/d20/d3e 0 2024-05-06T14:04:03.354 INFO:tasks.workunit.client.1.smithi174.stdout:8/198: rename d4/de/d24/f2f to d4/de/f3f 0 2024-05-06T14:04:03.354 INFO:tasks.workunit.client.1.smithi174.stdout:8/199: write d4/d15/f16 [888529,92957] 0 2024-05-06T14:04:03.355 INFO:tasks.workunit.client.1.smithi174.stdout:8/200: getdents d4/de 0 2024-05-06T14:04:03.355 INFO:tasks.workunit.client.1.smithi174.stdout:8/201: write d4/de/f2d [999443,30454] 0 2024-05-06T14:04:03.355 INFO:tasks.workunit.client.1.smithi174.stdout:8/202: mknod d4/de/d24/c40 0 2024-05-06T14:04:03.355 INFO:tasks.workunit.client.1.smithi174.stdout:8/203: mkdir d4/de/d23/d41 0 2024-05-06T14:04:03.368 INFO:tasks.workunit.client.1.smithi174.stdout:1/108: fdatasync d11/f22 0 2024-05-06T14:04:03.368 INFO:tasks.workunit.client.1.smithi174.stdout:1/109: dread f5 [1359872,65536] 0 2024-05-06T14:04:03.368 INFO:tasks.workunit.client.1.smithi174.stdout:1/110: creat d11/f2c x:0 0 0 2024-05-06T14:04:03.368 INFO:tasks.workunit.client.1.smithi174.stdout:4/115: fdatasync d1/d9/f16 0 2024-05-06T14:04:03.368 INFO:tasks.workunit.client.1.smithi174.stdout:4/116: creat d1/d1f/d27/f30 x:0 0 0 2024-05-06T14:04:03.368 INFO:tasks.workunit.client.1.smithi174.stdout:4/117: rmdir d1/d1f 39 2024-05-06T14:04:03.368 INFO:tasks.workunit.client.1.smithi174.stdout:4/118: creat d1/f31 x:0 0 0 2024-05-06T14:04:03.369 INFO:tasks.workunit.client.1.smithi174.stdout:4/119: read - d1/d9/d15/f21 zero size 2024-05-06T14:04:03.369 INFO:tasks.workunit.client.1.smithi174.stdout:2/107: dwrite d0/d1/d2/f1a [606208,53248] 0 2024-05-06T14:04:03.369 INFO:tasks.workunit.client.1.smithi174.stdout:2/108: write d0/d1/d2/f17 [1191885,5389] 0 2024-05-06T14:04:03.374 INFO:tasks.workunit.client.1.smithi174.stdout:8/204: dwrite d4/de/f11 [2498560,40960] 0 2024-05-06T14:04:03.374 INFO:tasks.workunit.client.1.smithi174.stdout:8/205: chown d4/d15/f30 20414 1 2024-05-06T14:04:03.374 INFO:tasks.workunit.client.1.smithi174.stdout:8/206: link d4/de/f3f d4/d15/d20/f42 0 2024-05-06T14:04:03.374 INFO:tasks.workunit.client.1.smithi174.stdout:8/207: creat d4/de/d24/f43 x:0 0 0 2024-05-06T14:04:03.375 INFO:tasks.workunit.client.1.smithi174.stdout:1/111: dread f1 [819200,122880] 0 2024-05-06T14:04:03.375 INFO:tasks.workunit.client.1.smithi174.stdout:8/208: creat d4/d15/d20/f44 x:0 0 0 2024-05-06T14:04:03.375 INFO:tasks.workunit.client.1.smithi174.stdout:1/112: mkdir d11/d1f/d27/d2d 0 2024-05-06T14:04:03.375 INFO:tasks.workunit.client.1.smithi174.stdout:1/113: chown la 0 1 2024-05-06T14:04:03.375 INFO:tasks.workunit.client.1.smithi174.stdout:8/209: unlink d4/de/f2d 0 2024-05-06T14:04:03.375 INFO:tasks.workunit.client.1.smithi174.stdout:4/120: truncate d1/d9/f16 59990 0 2024-05-06T14:04:03.375 INFO:tasks.workunit.client.1.smithi174.stdout:1/114: mknod d11/c2e 0 2024-05-06T14:04:03.375 INFO:tasks.workunit.client.1.smithi174.stdout:1/115: link c9 d11/c2f 0 2024-05-06T14:04:03.376 INFO:tasks.workunit.client.1.smithi174.stdout:1/116: mknod d11/d1f/d27/d2d/c30 0 2024-05-06T14:04:03.379 INFO:tasks.workunit.client.1.smithi174.stdout:8/210: dwrite d4/de/d24/f33 [733184,20480] 0 2024-05-06T14:04:03.379 INFO:tasks.workunit.client.1.smithi174.stdout:8/211: write d4/d15/f30 [112530,34358] 0 2024-05-06T14:04:03.379 INFO:tasks.workunit.client.1.smithi174.stdout:4/121: dwrite d1/d9/f20 [143360,81920] 0 2024-05-06T14:04:03.379 INFO:tasks.workunit.client.1.smithi174.stdout:4/122: chown d1/d1f/d27/d2c 73608 1 2024-05-06T14:04:03.380 INFO:tasks.workunit.client.1.smithi174.stdout:4/123: unlink d1/d2e/l2f 0 2024-05-06T14:04:03.380 INFO:tasks.workunit.client.1.smithi174.stdout:4/124: creat d1/d9/d15/f32 x:0 0 0 2024-05-06T14:04:03.380 INFO:tasks.workunit.client.1.smithi174.stdout:4/125: creat d1/d2e/f33 x:0 0 0 2024-05-06T14:04:03.380 INFO:tasks.workunit.client.1.smithi174.stdout:4/126: symlink d1/d2e/l34 0 2024-05-06T14:04:03.380 INFO:tasks.workunit.client.1.smithi174.stdout:4/127: getdents d1/d2e 0 2024-05-06T14:04:03.380 INFO:tasks.workunit.client.1.smithi174.stdout:1/117: dwrite d11/f22 [483328,16384] 0 2024-05-06T14:04:03.380 INFO:tasks.workunit.client.1.smithi174.stdout:4/128: mkdir d1/d9/d15/d35 0 2024-05-06T14:04:03.381 INFO:tasks.workunit.client.1.smithi174.stdout:1/118: rename d11/f1a to d11/d1f/d27/d2d/f31 0 2024-05-06T14:04:03.381 INFO:tasks.workunit.client.1.smithi174.stdout:4/129: dread d1/fd [323584,53248] 0 2024-05-06T14:04:03.381 INFO:tasks.workunit.client.1.smithi174.stdout:4/130: write d1/fc [597708,21489] 0 2024-05-06T14:04:03.381 INFO:tasks.workunit.client.1.smithi174.stdout:4/131: mknod d1/d2e/c36 0 2024-05-06T14:04:03.381 INFO:tasks.workunit.client.1.smithi174.stdout:4/132: link d1/c13 d1/d9/c37 0 2024-05-06T14:04:03.381 INFO:tasks.workunit.client.1.smithi174.stdout:4/133: truncate d1/d9/f2b 682714 0 2024-05-06T14:04:03.381 INFO:tasks.workunit.client.1.smithi174.stdout:4/134: getdents d1/d9/d15 0 2024-05-06T14:04:03.381 INFO:tasks.workunit.client.1.smithi174.stdout:4/135: write d1/d9/f2b [706534,122961] 0 2024-05-06T14:04:03.382 INFO:tasks.workunit.client.1.smithi174.stdout:4/136: creat d1/d1f/d27/f38 x:0 0 0 2024-05-06T14:04:03.382 INFO:tasks.workunit.client.1.smithi174.stdout:4/137: dread - d1/d9/d15/f32 zero size 2024-05-06T14:04:03.382 INFO:tasks.workunit.client.1.smithi174.stdout:4/138: write d1/d9/ff [1003847,39667] 0 2024-05-06T14:04:03.382 INFO:tasks.workunit.client.1.smithi174.stdout:4/139: rmdir d1/d9/d25 0 2024-05-06T14:04:03.382 INFO:tasks.workunit.client.1.smithi174.stdout:4/140: creat d1/d2e/f39 x:0 0 0 2024-05-06T14:04:03.382 INFO:tasks.workunit.client.1.smithi174.stdout:4/141: unlink d1/d9/d15/f17 0 2024-05-06T14:04:03.382 INFO:tasks.workunit.client.1.smithi174.stdout:4/142: link d1/l2a d1/d1f/d27/d2c/l3a 0 2024-05-06T14:04:03.382 INFO:tasks.workunit.client.1.smithi174.stdout:4/143: creat d1/d1f/d27/f3b x:0 0 0 2024-05-06T14:04:03.383 INFO:tasks.workunit.client.1.smithi174.stdout:4/144: write d1/d1a/f28 [402573,27685] 0 2024-05-06T14:04:03.383 INFO:tasks.workunit.client.1.smithi174.stdout:4/145: dread - d1/d1f/d27/f3b zero size 2024-05-06T14:04:03.383 INFO:tasks.workunit.client.1.smithi174.stdout:4/146: mkdir d1/d1a/d3c 0 2024-05-06T14:04:03.443 INFO:tasks.workunit.client.1.smithi174.stdout:8/212: fsync d4/de/f13 0 2024-05-06T14:04:03.443 INFO:tasks.workunit.client.1.smithi174.stdout:8/213: chown d4/de/d23/f32 13924 1 2024-05-06T14:04:03.447 INFO:tasks.workunit.client.1.smithi174.stdout:1/119: dwrite f5 [2514944,12288] 0 2024-05-06T14:04:03.447 INFO:tasks.workunit.client.1.smithi174.stdout:1/120: chown d11/l26 26340580 1 2024-05-06T14:04:03.447 INFO:tasks.workunit.client.1.smithi174.stdout:1/121: mkdir d11/d1f/d27/d32 0 2024-05-06T14:04:03.448 INFO:tasks.workunit.client.1.smithi174.stdout:8/214: dwrite d4/de/d24/f43 [331776,73728] 0 2024-05-06T14:04:03.448 INFO:tasks.workunit.client.1.smithi174.stdout:8/215: creat d4/de/d24/f45 x:0 0 0 2024-05-06T14:04:03.448 INFO:tasks.workunit.client.1.smithi174.stdout:8/216: mkdir d4/de/d24/d46 0 2024-05-06T14:04:03.449 INFO:tasks.workunit.client.1.smithi174.stdout:8/217: symlink d4/l47 0 2024-05-06T14:04:03.449 INFO:tasks.workunit.client.1.smithi174.stdout:8/218: mkdir d4/d48 0 2024-05-06T14:04:03.560 INFO:tasks.workunit.client.1.smithi174.stdout:1/122: fdatasync d11/d1f/d27/d2d/f31 0 2024-05-06T14:04:03.561 INFO:tasks.workunit.client.1.smithi174.stdout:1/123: creat d11/d1f/d27/d2d/f33 x:0 0 0 2024-05-06T14:04:03.561 INFO:tasks.workunit.client.1.smithi174.stdout:4/147: fdatasync d1/f31 0 2024-05-06T14:04:03.561 INFO:tasks.workunit.client.1.smithi174.stdout:4/148: fdatasync d1/d2e/f39 0 2024-05-06T14:04:03.562 INFO:tasks.workunit.client.1.smithi174.stdout:4/149: creat d1/d2e/f3d x:0 0 0 2024-05-06T14:04:03.562 INFO:tasks.workunit.client.1.smithi174.stdout:1/124: symlink d11/l34 0 2024-05-06T14:04:03.562 INFO:tasks.workunit.client.1.smithi174.stdout:1/125: write d11/d1f/d27/f2b [769121,25979] 0 2024-05-06T14:04:03.562 INFO:tasks.workunit.client.1.smithi174.stdout:4/150: write d1/d2e/f3d [177982,57942] 0 2024-05-06T14:04:03.619 INFO:tasks.workunit.client.1.smithi174.stdout:4/151: fsync d1/d2e/f39 0 2024-05-06T14:04:03.619 INFO:tasks.workunit.client.1.smithi174.stdout:4/152: rmdir d1/d1f/d27 39 2024-05-06T14:04:03.621 INFO:tasks.workunit.client.1.smithi174.stdout:4/153: mkdir d1/d1f/d27/d3e 0 2024-05-06T14:04:03.621 INFO:tasks.workunit.client.1.smithi174.stdout:4/154: creat d1/d1f/d27/d2c/f3f x:0 0 0 2024-05-06T14:04:03.621 INFO:tasks.workunit.client.1.smithi174.stdout:4/155: stat d1/d9/f20 0 2024-05-06T14:04:03.621 INFO:tasks.workunit.client.1.smithi174.stdout:4/156: truncate d1/f5 832834 0 2024-05-06T14:04:03.675 INFO:tasks.workunit.client.1.smithi174.stdout:4/157: fsync d1/d1f/d27/f38 0 2024-05-06T14:04:03.681 INFO:tasks.workunit.client.1.smithi174.stdout:7/121: sync 2024-05-06T14:04:03.681 INFO:tasks.workunit.client.1.smithi174.stdout:0/108: sync 2024-05-06T14:04:03.681 INFO:tasks.workunit.client.1.smithi174.stdout:0/109: getdents d0 0 2024-05-06T14:04:03.681 INFO:tasks.workunit.client.1.smithi174.stdout:6/179: sync 2024-05-06T14:04:03.681 INFO:tasks.workunit.client.1.smithi174.stdout:2/109: sync 2024-05-06T14:04:03.682 INFO:tasks.workunit.client.1.smithi174.stdout:9/127: sync 2024-05-06T14:04:03.682 INFO:tasks.workunit.client.1.smithi174.stdout:8/219: sync 2024-05-06T14:04:03.682 INFO:tasks.workunit.client.1.smithi174.stdout:2/110: truncate d0/d1/d2/f17 1515334 0 2024-05-06T14:04:03.682 INFO:tasks.workunit.client.1.smithi174.stdout:7/122: mkdir d0/da/d28 0 2024-05-06T14:04:03.682 INFO:tasks.workunit.client.1.smithi174.stdout:5/162: sync 2024-05-06T14:04:03.682 INFO:tasks.workunit.client.1.smithi174.stdout:9/128: truncate dc/f25 415544 0 2024-05-06T14:04:03.682 INFO:tasks.workunit.client.1.smithi174.stdout:2/111: chown d0/d1/d2/ld 61925238 1 2024-05-06T14:04:03.682 INFO:tasks.workunit.client.1.smithi174.stdout:9/129: truncate f7 1241857 0 2024-05-06T14:04:03.683 INFO:tasks.workunit.client.1.smithi174.stdout:7/123: mknod d0/da/d19/c29 0 2024-05-06T14:04:03.683 INFO:tasks.workunit.client.1.smithi174.stdout:6/180: unlink d0/df/f18 0 2024-05-06T14:04:03.683 INFO:tasks.workunit.client.1.smithi174.stdout:6/181: dread d0/f15 [204800,61440] 0 2024-05-06T14:04:03.683 INFO:tasks.workunit.client.1.smithi174.stdout:7/124: truncate d0/da/d19/d24/f1b 32172 0 2024-05-06T14:04:03.683 INFO:tasks.workunit.client.1.smithi174.stdout:3/183: sync 2024-05-06T14:04:03.683 INFO:tasks.workunit.client.1.smithi174.stdout:6/182: link d0/l11 d0/df/l3e 0 2024-05-06T14:04:03.683 INFO:tasks.workunit.client.1.smithi174.stdout:6/183: mknod d0/d25/d35/c3f 0 2024-05-06T14:04:03.683 INFO:tasks.workunit.client.1.smithi174.stdout:0/110: write d0/d1a/d17/fe [233060,128640] 0 2024-05-06T14:04:03.684 INFO:tasks.workunit.client.1.smithi174.stdout:3/184: unlink df/d2d/l30 0 2024-05-06T14:04:03.684 INFO:tasks.workunit.client.1.smithi174.stdout:0/111: stat d0/d3/c7 0 2024-05-06T14:04:03.684 INFO:tasks.workunit.client.1.smithi174.stdout:7/125: write d0/da/f16 [625249,60337] 0 2024-05-06T14:04:03.684 INFO:tasks.workunit.client.1.smithi174.stdout:0/112: readlink d0/l11 0 2024-05-06T14:04:03.684 INFO:tasks.workunit.client.1.smithi174.stdout:3/185: mknod df/d10/d1b/c41 0 2024-05-06T14:04:03.684 INFO:tasks.workunit.client.1.smithi174.stdout:6/184: write d0/f16 [678489,116574] 0 2024-05-06T14:04:03.684 INFO:tasks.workunit.client.1.smithi174.stdout:4/158: dwrite d1/d9/f12 [360448,40960] 0 2024-05-06T14:04:03.684 INFO:tasks.workunit.client.1.smithi174.stdout:5/163: dwrite d1/d6/d7/d36/f2c [3043328,4096] 0 2024-05-06T14:04:03.685 INFO:tasks.workunit.client.1.smithi174.stdout:4/159: creat d1/d2e/f40 x:0 0 0 2024-05-06T14:04:03.685 INFO:tasks.workunit.client.1.smithi174.stdout:4/160: mkdir d1/d9/d15/d41 0 2024-05-06T14:04:03.685 INFO:tasks.workunit.client.1.smithi174.stdout:5/164: write d1/d6/f9 [1110728,110379] 0 2024-05-06T14:04:03.685 INFO:tasks.workunit.client.1.smithi174.stdout:4/161: creat d1/d9/f42 x:0 0 0 2024-05-06T14:04:03.685 INFO:tasks.workunit.client.1.smithi174.stdout:4/162: dread - d1/d1a/f26 zero size 2024-05-06T14:04:03.685 INFO:tasks.workunit.client.1.smithi174.stdout:9/130: dwrite dc/d14/f1e [745472,61440] 0 2024-05-06T14:04:03.685 INFO:tasks.workunit.client.1.smithi174.stdout:9/131: chown dc/de/l10 215 1 2024-05-06T14:04:03.685 INFO:tasks.workunit.client.1.smithi174.stdout:9/132: creat dc/de/f28 x:0 0 0 2024-05-06T14:04:03.686 INFO:tasks.workunit.client.1.smithi174.stdout:9/133: creat dc/d17/f29 x:0 0 0 2024-05-06T14:04:03.686 INFO:tasks.workunit.client.1.smithi174.stdout:9/134: unlink dc/d17/l18 0 2024-05-06T14:04:03.686 INFO:tasks.workunit.client.1.smithi174.stdout:4/163: write d1/d9/f2d [610724,101882] 0 2024-05-06T14:04:03.686 INFO:tasks.workunit.client.1.smithi174.stdout:9/135: creat dc/d27/f2a x:0 0 0 2024-05-06T14:04:03.686 INFO:tasks.workunit.client.1.smithi174.stdout:9/136: mknod dc/d1c/c2b 0 2024-05-06T14:04:03.686 INFO:tasks.workunit.client.1.smithi174.stdout:9/137: chown f2 0 1 2024-05-06T14:04:03.686 INFO:tasks.workunit.client.1.smithi174.stdout:9/138: dread dc/df/f12 [888832,61440] 0 2024-05-06T14:04:03.686 INFO:tasks.workunit.client.1.smithi174.stdout:8/220: dwrite d4/de/d23/f25 [434176,69632] 0 2024-05-06T14:04:03.687 INFO:tasks.workunit.client.1.smithi174.stdout:4/164: write d1/d2e/f3d [329821,54911] 0 2024-05-06T14:04:03.687 INFO:tasks.workunit.client.1.smithi174.stdout:9/139: truncate f1 325140 0 2024-05-06T14:04:03.687 INFO:tasks.workunit.client.1.smithi174.stdout:9/140: symlink dc/df/l2c 0 2024-05-06T14:04:03.687 INFO:tasks.workunit.client.1.smithi174.stdout:8/221: creat d4/f49 x:0 0 0 2024-05-06T14:04:03.687 INFO:tasks.workunit.client.1.smithi174.stdout:9/141: rename dc/de/l13 to dc/d14/l2d 0 2024-05-06T14:04:03.687 INFO:tasks.workunit.client.1.smithi174.stdout:9/142: creat dc/de/f2e x:0 0 0 2024-05-06T14:04:03.687 INFO:tasks.workunit.client.1.smithi174.stdout:9/143: creat dc/d17/f2f x:0 0 0 2024-05-06T14:04:03.687 INFO:tasks.workunit.client.1.smithi174.stdout:0/113: dwrite d0/d1a/f1b [1421312,12288] 0 2024-05-06T14:04:03.688 INFO:tasks.workunit.client.1.smithi174.stdout:9/144: unlink dc/d14/l1f 0 2024-05-06T14:04:03.688 INFO:tasks.workunit.client.1.smithi174.stdout:8/222: write d4/d15/f16 [638737,42585] 0 2024-05-06T14:04:03.688 INFO:tasks.workunit.client.1.smithi174.stdout:0/114: dread - d0/d16/f20 zero size 2024-05-06T14:04:03.688 INFO:tasks.workunit.client.1.smithi174.stdout:8/223: rename d4/c2a to d4/de/c4a 0 2024-05-06T14:04:03.688 INFO:tasks.workunit.client.1.smithi174.stdout:8/224: chown d4/d15/d20/f44 811000 1 2024-05-06T14:04:03.688 INFO:tasks.workunit.client.1.smithi174.stdout:8/225: chown d4/c10 24 1 2024-05-06T14:04:03.688 INFO:tasks.workunit.client.1.smithi174.stdout:8/226: read - d4/f35 zero size 2024-05-06T14:04:03.688 INFO:tasks.workunit.client.1.smithi174.stdout:8/227: mknod d4/de/d23/d3c/c4b 0 2024-05-06T14:04:03.688 INFO:tasks.workunit.client.1.smithi174.stdout:8/228: creat d4/de/d23/d41/f4c x:0 0 0 2024-05-06T14:04:03.689 INFO:tasks.workunit.client.1.smithi174.stdout:8/229: creat d4/d15/f4d x:0 0 0 2024-05-06T14:04:03.689 INFO:tasks.workunit.client.1.smithi174.stdout:8/230: chown d4/de/c38 5914 1 2024-05-06T14:04:03.689 INFO:tasks.workunit.client.1.smithi174.stdout:7/126: dwrite d0/da/d11/f20 [626688,98304] 0 2024-05-06T14:04:03.689 INFO:tasks.workunit.client.1.smithi174.stdout:7/127: write d0/f1 [2555341,78438] 0 2024-05-06T14:04:03.689 INFO:tasks.workunit.client.1.smithi174.stdout:7/128: creat d0/d1d/f2a x:0 0 0 2024-05-06T14:04:03.689 INFO:tasks.workunit.client.1.smithi174.stdout:7/129: mknod d0/d1d/c2b 0 2024-05-06T14:04:03.689 INFO:tasks.workunit.client.1.smithi174.stdout:6/185: dwrite d0/df/d22/d2c/f37 [1298432,49152] 0 2024-05-06T14:04:03.689 INFO:tasks.workunit.client.1.smithi174.stdout:6/186: chown d0/df/d22/l32 1952221 1 2024-05-06T14:04:03.690 INFO:tasks.workunit.client.1.smithi174.stdout:6/187: creat d0/d25/f40 x:0 0 0 2024-05-06T14:04:03.729 INFO:tasks.workunit.client.1.smithi174.stdout:3/186: fdatasync df/d10/d1b/f20 0 2024-05-06T14:04:03.729 INFO:tasks.workunit.client.1.smithi174.stdout:7/130: fsync d0/f6 0 2024-05-06T14:04:03.729 INFO:tasks.workunit.client.1.smithi174.stdout:7/131: rename d0/da/f27 to d0/d1d/f2c 0 2024-05-06T14:04:03.729 INFO:tasks.workunit.client.1.smithi174.stdout:7/132: dread d0/f5 [4096,69632] 0 2024-05-06T14:04:03.729 INFO:tasks.workunit.client.1.smithi174.stdout:7/133: creat d0/da/d19/f2d x:0 0 0 2024-05-06T14:04:03.729 INFO:tasks.workunit.client.1.smithi174.stdout:9/145: dwrite fa [581632,4096] 0 2024-05-06T14:04:03.730 INFO:tasks.workunit.client.1.smithi174.stdout:9/146: chown dc/df/f12 0 1 2024-05-06T14:04:03.730 INFO:tasks.workunit.client.1.smithi174.stdout:9/147: dread fa [733184,122880] 0 2024-05-06T14:04:03.736 INFO:tasks.workunit.client.1.smithi174.stdout:2/112: write d0/d1/d2/f17 [150446,72759] 0 2024-05-06T14:04:03.736 INFO:tasks.workunit.client.1.smithi174.stdout:2/113: chown d0/d1/d2/f1a 313 1 2024-05-06T14:04:03.736 INFO:tasks.workunit.client.1.smithi174.stdout:2/114: creat d0/da/f1d x:0 0 0 2024-05-06T14:04:03.737 INFO:tasks.workunit.client.1.smithi174.stdout:6/188: dread d0/df/f29 [507904,16384] 0 2024-05-06T14:04:03.737 INFO:tasks.workunit.client.1.smithi174.stdout:6/189: read d0/df/f29 [60557,23364] 0 2024-05-06T14:04:03.737 INFO:tasks.workunit.client.1.smithi174.stdout:6/190: dread - d0/d25/f30 zero size 2024-05-06T14:04:03.737 INFO:tasks.workunit.client.1.smithi174.stdout:6/191: dread d0/df/f24 [1155072,16384] 0 2024-05-06T14:04:03.737 INFO:tasks.workunit.client.1.smithi174.stdout:2/115: symlink d0/d1/d2/d4/d18/l1e 0 2024-05-06T14:04:03.737 INFO:tasks.workunit.client.1.smithi174.stdout:8/231: dread d4/de/d24/f43 [266240,114688] 0 2024-05-06T14:04:03.737 INFO:tasks.workunit.client.1.smithi174.stdout:6/192: mkdir d0/df/d41 0 2024-05-06T14:04:03.738 INFO:tasks.workunit.client.1.smithi174.stdout:2/116: creat d0/d1/d2/d4/d6/f1f x:0 0 0 2024-05-06T14:04:03.738 INFO:tasks.workunit.client.1.smithi174.stdout:2/117: link d0/d1/d2/f1c d0/d1/d2/f20 0 2024-05-06T14:04:03.738 INFO:tasks.workunit.client.1.smithi174.stdout:2/118: dread - d0/d1/d2/d4/d6/f1f zero size 2024-05-06T14:04:03.738 INFO:tasks.workunit.client.1.smithi174.stdout:8/232: mkdir d4/de/d23/d41/d4e 0 2024-05-06T14:04:03.738 INFO:tasks.workunit.client.1.smithi174.stdout:6/193: truncate d0/df/f14 636051 0 2024-05-06T14:04:03.738 INFO:tasks.workunit.client.1.smithi174.stdout:6/194: truncate d0/df/f24 2560059 0 2024-05-06T14:04:03.738 INFO:tasks.workunit.client.1.smithi174.stdout:8/233: readlink d4/d15/d20/l3a 0 2024-05-06T14:04:03.738 INFO:tasks.workunit.client.1.smithi174.stdout:8/234: rename d4/cc to d4/de/d23/d41/d4e/c4f 0 2024-05-06T14:04:03.739 INFO:tasks.workunit.client.1.smithi174.stdout:5/165: dread d1/d6/df/d35/d3a/de/f38 [364544,57344] 0 2024-05-06T14:04:03.739 INFO:tasks.workunit.client.1.smithi174.stdout:5/166: chown d1/l19 35051788 1 2024-05-06T14:04:03.739 INFO:tasks.workunit.client.1.smithi174.stdout:6/195: rmdir d0/df/d41 0 2024-05-06T14:04:03.739 INFO:tasks.workunit.client.1.smithi174.stdout:2/119: truncate d0/d1/d2/d4/d6/f7 1207845 0 2024-05-06T14:04:03.739 INFO:tasks.workunit.client.1.smithi174.stdout:6/196: chown d0 1 1 2024-05-06T14:04:03.739 INFO:tasks.workunit.client.1.smithi174.stdout:2/120: creat d0/d16/f21 x:0 0 0 2024-05-06T14:04:03.739 INFO:tasks.workunit.client.1.smithi174.stdout:8/235: write d4/de/f13 [760031,109461] 0 2024-05-06T14:04:03.740 INFO:tasks.workunit.client.1.smithi174.stdout:2/121: write d0/d1/d2/d4/d6/fe [479051,29788] 0 2024-05-06T14:04:03.740 INFO:tasks.workunit.client.1.smithi174.stdout:2/122: truncate d0/d1/d2/d4/d6/f7 44991 0 2024-05-06T14:04:03.740 INFO:tasks.workunit.client.1.smithi174.stdout:4/165: read d1/f5 [265939,120689] 0 2024-05-06T14:04:03.740 INFO:tasks.workunit.client.1.smithi174.stdout:2/123: creat d0/d1/d2/d4/f22 x:0 0 0 2024-05-06T14:04:03.740 INFO:tasks.workunit.client.1.smithi174.stdout:2/124: mknod d0/c23 0 2024-05-06T14:04:03.740 INFO:tasks.workunit.client.1.smithi174.stdout:4/166: mknod d1/d1f/d27/d2c/c43 0 2024-05-06T14:04:03.740 INFO:tasks.workunit.client.1.smithi174.stdout:2/125: read - d0/d1/d2/f1c zero size 2024-05-06T14:04:03.740 INFO:tasks.workunit.client.1.smithi174.stdout:3/187: dread df/d2d/f37 [495616,98304] 0 2024-05-06T14:04:03.740 INFO:tasks.workunit.client.1.smithi174.stdout:2/126: write d0/d1/d2/f17 [743479,40465] 0 2024-05-06T14:04:03.741 INFO:tasks.workunit.client.1.smithi174.stdout:2/127: chown d0/d1/l9 1 1 2024-05-06T14:04:03.741 INFO:tasks.workunit.client.1.smithi174.stdout:3/188: creat df/d2d/f42 x:0 0 0 2024-05-06T14:04:03.741 INFO:tasks.workunit.client.1.smithi174.stdout:3/189: rename df/d10 to df/d10/d1b/d43 22 2024-05-06T14:04:03.741 INFO:tasks.workunit.client.1.smithi174.stdout:3/190: readlink df/d10/l23 0 2024-05-06T14:04:03.741 INFO:tasks.workunit.client.1.smithi174.stdout:2/128: mkdir d0/d24 0 2024-05-06T14:04:03.741 INFO:tasks.workunit.client.1.smithi174.stdout:3/191: write df/d10/d1b/f2b [148274,104129] 0 2024-05-06T14:04:03.741 INFO:tasks.workunit.client.1.smithi174.stdout:3/192: getdents df/d2d 0 2024-05-06T14:04:03.741 INFO:tasks.workunit.client.1.smithi174.stdout:2/129: write d0/da/f1d [988369,104178] 0 2024-05-06T14:04:03.742 INFO:tasks.workunit.client.1.smithi174.stdout:3/193: truncate df/d2d/f36 517128 0 2024-05-06T14:04:03.742 INFO:tasks.workunit.client.1.smithi174.stdout:3/194: rmdir df 39 2024-05-06T14:04:03.742 INFO:tasks.workunit.client.1.smithi174.stdout:2/130: link d0/d1/d2/d4/c14 d0/d1/d2/d1b/c25 0 2024-05-06T14:04:03.742 INFO:tasks.workunit.client.1.smithi174.stdout:2/131: stat d0/c23 0 2024-05-06T14:04:03.742 INFO:tasks.workunit.client.1.smithi174.stdout:3/195: dread df/d10/d1b/f2b [286720,106496] 0 2024-05-06T14:04:03.743 INFO:tasks.workunit.client.1.smithi174.stdout:2/132: creat d0/d1/d2/d4/d6/f26 x:0 0 0 2024-05-06T14:04:03.743 INFO:tasks.workunit.client.1.smithi174.stdout:2/133: write d0/d1/d2/f1c [667721,48119] 0 2024-05-06T14:04:03.743 INFO:tasks.workunit.client.1.smithi174.stdout:2/134: creat d0/d24/f27 x:0 0 0 2024-05-06T14:04:03.743 INFO:tasks.workunit.client.1.smithi174.stdout:2/135: mknod d0/db/d15/c28 0 2024-05-06T14:04:03.743 INFO:tasks.workunit.client.1.smithi174.stdout:2/136: read - d0/d1/d2/d4/d6/f1f zero size 2024-05-06T14:04:03.743 INFO:tasks.workunit.client.1.smithi174.stdout:2/137: dread d0/d1/d2/d4/d6/f7 [0,69632] 0 2024-05-06T14:04:03.743 INFO:tasks.workunit.client.1.smithi174.stdout:1/126: sync 2024-05-06T14:04:03.744 INFO:tasks.workunit.client.1.smithi174.stdout:6/197: dread d0/f15 [1302528,114688] 0 2024-05-06T14:04:03.744 INFO:tasks.workunit.client.1.smithi174.stdout:9/148: dwrite dc/de/f28 [131072,45056] 0 2024-05-06T14:04:03.744 INFO:tasks.workunit.client.1.smithi174.stdout:5/167: dwrite d1/d6/df/d35/d3a/fd [3088384,69632] 0 2024-05-06T14:04:03.744 INFO:tasks.workunit.client.1.smithi174.stdout:7/134: dwrite d0/da/d19/f1c [917504,110592] 0 2024-05-06T14:04:03.744 INFO:tasks.workunit.client.1.smithi174.stdout:8/236: dwrite d4/d15/d20/f42 [548864,110592] 0 2024-05-06T14:04:03.744 INFO:tasks.workunit.client.1.smithi174.stdout:4/167: dwrite d1/d9/f16 [45056,49152] 0 2024-05-06T14:04:03.744 INFO:tasks.workunit.client.1.smithi174.stdout:8/237: mknod d4/d15/d20/d3e/c50 0 2024-05-06T14:04:03.744 INFO:tasks.workunit.client.1.smithi174.stdout:1/127: rename d11/l23 to d11/d1f/d27/l35 0 2024-05-06T14:04:03.745 INFO:tasks.workunit.client.1.smithi174.stdout:3/196: read fc [1248200,25966] 0 2024-05-06T14:04:03.745 INFO:tasks.workunit.client.1.smithi174.stdout:7/135: truncate d0/da/d19/f1c 481429 0 2024-05-06T14:04:03.745 INFO:tasks.workunit.client.1.smithi174.stdout:4/168: symlink d1/d9/d15/l44 0 2024-05-06T14:04:03.745 INFO:tasks.workunit.client.1.smithi174.stdout:7/136: dread - d0/d1d/f2a zero size 2024-05-06T14:04:03.745 INFO:tasks.workunit.client.1.smithi174.stdout:3/197: truncate fd 605893 0 2024-05-06T14:04:03.745 INFO:tasks.workunit.client.1.smithi174.stdout:4/169: dread - d1/d9/f42 zero size 2024-05-06T14:04:03.745 INFO:tasks.workunit.client.1.smithi174.stdout:7/137: creat d0/f2e x:0 0 0 2024-05-06T14:04:03.745 INFO:tasks.workunit.client.1.smithi174.stdout:6/198: dwrite d0/df/d22/d2c/f37 [196608,122880] 0 2024-05-06T14:04:03.745 INFO:tasks.workunit.client.1.smithi174.stdout:6/199: rename d0/df/d22/l39 to d0/df/d22/d3b/l42 0 2024-05-06T14:04:03.746 INFO:tasks.workunit.client.1.smithi174.stdout:6/200: mknod d0/df/d3c/c43 0 2024-05-06T14:04:03.746 INFO:tasks.workunit.client.1.smithi174.stdout:6/201: stat d0/c2a 0 2024-05-06T14:04:03.746 INFO:tasks.workunit.client.1.smithi174.stdout:6/202: mknod d0/df/d22/c44 0 2024-05-06T14:04:03.746 INFO:tasks.workunit.client.1.smithi174.stdout:6/203: chown d0/df/l17 0 1 2024-05-06T14:04:03.746 INFO:tasks.workunit.client.1.smithi174.stdout:6/204: write d0/d25/f40 [345388,68942] 0 2024-05-06T14:04:03.746 INFO:tasks.workunit.client.1.smithi174.stdout:6/205: mkdir d0/df/d45 0 2024-05-06T14:04:03.746 INFO:tasks.workunit.client.1.smithi174.stdout:6/206: unlink d0/cb 0 2024-05-06T14:04:03.746 INFO:tasks.workunit.client.1.smithi174.stdout:6/207: chown d0/df 4 1 2024-05-06T14:04:03.747 INFO:tasks.workunit.client.1.smithi174.stdout:6/208: dread d0/df/f20 [364544,69632] 0 2024-05-06T14:04:03.747 INFO:tasks.workunit.client.1.smithi174.stdout:6/209: chown d0/l9 91541060 1 2024-05-06T14:04:03.747 INFO:tasks.workunit.client.1.smithi174.stdout:6/210: getdents d0/df/d22/d2c 0 2024-05-06T14:04:03.747 INFO:tasks.workunit.client.1.smithi174.stdout:6/211: dread d0/df/f1f [544768,98304] 0 2024-05-06T14:04:03.825 INFO:tasks.workunit.client.1.smithi174.stdout:5/168: fdatasync d1/d6/f18 0 2024-05-06T14:04:03.825 INFO:tasks.workunit.client.1.smithi174.stdout:5/169: creat d1/d6/df/d35/f3d x:0 0 0 2024-05-06T14:04:03.825 INFO:tasks.workunit.client.1.smithi174.stdout:5/170: stat d1/d6/df/c2f 0 2024-05-06T14:04:03.826 INFO:tasks.workunit.client.1.smithi174.stdout:5/171: dread - d1/d6/f34 zero size 2024-05-06T14:04:03.826 INFO:tasks.workunit.client.1.smithi174.stdout:5/172: readlink d1/d6/df/l20 0 2024-05-06T14:04:03.826 INFO:tasks.workunit.client.1.smithi174.stdout:5/173: readlink d1/d6/df/l20 0 2024-05-06T14:04:03.828 INFO:tasks.workunit.client.1.smithi174.stdout:5/174: dwrite d1/d6/df/d35/d3a/f3c [487424,32768] 0 2024-05-06T14:04:03.829 INFO:tasks.workunit.client.1.smithi174.stdout:5/175: mkdir d1/d6/d7/d3e 0 2024-05-06T14:04:03.829 INFO:tasks.workunit.client.1.smithi174.stdout:5/176: read - d1/d6/d7/f2e zero size 2024-05-06T14:04:03.829 INFO:tasks.workunit.client.1.smithi174.stdout:5/177: stat d1/d6/df/d35/d3a/de 0 2024-05-06T14:04:03.829 INFO:tasks.workunit.client.1.smithi174.stdout:5/178: creat d1/d6/df/d35/d3a/de/f3f x:0 0 0 2024-05-06T14:04:03.829 INFO:tasks.workunit.client.1.smithi174.stdout:5/179: mknod d1/d6/df/d35/d3a/db/c40 0 2024-05-06T14:04:03.829 INFO:tasks.workunit.client.1.smithi174.stdout:5/180: truncate d1/d6/df/d35/d3a/f25 1767866 0 2024-05-06T14:04:03.829 INFO:tasks.workunit.client.1.smithi174.stdout:1/128: dwrite fc [2285568,98304] 0 2024-05-06T14:04:03.829 INFO:tasks.workunit.client.1.smithi174.stdout:1/129: getdents d11/d1f/d27/d2d 0 2024-05-06T14:04:03.830 INFO:tasks.workunit.client.1.smithi174.stdout:1/130: getdents d11/d1f/d27 0 2024-05-06T14:04:03.830 INFO:tasks.workunit.client.1.smithi174.stdout:1/131: link d11/l17 d11/d1f/d27/d2d/l36 0 2024-05-06T14:04:03.830 INFO:tasks.workunit.client.1.smithi174.stdout:1/132: write d11/f19 [1108150,22590] 0 2024-05-06T14:04:03.830 INFO:tasks.workunit.client.1.smithi174.stdout:7/138: dwrite d0/f2e [860160,81920] 0 2024-05-06T14:04:03.830 INFO:tasks.workunit.client.1.smithi174.stdout:7/139: dread d0/fe [782336,40960] 0 2024-05-06T14:04:03.830 INFO:tasks.workunit.client.1.smithi174.stdout:6/212: dread d0/df/d22/d2c/f37 [1339392,32768] 0 2024-05-06T14:04:03.830 INFO:tasks.workunit.client.1.smithi174.stdout:4/170: dread d1/f19 [86016,20480] 0 2024-05-06T14:04:03.830 INFO:tasks.workunit.client.1.smithi174.stdout:9/149: dwrite dc/d17/f2f [827392,69632] 0 2024-05-06T14:04:03.831 INFO:tasks.workunit.client.1.smithi174.stdout:9/150: creat dc/f30 x:0 0 0 2024-05-06T14:04:03.831 INFO:tasks.workunit.client.1.smithi174.stdout:8/238: dwrite d4/de/f1f [2396160,126976] 0 2024-05-06T14:04:03.831 INFO:tasks.workunit.client.1.smithi174.stdout:8/239: truncate d4/d15/d20/f42 690349 0 2024-05-06T14:04:03.871 INFO:tasks.workunit.client.1.smithi174.stdout:0/115: fsync d0/d1a/d17/fe 0 2024-05-06T14:04:03.872 INFO:tasks.workunit.client.1.smithi174.stdout:1/133: fsync d11/d1f/d27/d2d/f31 0 2024-05-06T14:04:03.874 INFO:tasks.workunit.client.1.smithi174.stdout:4/171: dwrite d1/d1a/f28 [667648,20480] 0 2024-05-06T14:04:03.874 INFO:tasks.workunit.client.1.smithi174.stdout:9/151: dwrite f7 [339968,49152] 0 2024-05-06T14:04:03.875 INFO:tasks.workunit.client.1.smithi174.stdout:0/116: mknod d0/d3/c21 0 2024-05-06T14:04:03.875 INFO:tasks.workunit.client.1.smithi174.stdout:0/117: creat d0/d1a/f22 x:0 0 0 2024-05-06T14:04:03.908 INFO:tasks.workunit.client.1.smithi174.stdout:8/240: fsync d4/d15/f1e 0 2024-05-06T14:04:03.908 INFO:tasks.workunit.client.1.smithi174.stdout:9/152: fdatasync dc/d1c/f24 0 2024-05-06T14:04:03.908 INFO:tasks.workunit.client.1.smithi174.stdout:9/153: dread dc/df/f12 [2887680,81920] 0 2024-05-06T14:04:03.909 INFO:tasks.workunit.client.1.smithi174.stdout:9/154: creat dc/f31 x:0 0 0 2024-05-06T14:04:03.912 INFO:tasks.workunit.client.1.smithi174.stdout:8/241: dwrite d4/de/d24/f43 [344064,45056] 0 2024-05-06T14:04:03.912 INFO:tasks.workunit.client.1.smithi174.stdout:8/242: write d4/de/d23/d41/f4c [512634,20620] 0 2024-05-06T14:04:03.912 INFO:tasks.workunit.client.1.smithi174.stdout:8/243: symlink d4/de/d23/d41/d4e/l51 0 2024-05-06T14:04:03.912 INFO:tasks.workunit.client.1.smithi174.stdout:8/244: symlink d4/de/d23/d3c/l52 0 2024-05-06T14:04:03.913 INFO:tasks.workunit.client.1.smithi174.stdout:4/172: dwrite d1/d1a/f26 [524288,77824] 0 2024-05-06T14:04:03.913 INFO:tasks.workunit.client.1.smithi174.stdout:8/245: readlink d4/l1d 0 2024-05-06T14:04:03.913 INFO:tasks.workunit.client.1.smithi174.stdout:8/246: dread d4/de/d24/f2e [1150976,49152] 0 2024-05-06T14:04:03.913 INFO:tasks.workunit.client.1.smithi174.stdout:4/173: getdents d1/d1a/d3c 0 2024-05-06T14:04:03.913 INFO:tasks.workunit.client.1.smithi174.stdout:8/247: write d4/f49 [366974,41068] 0 2024-05-06T14:04:03.913 INFO:tasks.workunit.client.1.smithi174.stdout:9/155: dwrite dc/de/f2e [413696,118784] 0 2024-05-06T14:04:03.913 INFO:tasks.workunit.client.1.smithi174.stdout:9/156: mknod dc/d14/c32 0 2024-05-06T14:04:03.913 INFO:tasks.workunit.client.1.smithi174.stdout:9/157: rename dc/de/l10 to dc/df/l33 0 2024-05-06T14:04:03.914 INFO:tasks.workunit.client.1.smithi174.stdout:9/158: chown lb 0 1 2024-05-06T14:04:03.946 INFO:tasks.workunit.client.1.smithi174.stdout:1/134: dwrite f5 [3534848,16384] 0 2024-05-06T14:04:03.946 INFO:tasks.workunit.client.1.smithi174.stdout:1/135: symlink d11/l37 0 2024-05-06T14:04:03.950 INFO:tasks.workunit.client.1.smithi174.stdout:8/248: dwrite d4/de/f19 [40960,8192] 0 2024-05-06T14:04:03.951 INFO:tasks.workunit.client.1.smithi174.stdout:8/249: mkdir d4/d53 0 2024-05-06T14:04:03.951 INFO:tasks.workunit.client.1.smithi174.stdout:8/250: creat d4/d15/d20/d3e/f54 x:0 0 0 2024-05-06T14:04:03.951 INFO:tasks.workunit.client.1.smithi174.stdout:8/251: chown d4/de/d24/c26 5265 1 2024-05-06T14:04:03.951 INFO:tasks.workunit.client.1.smithi174.stdout:8/252: creat d4/de/d23/d3c/f55 x:0 0 0 2024-05-06T14:04:03.951 INFO:tasks.workunit.client.1.smithi174.stdout:8/253: mkdir d4/de/d23/d41/d56 0 2024-05-06T14:04:03.952 INFO:tasks.workunit.client.1.smithi174.stdout:8/254: write d4/de/f3f [790641,123088] 0 2024-05-06T14:04:03.952 INFO:tasks.workunit.client.1.smithi174.stdout:8/255: truncate d4/de/d23/d41/f4c 1016635 0 2024-05-06T14:04:04.032 INFO:tasks.workunit.client.1.smithi174.stdout:4/174: fdatasync d1/d1f/d27/f30 0 2024-05-06T14:04:04.032 INFO:tasks.workunit.client.1.smithi174.stdout:9/159: fsync f3 0 2024-05-06T14:04:04.032 INFO:tasks.workunit.client.1.smithi174.stdout:9/160: dread f2 [1187840,32768] 0 2024-05-06T14:04:04.033 INFO:tasks.workunit.client.1.smithi174.stdout:9/161: chown dc/c1b 521595 1 2024-05-06T14:04:04.033 INFO:tasks.workunit.client.1.smithi174.stdout:2/138: fsync d0/d1/d2/f1c 0 2024-05-06T14:04:04.033 INFO:tasks.workunit.client.1.smithi174.stdout:5/181: fdatasync d1/d6/df/d35/d3a/f25 0 2024-05-06T14:04:04.042 INFO:tasks.workunit.client.1.smithi174.stdout:4/175: fsync d1/d1f/d27/f3b 0 2024-05-06T14:04:04.045 INFO:tasks.workunit.client.1.smithi174.stdout:8/256: dwrite d4/de/d24/f43 [286720,4096] 0 2024-05-06T14:04:04.045 INFO:tasks.workunit.client.1.smithi174.stdout:2/139: rename d0/d16/f21 to d0/db/d15/f29 0 2024-05-06T14:04:04.045 INFO:tasks.workunit.client.1.smithi174.stdout:9/162: creat dc/df/f34 x:0 0 0 2024-05-06T14:04:04.045 INFO:tasks.workunit.client.1.smithi174.stdout:8/257: chown d4/l1b 4272399 1 2024-05-06T14:04:04.045 INFO:tasks.workunit.client.1.smithi174.stdout:9/163: dread - dc/f30 zero size 2024-05-06T14:04:04.046 INFO:tasks.workunit.client.1.smithi174.stdout:2/140: mkdir d0/d1/d2/d2a 0 2024-05-06T14:04:04.046 INFO:tasks.workunit.client.1.smithi174.stdout:9/164: symlink dc/d27/l35 0 2024-05-06T14:04:04.046 INFO:tasks.workunit.client.1.smithi174.stdout:9/165: truncate dc/de/f26 1134810 0 2024-05-06T14:04:04.046 INFO:tasks.workunit.client.1.smithi174.stdout:9/166: link dc/de/f28 dc/f36 0 2024-05-06T14:04:04.046 INFO:tasks.workunit.client.1.smithi174.stdout:8/258: write d4/de/f13 [1464256,101137] 0 2024-05-06T14:04:04.046 INFO:tasks.workunit.client.1.smithi174.stdout:9/167: chown dc/f30 1882220 1 2024-05-06T14:04:04.046 INFO:tasks.workunit.client.1.smithi174.stdout:2/141: symlink d0/d1/l2b 0 2024-05-06T14:04:04.046 INFO:tasks.workunit.client.1.smithi174.stdout:2/142: chown d0/d1 12 1 2024-05-06T14:04:04.047 INFO:tasks.workunit.client.1.smithi174.stdout:8/259: mknod d4/d15/d20/d3e/c57 0 2024-05-06T14:04:04.047 INFO:tasks.workunit.client.1.smithi174.stdout:9/168: symlink dc/d27/l37 0 2024-05-06T14:04:04.047 INFO:tasks.workunit.client.1.smithi174.stdout:8/260: truncate d4/f49 1129534 0 2024-05-06T14:04:04.047 INFO:tasks.workunit.client.1.smithi174.stdout:8/261: stat d4/de/d23/d3c/f55 0 2024-05-06T14:04:04.047 INFO:tasks.workunit.client.1.smithi174.stdout:8/262: rmdir d4/d15/d20 39 2024-05-06T14:04:04.047 INFO:tasks.workunit.client.1.smithi174.stdout:2/143: write d0/d24/f27 [314499,95911] 0 2024-05-06T14:04:04.059 INFO:tasks.workunit.client.1.smithi174.stdout:4/176: dread d1/f5 [163840,69632] 0 2024-05-06T14:04:04.087 INFO:tasks.workunit.client.1.smithi174.stdout:9/169: creat dc/d1c/f38 x:0 0 0 2024-05-06T14:04:04.087 INFO:tasks.workunit.client.1.smithi174.stdout:4/177: mkdir d1/d1f/d27/d2c/d45 0 2024-05-06T14:04:04.087 INFO:tasks.workunit.client.1.smithi174.stdout:9/170: creat dc/d27/f39 x:0 0 0 2024-05-06T14:04:04.087 INFO:tasks.workunit.client.1.smithi174.stdout:9/171: mkdir dc/d17/d3a 0 2024-05-06T14:04:04.087 INFO:tasks.workunit.client.1.smithi174.stdout:9/172: dread - dc/f31 zero size 2024-05-06T14:04:04.133 INFO:tasks.workunit.client.1.smithi174.stdout:7/140: fsync d0/da/d19/d24/f10 0 2024-05-06T14:04:04.133 INFO:tasks.workunit.client.1.smithi174.stdout:7/141: chown d0/da/d19/d24/f10 159887416 1 2024-05-06T14:04:04.160 INFO:tasks.workunit.client.1.smithi174.stdout:8/263: fdatasync d4/de/d23/d3c/f55 0 2024-05-06T14:04:04.164 INFO:tasks.workunit.client.1.smithi174.stdout:4/178: dwrite d1/d2e/f3d [1179648,102400] 0 2024-05-06T14:04:04.165 INFO:tasks.workunit.client.1.smithi174.stdout:8/264: mknod d4/d15/d20/c58 0 2024-05-06T14:04:04.165 INFO:tasks.workunit.client.1.smithi174.stdout:9/173: dwrite dc/df/f34 [528384,4096] 0 2024-05-06T14:04:04.165 INFO:tasks.workunit.client.1.smithi174.stdout:7/142: mknod d0/da/d19/c2f 0 2024-05-06T14:04:04.165 INFO:tasks.workunit.client.1.smithi174.stdout:9/174: getdents dc/df 0 2024-05-06T14:04:04.165 INFO:tasks.workunit.client.1.smithi174.stdout:4/179: creat d1/d2e/f46 x:0 0 0 2024-05-06T14:04:04.165 INFO:tasks.workunit.client.1.smithi174.stdout:4/180: truncate d1/d1f/d27/f30 518872 0 2024-05-06T14:04:04.165 INFO:tasks.workunit.client.1.smithi174.stdout:7/143: symlink d0/d1d/l30 0 2024-05-06T14:04:04.166 INFO:tasks.workunit.client.1.smithi174.stdout:8/265: read d4/de/f13 [1095123,122637] 0 2024-05-06T14:04:04.166 INFO:tasks.workunit.client.1.smithi174.stdout:7/144: chown d0/cf 6 1 2024-05-06T14:04:04.166 INFO:tasks.workunit.client.1.smithi174.stdout:4/181: rename d1/d9/ff to d1/d9/d15/f47 0 2024-05-06T14:04:04.166 INFO:tasks.workunit.client.1.smithi174.stdout:7/145: link d0/da/d19/d24/f10 d0/da/d19/f31 0 2024-05-06T14:04:04.166 INFO:tasks.workunit.client.1.smithi174.stdout:8/266: creat d4/de/d23/d3c/f59 x:0 0 0 2024-05-06T14:04:04.166 INFO:tasks.workunit.client.1.smithi174.stdout:8/267: write d4/de/f11 [1953781,19043] 0 2024-05-06T14:04:04.201 INFO:tasks.workunit.client.1.smithi174.stdout:7/146: dwrite d0/da/d19/d24/f1b [327680,110592] 0 2024-05-06T14:04:04.201 INFO:tasks.workunit.client.1.smithi174.stdout:7/147: creat d0/da/d19/f32 x:0 0 0 2024-05-06T14:04:04.201 INFO:tasks.workunit.client.1.smithi174.stdout:7/148: creat d0/da/d19/d24/d14/f33 x:0 0 0 2024-05-06T14:04:04.201 INFO:tasks.workunit.client.1.smithi174.stdout:7/149: rename d0/f1 to d0/f34 0 2024-05-06T14:04:04.202 INFO:tasks.workunit.client.1.smithi174.stdout:7/150: chown d0/da/fb 835193 1 2024-05-06T14:04:04.202 INFO:tasks.workunit.client.1.smithi174.stdout:3/198: sync 2024-05-06T14:04:04.202 INFO:tasks.workunit.client.1.smithi174.stdout:1/136: sync 2024-05-06T14:04:04.202 INFO:tasks.workunit.client.1.smithi174.stdout:6/213: sync 2024-05-06T14:04:04.203 INFO:tasks.workunit.client.1.smithi174.stdout:0/118: sync 2024-05-06T14:04:04.203 INFO:tasks.workunit.client.1.smithi174.stdout:3/199: truncate df/d10/f14 2109258 0 2024-05-06T14:04:04.203 INFO:tasks.workunit.client.1.smithi174.stdout:6/214: symlink d0/df/d45/l46 0 2024-05-06T14:04:04.254 INFO:tasks.workunit.client.1.smithi174.stdout:8/268: fdatasync d4/de/d23/f32 0 2024-05-06T14:04:04.254 INFO:tasks.workunit.client.1.smithi174.stdout:8/269: truncate d4/d15/f16 1924293 0 2024-05-06T14:04:04.254 INFO:tasks.workunit.client.1.smithi174.stdout:8/270: stat d4/de/d24/d46 0 2024-05-06T14:04:04.255 INFO:tasks.workunit.client.1.smithi174.stdout:1/137: fsync fe 0 2024-05-06T14:04:04.255 INFO:tasks.workunit.client.1.smithi174.stdout:0/119: fsync d0/d1a/f1b 0 2024-05-06T14:04:04.255 INFO:tasks.workunit.client.1.smithi174.stdout:3/200: fsync df/d10/d1b/f33 0 2024-05-06T14:04:04.255 INFO:tasks.workunit.client.1.smithi174.stdout:1/138: chown d11/f24 70708 1 2024-05-06T14:04:04.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/215: dread d0/df/f20 [495616,57344] 0 2024-05-06T14:04:04.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/216: chown d0/f3a 12523053 1 2024-05-06T14:04:04.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/217: dread - d0/d25/f30 zero size 2024-05-06T14:04:04.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/218: chown d0/df/d3c/c43 1815200 1 2024-05-06T14:04:04.261 INFO:tasks.workunit.client.1.smithi174.stdout:5/182: sync 2024-05-06T14:04:04.261 INFO:tasks.workunit.client.1.smithi174.stdout:5/183: stat d1/d6/f34 0 2024-05-06T14:04:04.261 INFO:tasks.workunit.client.1.smithi174.stdout:1/139: dread d11/f19 [192512,53248] 0 2024-05-06T14:04:04.261 INFO:tasks.workunit.client.1.smithi174.stdout:0/120: creat d0/d4/d8/f23 x:0 0 0 2024-05-06T14:04:04.261 INFO:tasks.workunit.client.1.smithi174.stdout:5/184: mkdir d1/d6/df/d35/d3a/d41 0 2024-05-06T14:04:04.261 INFO:tasks.workunit.client.1.smithi174.stdout:5/185: truncate d1/d6/df/d35/d3a/f25 2502518 0 2024-05-06T14:04:04.261 INFO:tasks.workunit.client.1.smithi174.stdout:0/121: creat d0/f24 x:0 0 0 2024-05-06T14:04:04.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/122: mkdir d0/d4/d8/d25 0 2024-05-06T14:04:04.262 INFO:tasks.workunit.client.1.smithi174.stdout:3/201: write df/d2d/f38 [442108,123823] 0 2024-05-06T14:04:04.262 INFO:tasks.workunit.client.1.smithi174.stdout:5/186: write d1/d6/df/d35/d3a/f28 [189526,72596] 0 2024-05-06T14:04:04.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/123: symlink d0/d3/dc/l26 0 2024-05-06T14:04:04.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/124: chown d0/d1a/f22 349051920 1 2024-05-06T14:04:04.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/125: write d0/d4/d8/f23 [474215,125845] 0 2024-05-06T14:04:04.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/126: symlink d0/d4/d8/d25/l27 0 2024-05-06T14:04:04.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/127: dread - d0/d1a/f1e zero size 2024-05-06T14:04:04.263 INFO:tasks.workunit.client.1.smithi174.stdout:0/128: creat d0/d19/f28 x:0 0 0 2024-05-06T14:04:04.263 INFO:tasks.workunit.client.1.smithi174.stdout:0/129: unlink d0/d1a/f1f 0 2024-05-06T14:04:04.263 INFO:tasks.workunit.client.1.smithi174.stdout:0/130: creat d0/d3/f29 x:0 0 0 2024-05-06T14:04:04.263 INFO:tasks.workunit.client.1.smithi174.stdout:0/131: dread - d0/d3/f29 zero size 2024-05-06T14:04:04.263 INFO:tasks.workunit.client.1.smithi174.stdout:0/132: write d0/d19/f28 [592480,123155] 0 2024-05-06T14:04:04.263 INFO:tasks.workunit.client.1.smithi174.stdout:0/133: dread d0/d1a/d17/f15 [114688,40960] 0 2024-05-06T14:04:04.311 INFO:tasks.workunit.client.1.smithi174.stdout:8/271: dwrite d4/f49 [1859584,8192] 0 2024-05-06T14:04:04.311 INFO:tasks.workunit.client.1.smithi174.stdout:8/272: mknod d4/de/c5a 0 2024-05-06T14:04:04.311 INFO:tasks.workunit.client.1.smithi174.stdout:8/273: write d4/de/f13 [1748639,13059] 0 2024-05-06T14:04:04.313 INFO:tasks.workunit.client.1.smithi174.stdout:5/187: dwrite d1/d6/df/d35/d3a/db/f1a [860160,122880] 0 2024-05-06T14:04:04.313 INFO:tasks.workunit.client.1.smithi174.stdout:0/134: dwrite d0/d4/d8/f23 [1376256,45056] 0 2024-05-06T14:04:04.313 INFO:tasks.workunit.client.1.smithi174.stdout:1/140: dread d11/d1f/d27/f2b [708608,69632] 0 2024-05-06T14:04:04.313 INFO:tasks.workunit.client.1.smithi174.stdout:5/188: symlink d1/d6/df/d35/l42 0 2024-05-06T14:04:04.313 INFO:tasks.workunit.client.1.smithi174.stdout:5/189: chown d1/d6/d7/d36/f2c 5664 1 2024-05-06T14:04:04.313 INFO:tasks.workunit.client.1.smithi174.stdout:1/141: creat d11/d1f/f38 x:0 0 0 2024-05-06T14:04:04.313 INFO:tasks.workunit.client.1.smithi174.stdout:5/190: creat d1/d6/d7/d36/f43 x:0 0 0 2024-05-06T14:04:04.314 INFO:tasks.workunit.client.1.smithi174.stdout:1/142: stat f5 0 2024-05-06T14:04:04.314 INFO:tasks.workunit.client.1.smithi174.stdout:5/191: getdents d1/d6/df/d35/d3a/db 0 2024-05-06T14:04:04.314 INFO:tasks.workunit.client.1.smithi174.stdout:5/192: dread - d1/d6/df/d35/f3d zero size 2024-05-06T14:04:04.314 INFO:tasks.workunit.client.1.smithi174.stdout:1/143: symlink d11/d1f/d27/l39 0 2024-05-06T14:04:04.314 INFO:tasks.workunit.client.1.smithi174.stdout:5/193: truncate d1/d6/f9 936588 0 2024-05-06T14:04:04.334 INFO:tasks.workunit.client.1.smithi174.stdout:3/202: fdatasync df/d10/f1a 0 2024-05-06T14:04:04.334 INFO:tasks.workunit.client.1.smithi174.stdout:8/274: fdatasync d4/de/f12 0 2024-05-06T14:04:04.334 INFO:tasks.workunit.client.1.smithi174.stdout:3/203: dread f5 [1298432,77824] 0 2024-05-06T14:04:04.338 INFO:tasks.workunit.client.1.smithi174.stdout:9/175: sync 2024-05-06T14:04:04.338 INFO:tasks.workunit.client.1.smithi174.stdout:4/182: sync 2024-05-06T14:04:04.338 INFO:tasks.workunit.client.1.smithi174.stdout:2/144: sync 2024-05-06T14:04:04.341 INFO:tasks.workunit.client.1.smithi174.stdout:2/145: mknod d0/c2c 0 2024-05-06T14:04:04.341 INFO:tasks.workunit.client.1.smithi174.stdout:1/144: dwrite d11/f20 [860160,110592] 0 2024-05-06T14:04:04.341 INFO:tasks.workunit.client.1.smithi174.stdout:0/135: dwrite d0/d1a/d17/f15 [1163264,73728] 0 2024-05-06T14:04:04.341 INFO:tasks.workunit.client.1.smithi174.stdout:3/204: creat df/f44 x:0 0 0 2024-05-06T14:04:04.341 INFO:tasks.workunit.client.1.smithi174.stdout:5/194: dwrite d1/d6/f34 [221184,102400] 0 2024-05-06T14:04:04.341 INFO:tasks.workunit.client.1.smithi174.stdout:1/145: chown d11/l34 20 1 2024-05-06T14:04:04.342 INFO:tasks.workunit.client.1.smithi174.stdout:5/195: readlink d1/l19 0 2024-05-06T14:04:04.342 INFO:tasks.workunit.client.1.smithi174.stdout:9/176: write f2 [968054,28618] 0 2024-05-06T14:04:04.342 INFO:tasks.workunit.client.1.smithi174.stdout:1/146: link f5 d11/d1f/d27/d2d/f3a 0 2024-05-06T14:04:04.342 INFO:tasks.workunit.client.1.smithi174.stdout:2/146: mkdir d0/d1/d2/d4/d18/d2d 0 2024-05-06T14:04:04.342 INFO:tasks.workunit.client.1.smithi174.stdout:5/196: rename d1/d6/d7/f1f to d1/d6/d7/f44 0 2024-05-06T14:04:04.342 INFO:tasks.workunit.client.1.smithi174.stdout:2/147: link d0/d1/d2/f1c d0/db/d15/f2e 0 2024-05-06T14:04:04.342 INFO:tasks.workunit.client.1.smithi174.stdout:1/147: mknod d11/c3b 0 2024-05-06T14:04:04.342 INFO:tasks.workunit.client.1.smithi174.stdout:5/197: dread d1/d6/df/d35/d3a/de/f38 [98304,53248] 0 2024-05-06T14:04:04.343 INFO:tasks.workunit.client.1.smithi174.stdout:9/177: creat dc/f3b x:0 0 0 2024-05-06T14:04:04.343 INFO:tasks.workunit.client.1.smithi174.stdout:0/136: write d0/fa [2560125,55003] 0 2024-05-06T14:04:04.343 INFO:tasks.workunit.client.1.smithi174.stdout:9/178: unlink dc/l20 0 2024-05-06T14:04:04.343 INFO:tasks.workunit.client.1.smithi174.stdout:5/198: chown d1/d6/df/d35/d3a/f3c 121 1 2024-05-06T14:04:04.343 INFO:tasks.workunit.client.1.smithi174.stdout:5/199: chown d1/d6/df/d35/d3a 5043 1 2024-05-06T14:04:04.343 INFO:tasks.workunit.client.1.smithi174.stdout:9/179: link dc/de/c15 dc/de/c3c 0 2024-05-06T14:04:04.343 INFO:tasks.workunit.client.1.smithi174.stdout:5/200: getdents d1/d6/df/d35/d3a/db 0 2024-05-06T14:04:04.343 INFO:tasks.workunit.client.1.smithi174.stdout:0/137: creat d0/d1a/d17/f2a x:0 0 0 2024-05-06T14:04:04.344 INFO:tasks.workunit.client.1.smithi174.stdout:0/138: link d0/d1a/d17/ff d0/d16/f2b 0 2024-05-06T14:04:04.344 INFO:tasks.workunit.client.1.smithi174.stdout:9/180: write dc/de/f2e [41265,48493] 0 2024-05-06T14:04:04.344 INFO:tasks.workunit.client.1.smithi174.stdout:9/181: write dc/f25 [559004,15365] 0 2024-05-06T14:04:04.344 INFO:tasks.workunit.client.1.smithi174.stdout:0/139: truncate d0/d16/f2b 441212 0 2024-05-06T14:04:04.344 INFO:tasks.workunit.client.1.smithi174.stdout:0/140: readlink d0/d3/dc/l26 0 2024-05-06T14:04:04.344 INFO:tasks.workunit.client.1.smithi174.stdout:9/182: truncate f3 1443723 0 2024-05-06T14:04:04.344 INFO:tasks.workunit.client.1.smithi174.stdout:0/141: dread d0/d19/f28 [425984,114688] 0 2024-05-06T14:04:04.344 INFO:tasks.workunit.client.1.smithi174.stdout:0/142: mknod d0/d1a/c2c 0 2024-05-06T14:04:04.345 INFO:tasks.workunit.client.1.smithi174.stdout:0/143: link d0/d3/dc/c18 d0/d1a/d17/c2d 0 2024-05-06T14:04:04.345 INFO:tasks.workunit.client.1.smithi174.stdout:9/183: write f2 [1857405,61361] 0 2024-05-06T14:04:04.345 INFO:tasks.workunit.client.1.smithi174.stdout:0/144: mkdir d0/d1a/d17/d2e 0 2024-05-06T14:04:04.345 INFO:tasks.workunit.client.1.smithi174.stdout:0/145: mknod d0/d3/dc/c2f 0 2024-05-06T14:04:04.345 INFO:tasks.workunit.client.1.smithi174.stdout:0/146: truncate d0/fa 3280534 0 2024-05-06T14:04:04.345 INFO:tasks.workunit.client.1.smithi174.stdout:0/147: chown d0/d1a/f13 583323839 1 2024-05-06T14:04:04.345 INFO:tasks.workunit.client.1.smithi174.stdout:0/148: truncate d0/d1a/d17/fe 402130 0 2024-05-06T14:04:04.345 INFO:tasks.workunit.client.1.smithi174.stdout:0/149: creat d0/d1a/f30 x:0 0 0 2024-05-06T14:04:04.346 INFO:tasks.workunit.client.1.smithi174.stdout:0/150: rename d0/d1a/d17/f15 to d0/d19/f31 0 2024-05-06T14:04:04.401 INFO:tasks.workunit.client.1.smithi174.stdout:4/183: fdatasync d1/d9/f12 0 2024-05-06T14:04:04.401 INFO:tasks.workunit.client.1.smithi174.stdout:3/205: dwrite df/d2d/f31 [671744,118784] 0 2024-05-06T14:04:04.402 INFO:tasks.workunit.client.1.smithi174.stdout:3/206: mknod df/c45 0 2024-05-06T14:04:04.402 INFO:tasks.workunit.client.1.smithi174.stdout:3/207: mknod df/d10/c46 0 2024-05-06T14:04:04.402 INFO:tasks.workunit.client.1.smithi174.stdout:3/208: symlink df/d10/l47 0 2024-05-06T14:04:04.405 INFO:tasks.workunit.client.1.smithi174.stdout:2/148: dwrite d0/d16/f19 [184320,8192] 0 2024-05-06T14:04:04.405 INFO:tasks.workunit.client.1.smithi174.stdout:9/184: dwrite dc/f31 [258048,12288] 0 2024-05-06T14:04:04.405 INFO:tasks.workunit.client.1.smithi174.stdout:2/149: read d0/d1/d2/d4/d6/f7 [22376,26439] 0 2024-05-06T14:04:04.406 INFO:tasks.workunit.client.1.smithi174.stdout:9/185: chown dc/d17/d3a 3 1 2024-05-06T14:04:04.406 INFO:tasks.workunit.client.1.smithi174.stdout:2/150: unlink d0/d1/d2/d4/d6/f1f 0 2024-05-06T14:04:04.406 INFO:tasks.workunit.client.1.smithi174.stdout:2/151: rmdir d0/db/d15 39 2024-05-06T14:04:04.406 INFO:tasks.workunit.client.1.smithi174.stdout:9/186: unlink lb 0 2024-05-06T14:04:04.406 INFO:tasks.workunit.client.1.smithi174.stdout:2/152: rename d0/da/lc to d0/d1/d2/l2f 0 2024-05-06T14:04:04.406 INFO:tasks.workunit.client.1.smithi174.stdout:9/187: creat dc/f3d x:0 0 0 2024-05-06T14:04:04.407 INFO:tasks.workunit.client.1.smithi174.stdout:9/188: readlink dc/d27/l35 0 2024-05-06T14:04:04.407 INFO:tasks.workunit.client.1.smithi174.stdout:9/189: rename dc/de/f28 to dc/de/f3e 0 2024-05-06T14:04:04.407 INFO:tasks.workunit.client.1.smithi174.stdout:9/190: chown dc/df/f11 13126 1 2024-05-06T14:04:04.407 INFO:tasks.workunit.client.1.smithi174.stdout:9/191: symlink dc/d17/d3a/l3f 0 2024-05-06T14:04:04.407 INFO:tasks.workunit.client.1.smithi174.stdout:1/148: dwrite fb [1454080,122880] 0 2024-05-06T14:04:04.407 INFO:tasks.workunit.client.1.smithi174.stdout:9/192: write f3 [1455572,73493] 0 2024-05-06T14:04:04.407 INFO:tasks.workunit.client.1.smithi174.stdout:1/149: getdents d11/d1f/d27/d32 0 2024-05-06T14:04:04.407 INFO:tasks.workunit.client.1.smithi174.stdout:1/150: stat d11/l1d 0 2024-05-06T14:04:04.407 INFO:tasks.workunit.client.1.smithi174.stdout:9/193: mknod dc/de/c40 0 2024-05-06T14:04:04.408 INFO:tasks.workunit.client.1.smithi174.stdout:9/194: chown dc/d17/f29 1699 1 2024-05-06T14:04:04.408 INFO:tasks.workunit.client.1.smithi174.stdout:1/151: creat d11/f3c x:0 0 0 2024-05-06T14:04:04.408 INFO:tasks.workunit.client.1.smithi174.stdout:9/195: creat dc/d1c/f41 x:0 0 0 2024-05-06T14:04:04.408 INFO:tasks.workunit.client.1.smithi174.stdout:1/152: link c10 d11/d1f/c3d 0 2024-05-06T14:04:04.408 INFO:tasks.workunit.client.1.smithi174.stdout:1/153: dread f5 [851968,57344] 0 2024-05-06T14:04:04.408 INFO:tasks.workunit.client.1.smithi174.stdout:5/201: dwrite d1/d6/df/d35/d3a/de/f3f [765952,40960] 0 2024-05-06T14:04:04.408 INFO:tasks.workunit.client.1.smithi174.stdout:9/196: write f3 [6994,128618] 0 2024-05-06T14:04:04.409 INFO:tasks.workunit.client.1.smithi174.stdout:9/197: write fa [211732,96494] 0 2024-05-06T14:04:04.409 INFO:tasks.workunit.client.1.smithi174.stdout:0/151: read d0/d19/f31 [1350592,113890] 0 2024-05-06T14:04:04.409 INFO:tasks.workunit.client.1.smithi174.stdout:0/152: write d0/d3/f29 [129642,1453] 0 2024-05-06T14:04:04.409 INFO:tasks.workunit.client.1.smithi174.stdout:4/184: write d1/d9/f20 [191129,77691] 0 2024-05-06T14:04:04.453 INFO:tasks.workunit.client.1.smithi174.stdout:3/209: fsync df/d10/d1b/f24 0 2024-05-06T14:04:04.453 INFO:tasks.workunit.client.1.smithi174.stdout:3/210: readlink df/l32 0 2024-05-06T14:04:04.453 INFO:tasks.workunit.client.1.smithi174.stdout:3/211: link df/d10/d1b/f22 df/d10/f48 0 2024-05-06T14:04:04.453 INFO:tasks.workunit.client.1.smithi174.stdout:3/212: symlink df/d10/d1b/l49 0 2024-05-06T14:04:04.453 INFO:tasks.workunit.client.1.smithi174.stdout:3/213: creat df/d2d/f4a x:0 0 0 2024-05-06T14:04:04.453 INFO:tasks.workunit.client.1.smithi174.stdout:3/214: truncate df/d2d/f36 859663 0 2024-05-06T14:04:04.453 INFO:tasks.workunit.client.1.smithi174.stdout:2/153: dwrite d0/d1/f5 [2613248,86016] 0 2024-05-06T14:04:04.454 INFO:tasks.workunit.client.1.smithi174.stdout:2/154: stat d0/d1/d2/d1b 0 2024-05-06T14:04:04.454 INFO:tasks.workunit.client.1.smithi174.stdout:2/155: read d0/db/d15/f2e [653359,103159] 0 2024-05-06T14:04:04.454 INFO:tasks.workunit.client.1.smithi174.stdout:2/156: dread d0/d24/f27 [32768,118784] 0 2024-05-06T14:04:04.454 INFO:tasks.workunit.client.1.smithi174.stdout:2/157: creat d0/db/d15/f30 x:0 0 0 2024-05-06T14:04:04.454 INFO:tasks.workunit.client.1.smithi174.stdout:2/158: symlink d0/l31 0 2024-05-06T14:04:04.455 INFO:tasks.workunit.client.1.smithi174.stdout:1/154: dwrite d11/d1f/d27/d2d/f33 [978944,86016] 0 2024-05-06T14:04:04.455 INFO:tasks.workunit.client.1.smithi174.stdout:5/202: dwrite d1/d6/df/d35/d3a/f33 [598016,28672] 0 2024-05-06T14:04:04.455 INFO:tasks.workunit.client.1.smithi174.stdout:5/203: rmdir d1/d6/df/d35/d3a/db/d1e 39 2024-05-06T14:04:04.456 INFO:tasks.workunit.client.1.smithi174.stdout:5/204: write d1/d6/df/d35/d3a/de/f3f [1521653,81653] 0 2024-05-06T14:04:04.456 INFO:tasks.workunit.client.1.smithi174.stdout:5/205: chown d1/d6/c14 0 1 2024-05-06T14:04:04.458 INFO:tasks.workunit.client.1.smithi174.stdout:2/159: read d0/d1/f5 [1083220,30349] 0 2024-05-06T14:04:04.497 INFO:tasks.workunit.client.1.smithi174.stdout:4/185: fsync d1/d9/f18 0 2024-05-06T14:04:04.499 INFO:tasks.workunit.client.1.smithi174.stdout:6/219: sync 2024-05-06T14:04:04.500 INFO:tasks.workunit.client.1.smithi174.stdout:7/151: sync 2024-05-06T14:04:04.500 INFO:tasks.workunit.client.1.smithi174.stdout:7/152: dread - d0/da/d19/d24/d14/f33 zero size 2024-05-06T14:04:04.500 INFO:tasks.workunit.client.1.smithi174.stdout:6/220: dread d0/df/f20 [417792,36864] 0 2024-05-06T14:04:04.500 INFO:tasks.workunit.client.1.smithi174.stdout:7/153: unlink d0/d1d/f2a 0 2024-05-06T14:04:04.501 INFO:tasks.workunit.client.1.smithi174.stdout:1/155: unlink fb 0 2024-05-06T14:04:04.501 INFO:tasks.workunit.client.1.smithi174.stdout:2/160: mkdir d0/d1/d2/d4/d18/d2d/d32 0 2024-05-06T14:04:04.501 INFO:tasks.workunit.client.1.smithi174.stdout:2/161: stat d0/db/d15/f2e 0 2024-05-06T14:04:04.501 INFO:tasks.workunit.client.1.smithi174.stdout:2/162: read d0/d1/d2/f1c [692924,24074] 0 2024-05-06T14:04:04.502 INFO:tasks.workunit.client.1.smithi174.stdout:2/163: chown d0/d1/d2/d4/d18/d2d/d32 1369 1 2024-05-06T14:04:04.502 INFO:tasks.workunit.client.1.smithi174.stdout:2/164: write d0/d16/f19 [1618091,124316] 0 2024-05-06T14:04:04.504 INFO:tasks.workunit.client.1.smithi174.stdout:6/221: dread d0/f16 [303104,36864] 0 2024-05-06T14:04:04.505 INFO:tasks.workunit.client.1.smithi174.stdout:6/222: chown d0/l1c 12573 1 2024-05-06T14:04:04.574 INFO:tasks.workunit.client.1.smithi174.stdout:4/186: fdatasync d1/d9/f16 0 2024-05-06T14:04:04.575 INFO:tasks.workunit.client.1.smithi174.stdout:7/154: fsync d0/da/d19/d24/f10 0 2024-05-06T14:04:04.575 INFO:tasks.workunit.client.1.smithi174.stdout:2/165: fdatasync d0/db/d15/f2e 0 2024-05-06T14:04:04.575 INFO:tasks.workunit.client.1.smithi174.stdout:2/166: readlink d0/l31 0 2024-05-06T14:04:04.575 INFO:tasks.workunit.client.1.smithi174.stdout:7/155: getdents d0/da/d19 0 2024-05-06T14:04:04.575 INFO:tasks.workunit.client.1.smithi174.stdout:7/156: read - d0/da/d19/f2d zero size 2024-05-06T14:04:04.575 INFO:tasks.workunit.client.1.smithi174.stdout:2/167: mknod d0/db/c33 0 2024-05-06T14:04:04.575 INFO:tasks.workunit.client.1.smithi174.stdout:2/168: truncate d0/d1/d2/f1c 106362 0 2024-05-06T14:04:04.575 INFO:tasks.workunit.client.1.smithi174.stdout:7/157: mkdir d0/da/d19/d35 0 2024-05-06T14:04:04.576 INFO:tasks.workunit.client.1.smithi174.stdout:2/169: creat d0/da/f34 x:0 0 0 2024-05-06T14:04:04.576 INFO:tasks.workunit.client.1.smithi174.stdout:7/158: write d0/da/d19/d24/f10 [3163495,102330] 0 2024-05-06T14:04:04.576 INFO:tasks.workunit.client.1.smithi174.stdout:7/159: mknod d0/da/d19/d35/c36 0 2024-05-06T14:04:04.576 INFO:tasks.workunit.client.1.smithi174.stdout:7/160: write d0/f34 [4204915,2429] 0 2024-05-06T14:04:04.576 INFO:tasks.workunit.client.1.smithi174.stdout:7/161: dread d0/d1d/f1e [159744,102400] 0 2024-05-06T14:04:04.576 INFO:tasks.workunit.client.1.smithi174.stdout:7/162: mkdir d0/da/d28/d37 0 2024-05-06T14:04:04.576 INFO:tasks.workunit.client.1.smithi174.stdout:7/163: getdents d0 0 2024-05-06T14:04:04.577 INFO:tasks.workunit.client.1.smithi174.stdout:1/156: dwrite d11/f22 [1421312,69632] 0 2024-05-06T14:04:04.577 INFO:tasks.workunit.client.1.smithi174.stdout:1/157: unlink d11/d1f/c3d 0 2024-05-06T14:04:04.578 INFO:tasks.workunit.client.1.smithi174.stdout:6/223: dread d0/d25/f40 [405504,65536] 0 2024-05-06T14:04:04.578 INFO:tasks.workunit.client.1.smithi174.stdout:6/224: creat d0/df/d45/f47 x:0 0 0 2024-05-06T14:04:04.578 INFO:tasks.workunit.client.1.smithi174.stdout:6/225: rmdir d0/df/d45 39 2024-05-06T14:04:04.578 INFO:tasks.workunit.client.1.smithi174.stdout:6/226: stat d0/l1c 0 2024-05-06T14:04:04.627 INFO:tasks.workunit.client.1.smithi174.stdout:4/187: fsync d1/d9/f18 0 2024-05-06T14:04:04.627 INFO:tasks.workunit.client.1.smithi174.stdout:4/188: chown d1/d1a/f28 128605 1 2024-05-06T14:04:04.627 INFO:tasks.workunit.client.1.smithi174.stdout:4/189: chown d1/d1a 252690 1 2024-05-06T14:04:04.628 INFO:tasks.workunit.client.1.smithi174.stdout:1/158: dwrite d11/d1f/d27/d2d/f3a [614400,4096] 0 2024-05-06T14:04:04.628 INFO:tasks.workunit.client.1.smithi174.stdout:1/159: symlink d11/l3e 0 2024-05-06T14:04:04.629 INFO:tasks.workunit.client.1.smithi174.stdout:1/160: rename d11/d1f/d27/d2d/c30 to d11/d1f/c3f 0 2024-05-06T14:04:04.629 INFO:tasks.workunit.client.1.smithi174.stdout:1/161: link fc d11/d1f/d27/d2d/f40 0 2024-05-06T14:04:04.629 INFO:tasks.workunit.client.1.smithi174.stdout:2/170: dwrite d0/d1/d2/f20 [176128,94208] 0 2024-05-06T14:04:04.629 INFO:tasks.workunit.client.1.smithi174.stdout:2/171: truncate d0/d1/d2/f20 842246 0 2024-05-06T14:04:04.643 INFO:tasks.workunit.client.1.smithi174.stdout:6/227: dread d0/df/f14 [172032,106496] 0 2024-05-06T14:04:04.643 INFO:tasks.workunit.client.1.smithi174.stdout:6/228: rmdir d0/d25/d35 39 2024-05-06T14:04:04.643 INFO:tasks.workunit.client.1.smithi174.stdout:6/229: getdents d0/df/d22/d2c 0 2024-05-06T14:04:04.661 INFO:tasks.workunit.client.1.smithi174.stdout:7/164: fsync d0/da/d19/f32 0 2024-05-06T14:04:04.661 INFO:tasks.workunit.client.1.smithi174.stdout:7/165: stat d0/da/d19/d35/c36 0 2024-05-06T14:04:04.662 INFO:tasks.workunit.client.1.smithi174.stdout:3/215: fsync df/d2d/f31 0 2024-05-06T14:04:04.664 INFO:tasks.workunit.client.1.smithi174.stdout:2/172: dwrite d0/d1/d2/f17 [217088,4096] 0 2024-05-06T14:04:04.673 INFO:tasks.workunit.client.1.smithi174.stdout:2/173: truncate d0/d16/f19 1941842 0 2024-05-06T14:04:04.673 INFO:tasks.workunit.client.1.smithi174.stdout:1/162: dwrite d11/d1f/d27/d2d/f33 [385024,24576] 0 2024-05-06T14:04:04.673 INFO:tasks.workunit.client.1.smithi174.stdout:6/230: dwrite d0/f15 [1527808,106496] 0 2024-05-06T14:04:04.673 INFO:tasks.workunit.client.1.smithi174.stdout:3/216: mkdir df/d2d/d4b 0 2024-05-06T14:04:04.673 INFO:tasks.workunit.client.1.smithi174.stdout:2/174: dread - d0/d1/d2/d4/d6/f26 zero size 2024-05-06T14:04:04.673 INFO:tasks.workunit.client.1.smithi174.stdout:6/231: truncate d0/df/f1f 748082 0 2024-05-06T14:04:04.674 INFO:tasks.workunit.client.1.smithi174.stdout:1/163: mkdir d11/d41 0 2024-05-06T14:04:04.674 INFO:tasks.workunit.client.1.smithi174.stdout:3/217: write f7 [1223303,81398] 0 2024-05-06T14:04:04.674 INFO:tasks.workunit.client.1.smithi174.stdout:6/232: mkdir d0/d48 0 2024-05-06T14:04:04.674 INFO:tasks.workunit.client.1.smithi174.stdout:6/233: mknod d0/df/d45/c49 0 2024-05-06T14:04:04.674 INFO:tasks.workunit.client.1.smithi174.stdout:6/234: unlink d0/le 0 2024-05-06T14:04:04.675 INFO:tasks.workunit.client.1.smithi174.stdout:6/235: symlink d0/df/d22/l4a 0 2024-05-06T14:04:04.675 INFO:tasks.workunit.client.1.smithi174.stdout:6/236: getdents d0/df/d22/d2c 0 2024-05-06T14:04:04.675 INFO:tasks.workunit.client.1.smithi174.stdout:6/237: chown d0/d25/d35 508184831 1 2024-05-06T14:04:04.675 INFO:tasks.workunit.client.1.smithi174.stdout:6/238: mkdir d0/df/d45/d4b 0 2024-05-06T14:04:04.675 INFO:tasks.workunit.client.1.smithi174.stdout:7/166: dwrite d0/da/fb [1576960,81920] 0 2024-05-06T14:04:04.675 INFO:tasks.workunit.client.1.smithi174.stdout:2/175: dwrite d0/db/d15/f29 [499712,118784] 0 2024-05-06T14:04:04.676 INFO:tasks.workunit.client.1.smithi174.stdout:1/164: dread d11/d1f/d27/d2d/f33 [327680,106496] 0 2024-05-06T14:04:04.676 INFO:tasks.workunit.client.1.smithi174.stdout:1/165: mknod d11/c42 0 2024-05-06T14:04:04.676 INFO:tasks.workunit.client.1.smithi174.stdout:1/166: creat d11/d1f/d27/d2d/f43 x:0 0 0 2024-05-06T14:04:04.676 INFO:tasks.workunit.client.1.smithi174.stdout:1/167: write d11/d1f/f38 [618288,22273] 0 2024-05-06T14:04:04.676 INFO:tasks.workunit.client.1.smithi174.stdout:1/168: mknod d11/d1f/d27/d32/c44 0 2024-05-06T14:04:04.676 INFO:tasks.workunit.client.1.smithi174.stdout:1/169: link d11/d1f/d27/d2d/f31 d11/d1f/d27/f45 0 2024-05-06T14:04:04.676 INFO:tasks.workunit.client.1.smithi174.stdout:1/170: symlink d11/d1f/l46 0 2024-05-06T14:04:04.677 INFO:tasks.workunit.client.1.smithi174.stdout:3/218: dwrite df/d10/f48 [126976,90112] 0 2024-05-06T14:04:04.677 INFO:tasks.workunit.client.1.smithi174.stdout:3/219: chown df/d10/d1b 399 1 2024-05-06T14:04:04.677 INFO:tasks.workunit.client.1.smithi174.stdout:3/220: link df/d10/f48 df/d10/f4c 0 2024-05-06T14:04:04.677 INFO:tasks.workunit.client.1.smithi174.stdout:6/239: dread d0/d25/f40 [258048,94208] 0 2024-05-06T14:04:04.677 INFO:tasks.workunit.client.1.smithi174.stdout:3/221: read df/d2d/f36 [374437,73799] 0 2024-05-06T14:04:04.677 INFO:tasks.workunit.client.1.smithi174.stdout:6/240: mkdir d0/df/d22/d4c 0 2024-05-06T14:04:04.677 INFO:tasks.workunit.client.1.smithi174.stdout:8/275: sync 2024-05-06T14:04:04.677 INFO:tasks.workunit.client.1.smithi174.stdout:3/222: mkdir df/d2d/d4d 0 2024-05-06T14:04:04.677 INFO:tasks.workunit.client.1.smithi174.stdout:3/223: dread fe [815104,16384] 0 2024-05-06T14:04:04.678 INFO:tasks.workunit.client.1.smithi174.stdout:8/276: unlink d4/de/f3f 0 2024-05-06T14:04:04.678 INFO:tasks.workunit.client.1.smithi174.stdout:3/224: write df/d10/f3a [897475,12181] 0 2024-05-06T14:04:04.678 INFO:tasks.workunit.client.1.smithi174.stdout:8/277: getdents d4/d15/d20/d3e 0 2024-05-06T14:04:04.678 INFO:tasks.workunit.client.1.smithi174.stdout:8/278: mknod d4/de/d24/d46/c5b 0 2024-05-06T14:04:04.678 INFO:tasks.workunit.client.1.smithi174.stdout:8/279: creat d4/d48/f5c x:0 0 0 2024-05-06T14:04:04.748 INFO:tasks.workunit.client.1.smithi174.stdout:1/171: dwrite d11/d1f/d27/d2d/f31 [1708032,12288] 0 2024-05-06T14:04:04.749 INFO:tasks.workunit.client.1.smithi174.stdout:1/172: dread - d11/f2c zero size 2024-05-06T14:04:04.749 INFO:tasks.workunit.client.1.smithi174.stdout:3/225: dwrite df/d10/f3f [937984,102400] 0 2024-05-06T14:04:04.750 INFO:tasks.workunit.client.1.smithi174.stdout:1/173: dwrite fc [2162688,57344] 0 2024-05-06T14:04:04.761 INFO:tasks.workunit.client.1.smithi174.stdout:8/280: dread d4/de/f11 [524288,24576] 0 2024-05-06T14:04:04.761 INFO:tasks.workunit.client.1.smithi174.stdout:8/281: write d4/fb [423777,61707] 0 2024-05-06T14:04:04.762 INFO:tasks.workunit.client.1.smithi174.stdout:8/282: unlink d4/d15/d20/c21 0 2024-05-06T14:04:04.762 INFO:tasks.workunit.client.1.smithi174.stdout:8/283: rename d4/de/f11 to d4/de/d23/d41/d56/f5d 0 2024-05-06T14:04:04.769 INFO:tasks.workunit.client.1.smithi174.stdout:6/241: dread d0/df/f20 [126976,69632] 0 2024-05-06T14:04:04.769 INFO:tasks.workunit.client.1.smithi174.stdout:6/242: creat d0/d25/d35/f4d x:0 0 0 2024-05-06T14:04:04.769 INFO:tasks.workunit.client.1.smithi174.stdout:6/243: write d0/f3a [534708,48943] 0 2024-05-06T14:04:04.797 INFO:tasks.workunit.client.1.smithi174.stdout:7/167: fdatasync d0/d1d/f2c 0 2024-05-06T14:04:04.797 INFO:tasks.workunit.client.1.smithi174.stdout:4/190: fsync d1/d9/f20 0 2024-05-06T14:04:04.797 INFO:tasks.workunit.client.1.smithi174.stdout:7/168: truncate d0/da/d11/f20 2592782 0 2024-05-06T14:04:04.797 INFO:tasks.workunit.client.1.smithi174.stdout:7/169: truncate d0/f34 4608670 0 2024-05-06T14:04:04.797 INFO:tasks.workunit.client.1.smithi174.stdout:7/170: creat d0/da/f38 x:0 0 0 2024-05-06T14:04:04.797 INFO:tasks.workunit.client.1.smithi174.stdout:7/171: dread - d0/da/d19/f2d zero size 2024-05-06T14:04:04.798 INFO:tasks.workunit.client.1.smithi174.stdout:7/172: dread - d0/d1d/f2c zero size 2024-05-06T14:04:04.798 INFO:tasks.workunit.client.1.smithi174.stdout:8/284: dwrite d4/de/d23/f25 [1564672,94208] 0 2024-05-06T14:04:04.798 INFO:tasks.workunit.client.1.smithi174.stdout:3/226: dwrite df/d2d/f37 [966656,86016] 0 2024-05-06T14:04:04.799 INFO:tasks.workunit.client.1.smithi174.stdout:3/227: readlink df/d10/d1b/l40 0 2024-05-06T14:04:04.799 INFO:tasks.workunit.client.1.smithi174.stdout:3/228: truncate df/d2d/f38 950942 0 2024-05-06T14:04:04.854 INFO:tasks.workunit.client.1.smithi174.stdout:2/176: fsync d0/db/d15/f2e 0 2024-05-06T14:04:04.854 INFO:tasks.workunit.client.1.smithi174.stdout:3/229: readlink df/d2d/l35 0 2024-05-06T14:04:04.854 INFO:tasks.workunit.client.1.smithi174.stdout:3/230: chown df/d10/d1b/l3d 81 1 2024-05-06T14:04:04.860 INFO:tasks.workunit.client.1.smithi174.stdout:4/191: dread d1/f19 [53248,114688] 0 2024-05-06T14:04:04.860 INFO:tasks.workunit.client.1.smithi174.stdout:2/177: dwrite d0/d1/d2/f1c [675840,98304] 0 2024-05-06T14:04:04.861 INFO:tasks.workunit.client.1.smithi174.stdout:3/231: dwrite df/d2d/f39 [798720,86016] 0 2024-05-06T14:04:04.861 INFO:tasks.workunit.client.1.smithi174.stdout:0/153: sync 2024-05-06T14:04:04.861 INFO:tasks.workunit.client.1.smithi174.stdout:9/198: sync 2024-05-06T14:04:04.861 INFO:tasks.workunit.client.1.smithi174.stdout:5/206: sync 2024-05-06T14:04:04.861 INFO:tasks.workunit.client.1.smithi174.stdout:9/199: chown dc/d14/c32 1397 1 2024-05-06T14:04:04.862 INFO:tasks.workunit.client.1.smithi174.stdout:0/154: write d0/fa [2061434,3961] 0 2024-05-06T14:04:04.862 INFO:tasks.workunit.client.1.smithi174.stdout:0/155: unlink d0/d16/f2b 0 2024-05-06T14:04:04.862 INFO:tasks.workunit.client.1.smithi174.stdout:7/173: dwrite d0/d1d/f2c [655360,45056] 0 2024-05-06T14:04:04.862 INFO:tasks.workunit.client.1.smithi174.stdout:8/285: dread d4/d15/d20/f42 [512000,40960] 0 2024-05-06T14:04:04.862 INFO:tasks.workunit.client.1.smithi174.stdout:9/200: creat dc/f42 x:0 0 0 2024-05-06T14:04:04.862 INFO:tasks.workunit.client.1.smithi174.stdout:7/174: getdents d0/da/d19/d35 0 2024-05-06T14:04:04.862 INFO:tasks.workunit.client.1.smithi174.stdout:3/232: mkdir df/d2d/d4e 0 2024-05-06T14:04:04.863 INFO:tasks.workunit.client.1.smithi174.stdout:0/156: mkdir d0/d4/d8/d25/d32 0 2024-05-06T14:04:04.863 INFO:tasks.workunit.client.1.smithi174.stdout:3/233: truncate fe 1816254 0 2024-05-06T14:04:04.863 INFO:tasks.workunit.client.1.smithi174.stdout:5/207: creat d1/f45 x:0 0 0 2024-05-06T14:04:04.863 INFO:tasks.workunit.client.1.smithi174.stdout:0/157: rename d0/d1a/c2c to d0/d1a/d17/c33 0 2024-05-06T14:04:04.863 INFO:tasks.workunit.client.1.smithi174.stdout:9/201: mkdir dc/d14/d43 0 2024-05-06T14:04:04.863 INFO:tasks.workunit.client.1.smithi174.stdout:8/286: mkdir d4/de/d24/d5e 0 2024-05-06T14:04:04.863 INFO:tasks.workunit.client.1.smithi174.stdout:4/192: mkdir d1/d48 0 2024-05-06T14:04:04.864 INFO:tasks.workunit.client.1.smithi174.stdout:9/202: readlink dc/l19 0 2024-05-06T14:04:04.864 INFO:tasks.workunit.client.1.smithi174.stdout:3/234: getdents df 0 2024-05-06T14:04:04.864 INFO:tasks.workunit.client.1.smithi174.stdout:7/175: mkdir d0/da/d19/d39 0 2024-05-06T14:04:04.864 INFO:tasks.workunit.client.1.smithi174.stdout:9/203: truncate dc/df/f11 3819089 0 2024-05-06T14:04:04.864 INFO:tasks.workunit.client.1.smithi174.stdout:8/287: creat d4/d15/d20/f5f x:0 0 0 2024-05-06T14:04:04.864 INFO:tasks.workunit.client.1.smithi174.stdout:3/235: dread f7 [524288,77824] 0 2024-05-06T14:04:04.864 INFO:tasks.workunit.client.1.smithi174.stdout:8/288: stat d4/de/f1f 0 2024-05-06T14:04:04.864 INFO:tasks.workunit.client.1.smithi174.stdout:4/193: creat d1/d9/d15/d41/f49 x:0 0 0 2024-05-06T14:04:04.865 INFO:tasks.workunit.client.1.smithi174.stdout:5/208: dread d1/d6/f9 [65536,122880] 0 2024-05-06T14:04:04.865 INFO:tasks.workunit.client.1.smithi174.stdout:0/158: mkdir d0/d34 0 2024-05-06T14:04:04.865 INFO:tasks.workunit.client.1.smithi174.stdout:3/236: truncate df/d2d/f4a 753140 0 2024-05-06T14:04:04.865 INFO:tasks.workunit.client.1.smithi174.stdout:5/209: chown d1/d6/df/d35/d3a/db/c40 512212824 1 2024-05-06T14:04:04.865 INFO:tasks.workunit.client.1.smithi174.stdout:8/289: link d4/de/d23/d41/d4e/c4f d4/de/d24/d5e/c60 0 2024-05-06T14:04:04.865 INFO:tasks.workunit.client.1.smithi174.stdout:7/176: truncate d0/f2e 783414 0 2024-05-06T14:04:04.865 INFO:tasks.workunit.client.1.smithi174.stdout:8/290: readlink d4/de/d24/l37 0 2024-05-06T14:04:04.865 INFO:tasks.workunit.client.1.smithi174.stdout:8/291: stat d4/d15/d20/f44 0 2024-05-06T14:04:04.865 INFO:tasks.workunit.client.1.smithi174.stdout:3/237: creat df/d2d/d4d/f4f x:0 0 0 2024-05-06T14:04:04.866 INFO:tasks.workunit.client.1.smithi174.stdout:4/194: write d1/d2e/f39 [821199,27012] 0 2024-05-06T14:04:04.866 INFO:tasks.workunit.client.1.smithi174.stdout:7/177: mkdir d0/d3a 0 2024-05-06T14:04:04.866 INFO:tasks.workunit.client.1.smithi174.stdout:3/238: unlink df/d10/d1b/l3d 0 2024-05-06T14:04:04.866 INFO:tasks.workunit.client.1.smithi174.stdout:7/178: truncate d0/da/d19/d24/d14/f33 992059 0 2024-05-06T14:04:04.866 INFO:tasks.workunit.client.1.smithi174.stdout:4/195: rename d1/d9/d15/l1e to d1/l4a 0 2024-05-06T14:04:04.866 INFO:tasks.workunit.client.1.smithi174.stdout:2/178: dwrite d0/d1/d2/d4/f22 [778240,69632] 0 2024-05-06T14:04:04.866 INFO:tasks.workunit.client.1.smithi174.stdout:7/179: mknod d0/da/d19/d24/d14/c3b 0 2024-05-06T14:04:04.866 INFO:tasks.workunit.client.1.smithi174.stdout:4/196: symlink d1/d2e/l4b 0 2024-05-06T14:04:04.867 INFO:tasks.workunit.client.1.smithi174.stdout:2/179: link d0/db/d15/f30 d0/d1/f35 0 2024-05-06T14:04:04.867 INFO:tasks.workunit.client.1.smithi174.stdout:4/197: creat d1/d9/d15/f4c x:0 0 0 2024-05-06T14:04:04.867 INFO:tasks.workunit.client.1.smithi174.stdout:8/292: write d4/d15/d20/f34 [1304939,119556] 0 2024-05-06T14:04:04.867 INFO:tasks.workunit.client.1.smithi174.stdout:7/180: write d0/da/f38 [15697,21202] 0 2024-05-06T14:04:04.867 INFO:tasks.workunit.client.1.smithi174.stdout:2/180: symlink d0/d1/d2/d4/d6/l36 0 2024-05-06T14:04:04.867 INFO:tasks.workunit.client.1.smithi174.stdout:4/198: creat d1/d9/f4d x:0 0 0 2024-05-06T14:04:04.867 INFO:tasks.workunit.client.1.smithi174.stdout:4/199: truncate d1/d9/d15/f21 896906 0 2024-05-06T14:04:04.868 INFO:tasks.workunit.client.1.smithi174.stdout:4/200: write d1/f19 [991980,86141] 0 2024-05-06T14:04:04.868 INFO:tasks.workunit.client.1.smithi174.stdout:4/201: chown d1/d1a/f28 333832 1 2024-05-06T14:04:04.868 INFO:tasks.workunit.client.1.smithi174.stdout:4/202: creat d1/d9/d15/f4e x:0 0 0 2024-05-06T14:04:04.868 INFO:tasks.workunit.client.1.smithi174.stdout:4/203: creat d1/d1f/d27/d3e/f4f x:0 0 0 2024-05-06T14:04:04.868 INFO:tasks.workunit.client.1.smithi174.stdout:4/204: mkdir d1/d1a/d3c/d50 0 2024-05-06T14:04:04.868 INFO:tasks.workunit.client.1.smithi174.stdout:4/205: unlink d1/d9/f4d 0 2024-05-06T14:04:04.869 INFO:tasks.workunit.client.1.smithi174.stdout:4/206: creat d1/d1a/f51 x:0 0 0 2024-05-06T14:04:04.869 INFO:tasks.workunit.client.1.smithi174.stdout:4/207: write d1/fd [1613217,27888] 0 2024-05-06T14:04:04.869 INFO:tasks.workunit.client.1.smithi174.stdout:4/208: rename d1/f1d to d1/d1f/d27/d2c/d45/f52 0 2024-05-06T14:04:04.869 INFO:tasks.workunit.client.1.smithi174.stdout:4/209: mkdir d1/d9/d53 0 2024-05-06T14:04:04.869 INFO:tasks.workunit.client.1.smithi174.stdout:4/210: getdents d1/d9 0 2024-05-06T14:04:04.869 INFO:tasks.workunit.client.1.smithi174.stdout:4/211: creat d1/d1f/f54 x:0 0 0 2024-05-06T14:04:04.869 INFO:tasks.workunit.client.1.smithi174.stdout:4/212: chown d1/d9 16 1 2024-05-06T14:04:04.869 INFO:tasks.workunit.client.1.smithi174.stdout:4/213: link d1/d9/f18 d1/d1a/d3c/f55 0 2024-05-06T14:04:04.870 INFO:tasks.workunit.client.1.smithi174.stdout:4/214: readlink d1/l8 0 2024-05-06T14:04:04.870 INFO:tasks.workunit.client.1.smithi174.stdout:4/215: mkdir d1/d1a/d56 0 2024-05-06T14:04:04.870 INFO:tasks.workunit.client.1.smithi174.stdout:4/216: creat d1/d1a/d3c/d50/f57 x:0 0 0 2024-05-06T14:04:04.923 INFO:tasks.workunit.client.1.smithi174.stdout:9/204: dwrite f1 [1245184,20480] 0 2024-05-06T14:04:04.923 INFO:tasks.workunit.client.1.smithi174.stdout:9/205: truncate f2 1296869 0 2024-05-06T14:04:04.924 INFO:tasks.workunit.client.1.smithi174.stdout:9/206: creat dc/de/f44 x:0 0 0 2024-05-06T14:04:04.927 INFO:tasks.workunit.client.1.smithi174.stdout:4/217: dwrite d1/d9/d15/f4c [40960,102400] 0 2024-05-06T14:04:04.927 INFO:tasks.workunit.client.1.smithi174.stdout:4/218: write d1/d1f/f54 [202884,80204] 0 2024-05-06T14:04:04.927 INFO:tasks.workunit.client.1.smithi174.stdout:4/219: creat d1/d48/f58 x:0 0 0 2024-05-06T14:04:04.927 INFO:tasks.workunit.client.1.smithi174.stdout:4/220: mkdir d1/d1a/d3c/d50/d59 0 2024-05-06T14:04:04.927 INFO:tasks.workunit.client.1.smithi174.stdout:5/210: dwrite d1/f10 [3047424,77824] 0 2024-05-06T14:04:04.927 INFO:tasks.workunit.client.1.smithi174.stdout:4/221: write d1/d9/f2d [207108,55309] 0 2024-05-06T14:04:04.927 INFO:tasks.workunit.client.1.smithi174.stdout:4/222: truncate d1/d9/d15/d41/f49 709746 0 2024-05-06T14:04:04.928 INFO:tasks.workunit.client.1.smithi174.stdout:4/223: truncate d1/d1f/d27/d2c/d45/f52 594244 0 2024-05-06T14:04:04.928 INFO:tasks.workunit.client.1.smithi174.stdout:4/224: rmdir d1/d9/d15 39 2024-05-06T14:04:04.928 INFO:tasks.workunit.client.1.smithi174.stdout:4/225: chown d1/d9/d15 586 1 2024-05-06T14:04:04.928 INFO:tasks.workunit.client.1.smithi174.stdout:4/226: mkdir d1/d48/d5a 0 2024-05-06T14:04:04.928 INFO:tasks.workunit.client.1.smithi174.stdout:4/227: chown d1/f19 76000521 1 2024-05-06T14:04:04.928 INFO:tasks.workunit.client.1.smithi174.stdout:4/228: mknod d1/d1f/d27/d2c/c5b 0 2024-05-06T14:04:04.928 INFO:tasks.workunit.client.1.smithi174.stdout:4/229: truncate d1/d9/d15/f47 1618449 0 2024-05-06T14:04:04.928 INFO:tasks.workunit.client.1.smithi174.stdout:8/293: dwrite d4/de/d23/f25 [1978368,94208] 0 2024-05-06T14:04:04.929 INFO:tasks.workunit.client.1.smithi174.stdout:9/207: dwrite fa [483328,40960] 0 2024-05-06T14:04:04.929 INFO:tasks.workunit.client.1.smithi174.stdout:9/208: symlink dc/l45 0 2024-05-06T14:04:04.929 INFO:tasks.workunit.client.1.smithi174.stdout:8/294: write d4/de/f17 [2935195,124985] 0 2024-05-06T14:04:04.929 INFO:tasks.workunit.client.1.smithi174.stdout:8/295: creat d4/de/d24/d46/f61 x:0 0 0 2024-05-06T14:04:04.929 INFO:tasks.workunit.client.1.smithi174.stdout:8/296: creat d4/d15/d20/d3e/f62 x:0 0 0 2024-05-06T14:04:04.929 INFO:tasks.workunit.client.1.smithi174.stdout:9/209: write f3 [458803,72370] 0 2024-05-06T14:04:04.929 INFO:tasks.workunit.client.1.smithi174.stdout:8/297: stat d4/de/d24/d5e/c60 0 2024-05-06T14:04:04.930 INFO:tasks.workunit.client.1.smithi174.stdout:8/298: readlink d4/de/d23/l27 0 2024-05-06T14:04:04.930 INFO:tasks.workunit.client.1.smithi174.stdout:8/299: mkdir d4/de/d24/d46/d63 0 2024-05-06T14:04:04.930 INFO:tasks.workunit.client.1.smithi174.stdout:8/300: mkdir d4/d15/d64 0 2024-05-06T14:04:04.930 INFO:tasks.workunit.client.1.smithi174.stdout:9/210: write dc/f30 [929219,126344] 0 2024-05-06T14:04:04.930 INFO:tasks.workunit.client.1.smithi174.stdout:9/211: rename dc/d14/c32 to dc/d17/d3a/c46 0 2024-05-06T14:04:04.930 INFO:tasks.workunit.client.1.smithi174.stdout:9/212: rename dc/de/f44 to dc/d17/d3a/f47 0 2024-05-06T14:04:04.939 INFO:tasks.workunit.client.1.smithi174.stdout:7/181: dread d0/da/d11/f20 [712704,118784] 0 2024-05-06T14:04:04.939 INFO:tasks.workunit.client.1.smithi174.stdout:7/182: creat d0/da/d19/d24/f3c x:0 0 0 2024-05-06T14:04:04.940 INFO:tasks.workunit.client.1.smithi174.stdout:7/183: write d0/f34 [2557054,45226] 0 2024-05-06T14:04:04.940 INFO:tasks.workunit.client.1.smithi174.stdout:7/184: link d0/da/d19/c2f d0/da/d28/c3d 0 2024-05-06T14:04:04.940 INFO:tasks.workunit.client.1.smithi174.stdout:7/185: write d0/da/f16 [2953001,88249] 0 2024-05-06T14:04:04.982 INFO:tasks.workunit.client.1.smithi174.stdout:3/239: fsync df/d10/f16 0 2024-05-06T14:04:04.982 INFO:tasks.workunit.client.1.smithi174.stdout:0/159: fdatasync d0/d19/f28 0 2024-05-06T14:04:04.982 INFO:tasks.workunit.client.1.smithi174.stdout:2/181: fsync d0/da/f34 0 2024-05-06T14:04:04.982 INFO:tasks.workunit.client.1.smithi174.stdout:0/160: chown d0/d1a/d17/c1c 237428 1 2024-05-06T14:04:04.982 INFO:tasks.workunit.client.1.smithi174.stdout:2/182: rmdir d0/d1/d2/d4/d18 39 2024-05-06T14:04:04.983 INFO:tasks.workunit.client.1.smithi174.stdout:0/161: chown d0/d16/f20 404787 1 2024-05-06T14:04:04.983 INFO:tasks.workunit.client.1.smithi174.stdout:2/183: symlink d0/d1/d2/d4/l37 0 2024-05-06T14:04:04.983 INFO:tasks.workunit.client.1.smithi174.stdout:2/184: dread d0/db/d15/f29 [73728,49152] 0 2024-05-06T14:04:04.983 INFO:tasks.workunit.client.1.smithi174.stdout:2/185: link d0/d1/d2/f17 d0/d1/d2/d4/d18/d2d/d32/f38 0 2024-05-06T14:04:04.983 INFO:tasks.workunit.client.1.smithi174.stdout:2/186: truncate d0/db/d15/f30 418585 0 2024-05-06T14:04:04.983 INFO:tasks.workunit.client.1.smithi174.stdout:5/211: dwrite d1/d6/f9 [1544192,28672] 0 2024-05-06T14:04:04.983 INFO:tasks.workunit.client.1.smithi174.stdout:2/187: symlink d0/d1/d2/d4/l39 0 2024-05-06T14:04:04.983 INFO:tasks.workunit.client.1.smithi174.stdout:2/188: creat d0/d1/d2/d2a/f3a x:0 0 0 2024-05-06T14:04:04.984 INFO:tasks.workunit.client.1.smithi174.stdout:5/212: write d1/d6/df/d35/d3a/de/f3f [1384442,33033] 0 2024-05-06T14:04:04.984 INFO:tasks.workunit.client.1.smithi174.stdout:5/213: dread d1/d6/df/d35/d3a/de/f3f [913408,114688] 0 2024-05-06T14:04:04.984 INFO:tasks.workunit.client.1.smithi174.stdout:9/213: dread dc/f36 [139264,86016] 0 2024-05-06T14:04:04.985 INFO:tasks.workunit.client.1.smithi174.stdout:9/214: symlink dc/d17/l48 0 2024-05-06T14:04:04.985 INFO:tasks.workunit.client.1.smithi174.stdout:9/215: symlink dc/df/l49 0 2024-05-06T14:04:04.985 INFO:tasks.workunit.client.1.smithi174.stdout:3/240: read df/d10/f48 [216630,349] 0 2024-05-06T14:04:04.985 INFO:tasks.workunit.client.1.smithi174.stdout:7/186: dwrite d0/da/fb [45056,32768] 0 2024-05-06T14:04:05.044 INFO:tasks.workunit.client.1.smithi174.stdout:8/301: fsync d4/fb 0 2024-05-06T14:04:05.045 INFO:tasks.workunit.client.1.smithi174.stdout:0/162: fdatasync d0/d1a/f1e 0 2024-05-06T14:04:05.048 INFO:tasks.workunit.client.1.smithi174.stdout:7/187: dread d0/da/f38 [28672,12288] 0 2024-05-06T14:04:05.048 INFO:tasks.workunit.client.1.smithi174.stdout:2/189: dwrite d0/d1/f35 [610304,65536] 0 2024-05-06T14:04:05.048 INFO:tasks.workunit.client.1.smithi174.stdout:5/214: dwrite d1/d6/d7/d36/f2c [2207744,61440] 0 2024-05-06T14:04:05.048 INFO:tasks.workunit.client.1.smithi174.stdout:9/216: dwrite dc/d17/f2f [503808,106496] 0 2024-05-06T14:04:05.048 INFO:tasks.workunit.client.1.smithi174.stdout:8/302: rename d4/d15/d20/f34 to d4/de/d23/f65 0 2024-05-06T14:04:05.048 INFO:tasks.workunit.client.1.smithi174.stdout:0/163: creat d0/d4/d8/d25/d32/f35 x:0 0 0 2024-05-06T14:04:05.048 INFO:tasks.workunit.client.1.smithi174.stdout:2/190: dread d0/d1/d2/f20 [540672,20480] 0 2024-05-06T14:04:05.049 INFO:tasks.workunit.client.1.smithi174.stdout:5/215: mknod d1/d6/d7/c46 0 2024-05-06T14:04:05.049 INFO:tasks.workunit.client.1.smithi174.stdout:3/241: truncate df/d10/f16 172581 0 2024-05-06T14:04:05.049 INFO:tasks.workunit.client.1.smithi174.stdout:2/191: truncate d0/d1/f5 3585643 0 2024-05-06T14:04:05.049 INFO:tasks.workunit.client.1.smithi174.stdout:8/303: mkdir d4/d15/d66 0 2024-05-06T14:04:05.049 INFO:tasks.workunit.client.1.smithi174.stdout:8/304: chown d4/de/d23/d41/f4c 123214071 1 2024-05-06T14:04:05.049 INFO:tasks.workunit.client.1.smithi174.stdout:3/242: write df/d10/f1c [1494246,21602] 0 2024-05-06T14:04:05.049 INFO:tasks.workunit.client.1.smithi174.stdout:8/305: write d4/de/f17 [3767056,16075] 0 2024-05-06T14:04:05.049 INFO:tasks.workunit.client.1.smithi174.stdout:2/192: write d0/d16/f19 [195634,113584] 0 2024-05-06T14:04:05.049 INFO:tasks.workunit.client.1.smithi174.stdout:2/193: read d0/d1/f35 [308776,26393] 0 2024-05-06T14:04:05.050 INFO:tasks.workunit.client.1.smithi174.stdout:6/244: sync 2024-05-06T14:04:05.050 INFO:tasks.workunit.client.1.smithi174.stdout:1/174: sync 2024-05-06T14:04:05.054 INFO:tasks.workunit.client.1.smithi174.stdout:9/217: rename fa to dc/df/f4a 0 2024-05-06T14:04:05.054 INFO:tasks.workunit.client.1.smithi174.stdout:0/164: mkdir d0/d36 0 2024-05-06T14:04:05.055 INFO:tasks.workunit.client.1.smithi174.stdout:5/216: creat d1/d6/d7/d36/f47 x:0 0 0 2024-05-06T14:04:05.055 INFO:tasks.workunit.client.1.smithi174.stdout:8/306: mknod d4/de/d24/d5e/c67 0 2024-05-06T14:04:05.055 INFO:tasks.workunit.client.1.smithi174.stdout:9/218: dread - dc/f3b zero size 2024-05-06T14:04:05.055 INFO:tasks.workunit.client.1.smithi174.stdout:8/307: unlink d4/de/d23/d3c/l52 0 2024-05-06T14:04:05.055 INFO:tasks.workunit.client.1.smithi174.stdout:5/217: mknod d1/d6/df/d35/c48 0 2024-05-06T14:04:05.055 INFO:tasks.workunit.client.1.smithi174.stdout:0/165: write d0/d4/d8/d25/d32/f35 [428810,74656] 0 2024-05-06T14:04:05.055 INFO:tasks.workunit.client.1.smithi174.stdout:5/218: symlink d1/d6/df/d35/d3a/d41/l49 0 2024-05-06T14:04:05.055 INFO:tasks.workunit.client.1.smithi174.stdout:0/166: rename d0/d4/d8/f23 to d0/d4/f37 0 2024-05-06T14:04:05.055 INFO:tasks.workunit.client.1.smithi174.stdout:9/219: write dc/d27/f39 [813381,117309] 0 2024-05-06T14:04:05.056 INFO:tasks.workunit.client.1.smithi174.stdout:0/167: truncate d0/d1a/f1b 539724 0 2024-05-06T14:04:05.056 INFO:tasks.workunit.client.1.smithi174.stdout:9/220: stat dc/f36 0 2024-05-06T14:04:05.056 INFO:tasks.workunit.client.1.smithi174.stdout:0/168: chown d0/d4/d8/d25/d32/f35 68972 1 2024-05-06T14:04:05.056 INFO:tasks.workunit.client.1.smithi174.stdout:5/219: unlink d1/d6/df/d35/d3a/de/f38 0 2024-05-06T14:04:05.056 INFO:tasks.workunit.client.1.smithi174.stdout:0/169: write d0/d1a/f30 [643096,76344] 0 2024-05-06T14:04:05.056 INFO:tasks.workunit.client.1.smithi174.stdout:0/170: chown d0/d1a/d17/d2e 32331626 1 2024-05-06T14:04:05.056 INFO:tasks.workunit.client.1.smithi174.stdout:0/171: truncate d0/d1a/f22 564593 0 2024-05-06T14:04:05.056 INFO:tasks.workunit.client.1.smithi174.stdout:0/172: rename d0/d19 to d0/d4/d8/d25/d32/d38 0 2024-05-06T14:04:05.057 INFO:tasks.workunit.client.1.smithi174.stdout:5/220: write d1/d6/df/d35/d3a/f25 [1034402,121526] 0 2024-05-06T14:04:05.057 INFO:tasks.workunit.client.1.smithi174.stdout:5/221: chown d1/d6/df/d35/d3a/db/d1e/f29 703602710 1 2024-05-06T14:04:05.057 INFO:tasks.workunit.client.1.smithi174.stdout:2/194: creat d0/da/f3b x:0 0 0 2024-05-06T14:04:05.057 INFO:tasks.workunit.client.1.smithi174.stdout:2/195: dread d0/db/d15/f29 [61440,28672] 0 2024-05-06T14:04:05.057 INFO:tasks.workunit.client.1.smithi174.stdout:6/245: write d0/df/d22/d2c/f37 [2147723,38748] 0 2024-05-06T14:04:05.057 INFO:tasks.workunit.client.1.smithi174.stdout:5/222: creat d1/d6/f4a x:0 0 0 2024-05-06T14:04:05.057 INFO:tasks.workunit.client.1.smithi174.stdout:5/223: write d1/d6/df/d35/d3a/db/f1b [890240,23759] 0 2024-05-06T14:04:05.057 INFO:tasks.workunit.client.1.smithi174.stdout:2/196: write d0/d1/d2/d2a/f3a [590932,75284] 0 2024-05-06T14:04:05.058 INFO:tasks.workunit.client.1.smithi174.stdout:5/224: truncate d1/d6/f18 542746 0 2024-05-06T14:04:05.058 INFO:tasks.workunit.client.1.smithi174.stdout:5/225: readlink d1/d6/df/l20 0 2024-05-06T14:04:05.058 INFO:tasks.workunit.client.1.smithi174.stdout:5/226: creat d1/d6/df/d35/d3a/db/f4b x:0 0 0 2024-05-06T14:04:05.058 INFO:tasks.workunit.client.1.smithi174.stdout:5/227: mkdir d1/d6/d7/d3e/d4c 0 2024-05-06T14:04:05.058 INFO:tasks.workunit.client.1.smithi174.stdout:5/228: unlink d1/d6/fc 0 2024-05-06T14:04:05.058 INFO:tasks.workunit.client.1.smithi174.stdout:0/173: truncate d0/fa 1803535 0 2024-05-06T14:04:05.058 INFO:tasks.workunit.client.1.smithi174.stdout:0/174: dread d0/d1a/f13 [1298432,106496] 0 2024-05-06T14:04:05.058 INFO:tasks.workunit.client.1.smithi174.stdout:7/188: dwrite d0/da/f16 [2502656,73728] 0 2024-05-06T14:04:05.059 INFO:tasks.workunit.client.1.smithi174.stdout:7/189: readlink d0/da/d11/l12 0 2024-05-06T14:04:05.059 INFO:tasks.workunit.client.1.smithi174.stdout:7/190: readlink d0/d1d/l30 0 2024-05-06T14:04:05.059 INFO:tasks.workunit.client.1.smithi174.stdout:7/191: chown d0/da/d19/d35/c36 2669 1 2024-05-06T14:04:05.059 INFO:tasks.workunit.client.1.smithi174.stdout:7/192: creat d0/da/d11/f3e x:0 0 0 2024-05-06T14:04:05.059 INFO:tasks.workunit.client.1.smithi174.stdout:7/193: dread d0/d1d/f2c [204800,49152] 0 2024-05-06T14:04:05.059 INFO:tasks.workunit.client.1.smithi174.stdout:7/194: dread - d0/da/d19/f32 zero size 2024-05-06T14:04:05.059 INFO:tasks.workunit.client.1.smithi174.stdout:7/195: creat d0/da/d19/d35/f3f x:0 0 0 2024-05-06T14:04:05.059 INFO:tasks.workunit.client.1.smithi174.stdout:3/243: dwrite df/d10/f48 [1163264,40960] 0 2024-05-06T14:04:05.059 INFO:tasks.workunit.client.1.smithi174.stdout:3/244: rmdir df/d10/d1b 39 2024-05-06T14:04:05.060 INFO:tasks.workunit.client.1.smithi174.stdout:3/245: chown df/d10/d1b/c41 396503 1 2024-05-06T14:04:05.134 INFO:tasks.workunit.client.1.smithi174.stdout:2/197: dwrite d0/d1/d2/d4/d6/f26 [544768,45056] 0 2024-05-06T14:04:05.140 INFO:tasks.workunit.client.1.smithi174.stdout:1/175: dwrite d11/d1f/d27/f45 [225280,118784] 0 2024-05-06T14:04:05.140 INFO:tasks.workunit.client.1.smithi174.stdout:1/176: rmdir d11/d1f 39 2024-05-06T14:04:05.141 INFO:tasks.workunit.client.1.smithi174.stdout:5/229: dwrite d1/d6/df/d35/d3a/db/f1a [839680,94208] 0 2024-05-06T14:04:05.141 INFO:tasks.workunit.client.1.smithi174.stdout:5/230: symlink d1/d6/df/d35/d3a/l4d 0 2024-05-06T14:04:05.141 INFO:tasks.workunit.client.1.smithi174.stdout:6/246: dwrite d0/df/d22/d2c/f37 [1888256,90112] 0 2024-05-06T14:04:05.141 INFO:tasks.workunit.client.1.smithi174.stdout:6/247: mknod d0/d25/d35/c4e 0 2024-05-06T14:04:05.141 INFO:tasks.workunit.client.1.smithi174.stdout:6/248: symlink d0/d25/l4f 0 2024-05-06T14:04:05.141 INFO:tasks.workunit.client.1.smithi174.stdout:6/249: dread - d0/d25/d35/f4d zero size 2024-05-06T14:04:05.142 INFO:tasks.workunit.client.1.smithi174.stdout:6/250: link d0/df/f24 d0/df/d45/f50 0 2024-05-06T14:04:05.142 INFO:tasks.workunit.client.1.smithi174.stdout:6/251: chown d0/d25 238791 1 2024-05-06T14:04:05.142 INFO:tasks.workunit.client.1.smithi174.stdout:6/252: chown d0/df/l17 0 1 2024-05-06T14:04:05.142 INFO:tasks.workunit.client.1.smithi174.stdout:6/253: stat d0/f26 0 2024-05-06T14:04:05.143 INFO:tasks.workunit.client.1.smithi174.stdout:6/254: write d0/f3a [291268,70001] 0 2024-05-06T14:04:05.143 INFO:tasks.workunit.client.1.smithi174.stdout:6/255: creat d0/d25/f51 x:0 0 0 2024-05-06T14:04:05.143 INFO:tasks.workunit.client.1.smithi174.stdout:7/196: dwrite d0/da/d19/d35/f3f [569344,94208] 0 2024-05-06T14:04:05.143 INFO:tasks.workunit.client.1.smithi174.stdout:6/256: read d0/df/f24 [486428,122041] 0 2024-05-06T14:04:05.143 INFO:tasks.workunit.client.1.smithi174.stdout:6/257: chown d0/df 0 1 2024-05-06T14:04:05.143 INFO:tasks.workunit.client.1.smithi174.stdout:7/197: creat d0/da/d28/d37/f40 x:0 0 0 2024-05-06T14:04:05.143 INFO:tasks.workunit.client.1.smithi174.stdout:7/198: rmdir d0/da/d11 39 2024-05-06T14:04:05.143 INFO:tasks.workunit.client.1.smithi174.stdout:6/258: rename d0/df/d22 to d0/d25/d52 0 2024-05-06T14:04:05.144 INFO:tasks.workunit.client.1.smithi174.stdout:7/199: mkdir d0/d1d/d41 0 2024-05-06T14:04:05.144 INFO:tasks.workunit.client.1.smithi174.stdout:6/259: creat d0/d25/d52/d3b/f53 x:0 0 0 2024-05-06T14:04:05.144 INFO:tasks.workunit.client.1.smithi174.stdout:3/246: dwrite df/d2d/f4a [679936,57344] 0 2024-05-06T14:04:05.144 INFO:tasks.workunit.client.1.smithi174.stdout:3/247: write df/d10/f3a [1784382,77994] 0 2024-05-06T14:04:05.144 INFO:tasks.workunit.client.1.smithi174.stdout:3/248: dread - df/d10/d1b/f24 zero size 2024-05-06T14:04:05.144 INFO:tasks.workunit.client.1.smithi174.stdout:3/249: chown df/f18 1709446992 1 2024-05-06T14:04:05.145 INFO:tasks.workunit.client.1.smithi174.stdout:3/250: symlink df/d2d/l50 0 2024-05-06T14:04:05.145 INFO:tasks.workunit.client.1.smithi174.stdout:3/251: truncate df/d10/d1b/f2b 1324093 0 2024-05-06T14:04:05.145 INFO:tasks.workunit.client.1.smithi174.stdout:3/252: write df/d10/f48 [745903,88489] 0 2024-05-06T14:04:05.145 INFO:tasks.workunit.client.1.smithi174.stdout:3/253: write df/d10/d1b/f24 [278184,123329] 0 2024-05-06T14:04:05.145 INFO:tasks.workunit.client.1.smithi174.stdout:3/254: creat df/d2d/d4b/f51 x:0 0 0 2024-05-06T14:04:05.145 INFO:tasks.workunit.client.1.smithi174.stdout:3/255: chown df/d10/f19 15385072 1 2024-05-06T14:04:05.145 INFO:tasks.workunit.client.1.smithi174.stdout:3/256: creat df/d10/f52 x:0 0 0 2024-05-06T14:04:05.146 INFO:tasks.workunit.client.1.smithi174.stdout:3/257: write df/d10/f2f [848161,112548] 0 2024-05-06T14:04:05.146 INFO:tasks.workunit.client.1.smithi174.stdout:3/258: truncate df/f28 1089891 0 2024-05-06T14:04:05.234 INFO:tasks.workunit.client.1.smithi174.stdout:0/175: fdatasync d0/d4/f37 0 2024-05-06T14:04:05.234 INFO:tasks.workunit.client.1.smithi174.stdout:9/221: fdatasync f1 0 2024-05-06T14:04:05.234 INFO:tasks.workunit.client.1.smithi174.stdout:7/200: fdatasync d0/da/d19/d24/f1a 0 2024-05-06T14:04:05.234 INFO:tasks.workunit.client.1.smithi174.stdout:7/201: stat d0/da/d28 0 2024-05-06T14:04:05.240 INFO:tasks.workunit.client.1.smithi174.stdout:1/177: dwrite f5 [2760704,106496] 0 2024-05-06T14:04:05.240 INFO:tasks.workunit.client.1.smithi174.stdout:0/176: dwrite d0/fa [2154496,90112] 0 2024-05-06T14:04:05.240 INFO:tasks.workunit.client.1.smithi174.stdout:1/178: dread - d11/d1f/d27/d2d/f43 zero size 2024-05-06T14:04:05.240 INFO:tasks.workunit.client.1.smithi174.stdout:1/179: read fc [684081,94497] 0 2024-05-06T14:04:05.241 INFO:tasks.workunit.client.1.smithi174.stdout:1/180: write d11/f20 [1066170,99850] 0 2024-05-06T14:04:05.241 INFO:tasks.workunit.client.1.smithi174.stdout:9/222: dwrite dc/d27/f2a [344064,73728] 0 2024-05-06T14:04:05.241 INFO:tasks.workunit.client.1.smithi174.stdout:9/223: chown dc/d1c/f41 114256 1 2024-05-06T14:04:05.241 INFO:tasks.workunit.client.1.smithi174.stdout:9/224: write dc/de/f2e [1001846,60488] 0 2024-05-06T14:04:05.241 INFO:tasks.workunit.client.1.smithi174.stdout:9/225: rmdir dc/d14 39 2024-05-06T14:04:05.241 INFO:tasks.workunit.client.1.smithi174.stdout:9/226: chown dc/f31 15241687 1 2024-05-06T14:04:05.241 INFO:tasks.workunit.client.1.smithi174.stdout:7/202: dwrite d0/f6 [2170880,90112] 0 2024-05-06T14:04:05.242 INFO:tasks.workunit.client.1.smithi174.stdout:7/203: creat d0/da/d28/d37/f42 x:0 0 0 2024-05-06T14:04:05.242 INFO:tasks.workunit.client.1.smithi174.stdout:7/204: write d0/da/d28/d37/f42 [684610,108647] 0 2024-05-06T14:04:05.293 INFO:tasks.workunit.client.1.smithi174.stdout:9/227: dread dc/d27/f2a [372736,77824] 0 2024-05-06T14:04:05.300 INFO:tasks.workunit.client.1.smithi174.stdout:4/230: sync 2024-05-06T14:04:05.301 INFO:tasks.workunit.client.1.smithi174.stdout:4/231: rename d1/d1f/d27/f30 to d1/d1a/d3c/d50/f5c 0 2024-05-06T14:04:05.301 INFO:tasks.workunit.client.1.smithi174.stdout:4/232: mkdir d1/d1f/d27/d3e/d5d 0 2024-05-06T14:04:05.301 INFO:tasks.workunit.client.1.smithi174.stdout:4/233: mknod d1/d9/d15/d35/c5e 0 2024-05-06T14:04:05.301 INFO:tasks.workunit.client.1.smithi174.stdout:4/234: read - d1/d2e/f40 zero size 2024-05-06T14:04:05.301 INFO:tasks.workunit.client.1.smithi174.stdout:4/235: mkdir d1/d48/d5a/d5f 0 2024-05-06T14:04:05.301 INFO:tasks.workunit.client.1.smithi174.stdout:4/236: link d1/d9/f16 d1/d1a/d3c/d50/f60 0 2024-05-06T14:04:05.301 INFO:tasks.workunit.client.1.smithi174.stdout:4/237: mkdir d1/d48/d5a/d61 0 2024-05-06T14:04:05.301 INFO:tasks.workunit.client.1.smithi174.stdout:4/238: creat d1/d1f/f62 x:0 0 0 2024-05-06T14:04:05.302 INFO:tasks.workunit.client.1.smithi174.stdout:4/239: link d1/d9/f23 d1/d48/d5a/d61/f63 0 2024-05-06T14:04:05.302 INFO:tasks.workunit.client.1.smithi174.stdout:4/240: read - d1/d1f/d27/d2c/f3f zero size 2024-05-06T14:04:05.302 INFO:tasks.workunit.client.1.smithi174.stdout:4/241: dread - d1/d1f/d27/f38 zero size 2024-05-06T14:04:05.302 INFO:tasks.workunit.client.1.smithi174.stdout:1/181: dwrite d11/d1f/d27/d2d/f3a [1101824,114688] 0 2024-05-06T14:04:05.302 INFO:tasks.workunit.client.1.smithi174.stdout:1/182: creat d11/d1f/d27/d2d/f47 x:0 0 0 2024-05-06T14:04:05.302 INFO:tasks.workunit.client.1.smithi174.stdout:1/183: chown d11/l1d 0 1 2024-05-06T14:04:05.302 INFO:tasks.workunit.client.1.smithi174.stdout:1/184: read d11/f22 [1026938,29608] 0 2024-05-06T14:04:05.302 INFO:tasks.workunit.client.1.smithi174.stdout:1/185: chown d11/d1f/l25 400638 1 2024-05-06T14:04:05.302 INFO:tasks.workunit.client.1.smithi174.stdout:1/186: dread d11/d1f/d27/d2d/f3a [958464,8192] 0 2024-05-06T14:04:05.303 INFO:tasks.workunit.client.1.smithi174.stdout:1/187: symlink d11/d1f/l48 0 2024-05-06T14:04:05.303 INFO:tasks.workunit.client.1.smithi174.stdout:1/188: getdents d11/d41 0 2024-05-06T14:04:05.303 INFO:tasks.workunit.client.1.smithi174.stdout:1/189: mknod d11/d1f/d27/d2d/c49 0 2024-05-06T14:04:05.303 INFO:tasks.workunit.client.1.smithi174.stdout:1/190: mkdir d11/d41/d4a 0 2024-05-06T14:04:05.303 INFO:tasks.workunit.client.1.smithi174.stdout:7/205: dwrite d0/da/d11/f3e [409600,102400] 0 2024-05-06T14:04:05.303 INFO:tasks.workunit.client.1.smithi174.stdout:7/206: readlink d0/da/d11/l12 0 2024-05-06T14:04:05.303 INFO:tasks.workunit.client.1.smithi174.stdout:1/191: write d11/d1f/d27/f2b [509320,54296] 0 2024-05-06T14:04:05.303 INFO:tasks.workunit.client.1.smithi174.stdout:1/192: creat d11/d1f/d27/d32/f4b x:0 0 0 2024-05-06T14:04:05.304 INFO:tasks.workunit.client.1.smithi174.stdout:7/207: mkdir d0/d3a/d43 0 2024-05-06T14:04:05.304 INFO:tasks.workunit.client.1.smithi174.stdout:7/208: mknod d0/da/d19/d39/c44 0 2024-05-06T14:04:05.304 INFO:tasks.workunit.client.1.smithi174.stdout:7/209: rename d0/da to d0/da/d19/d45 22 2024-05-06T14:04:05.304 INFO:tasks.workunit.client.1.smithi174.stdout:7/210: chown d0/da/d19/c29 935505 1 2024-05-06T14:04:05.304 INFO:tasks.workunit.client.1.smithi174.stdout:7/211: mkdir d0/da/d19/d39/d46 0 2024-05-06T14:04:05.304 INFO:tasks.workunit.client.1.smithi174.stdout:7/212: mkdir d0/da/d19/d24/d47 0 2024-05-06T14:04:05.304 INFO:tasks.workunit.client.1.smithi174.stdout:7/213: dread - d0/da/d28/d37/f40 zero size 2024-05-06T14:04:05.304 INFO:tasks.workunit.client.1.smithi174.stdout:7/214: stat d0/da/d11 0 2024-05-06T14:04:05.304 INFO:tasks.workunit.client.1.smithi174.stdout:7/215: creat d0/da/d19/d24/f48 x:0 0 0 2024-05-06T14:04:05.305 INFO:tasks.workunit.client.1.smithi174.stdout:7/216: chown d0/d1d/d41 12 1 2024-05-06T14:04:05.305 INFO:tasks.workunit.client.1.smithi174.stdout:7/217: mknod d0/d3a/c49 0 2024-05-06T14:04:05.305 INFO:tasks.workunit.client.1.smithi174.stdout:7/218: symlink d0/da/d11/l4a 0 2024-05-06T14:04:05.305 INFO:tasks.workunit.client.1.smithi174.stdout:7/219: dread d0/d1d/f1e [327680,114688] 0 2024-05-06T14:04:05.305 INFO:tasks.workunit.client.1.smithi174.stdout:9/228: dwrite dc/d27/f39 [1703936,4096] 0 2024-05-06T14:04:05.335 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-06T14:04:05.369 INFO:tasks.workunit.client.1.smithi174.stdout:6/260: fsync d0/df/d45/f50 0 2024-05-06T14:04:05.370 INFO:tasks.workunit.client.1.smithi174.stdout:3/259: fsync df/d2d/d4b/f51 0 2024-05-06T14:04:05.370 INFO:tasks.workunit.client.1.smithi174.stdout:8/308: fdatasync d4/de/f17 0 2024-05-06T14:04:05.370 INFO:tasks.workunit.client.1.smithi174.stdout:8/309: truncate d4/de/f1f 8708 0 2024-05-06T14:04:05.370 INFO:tasks.workunit.client.1.smithi174.stdout:3/260: creat df/d2d/f53 x:0 0 0 2024-05-06T14:04:05.371 INFO:tasks.workunit.client.1.smithi174.stdout:9/229: dread dc/f36 [94208,69632] 0 2024-05-06T14:04:05.371 INFO:tasks.workunit.client.1.smithi174.stdout:9/230: truncate dc/f31 367051 0 2024-05-06T14:04:05.371 INFO:tasks.workunit.client.1.smithi174.stdout:9/231: creat dc/df/f4b x:0 0 0 2024-05-06T14:04:05.371 INFO:tasks.workunit.client.1.smithi174.stdout:9/232: read f7 [439136,58891] 0 2024-05-06T14:04:05.372 INFO:tasks.workunit.client.1.smithi174.stdout:9/233: chown dc/d17/d3a/c46 2 1 2024-05-06T14:04:05.415 INFO:tasks.workunit.client.1.smithi174.stdout:9/234: chown l0 14188 1 2024-05-06T14:04:05.417 INFO:tasks.workunit.client.1.smithi174.stdout:6/261: dwrite d0/df/f24 [1720320,20480] 0 2024-05-06T14:04:05.418 INFO:tasks.workunit.client.1.smithi174.stdout:4/242: fdatasync d1/d9/d15/d41/f49 0 2024-05-06T14:04:05.418 INFO:tasks.workunit.client.1.smithi174.stdout:4/243: stat d1/l7 0 2024-05-06T14:04:05.418 INFO:tasks.workunit.client.1.smithi174.stdout:6/262: mknod d0/d25/d52/d2c/c54 0 2024-05-06T14:04:05.418 INFO:tasks.workunit.client.1.smithi174.stdout:4/244: truncate d1/d2e/f40 585728 0 2024-05-06T14:04:05.418 INFO:tasks.workunit.client.1.smithi174.stdout:7/220: dwrite d0/da/d19/f32 [290816,106496] 0 2024-05-06T14:04:05.418 INFO:tasks.workunit.client.1.smithi174.stdout:3/261: mknod df/d2d/d4e/c54 0 2024-05-06T14:04:05.418 INFO:tasks.workunit.client.1.smithi174.stdout:3/262: chown df/d10/c46 485908777 1 2024-05-06T14:04:05.418 INFO:tasks.workunit.client.1.smithi174.stdout:7/221: link d0/da/f16 d0/d1d/d41/f4b 0 2024-05-06T14:04:05.419 INFO:tasks.workunit.client.1.smithi174.stdout:9/235: mkdir dc/d17/d4c 0 2024-05-06T14:04:05.419 INFO:tasks.workunit.client.1.smithi174.stdout:7/222: creat d0/da/d19/d35/f4c x:0 0 0 2024-05-06T14:04:05.419 INFO:tasks.workunit.client.1.smithi174.stdout:7/223: stat d0/da/d28/c3d 0 2024-05-06T14:04:05.419 INFO:tasks.workunit.client.1.smithi174.stdout:7/224: link d0/da/d19/f32 d0/da/d28/f4d 0 2024-05-06T14:04:05.419 INFO:tasks.workunit.client.1.smithi174.stdout:9/236: creat dc/d14/d43/f4d x:0 0 0 2024-05-06T14:04:05.419 INFO:tasks.workunit.client.1.smithi174.stdout:9/237: creat dc/f4e x:0 0 0 2024-05-06T14:04:05.419 INFO:tasks.workunit.client.1.smithi174.stdout:6/263: rename d0/d25/d52/c2f to d0/df/c55 0 2024-05-06T14:04:05.419 INFO:tasks.workunit.client.1.smithi174.stdout:9/238: rename dc/f31 to dc/de/f4f 0 2024-05-06T14:04:05.420 INFO:tasks.workunit.client.1.smithi174.stdout:9/239: rename f1 to dc/d17/f50 0 2024-05-06T14:04:05.420 INFO:tasks.workunit.client.1.smithi174.stdout:6/264: write d0/d25/d52/d3b/f53 [890387,78900] 0 2024-05-06T14:04:05.420 INFO:tasks.workunit.client.1.smithi174.stdout:9/240: mkdir dc/d27/d51 0 2024-05-06T14:04:05.420 INFO:tasks.workunit.client.1.smithi174.stdout:9/241: readlink l0 0 2024-05-06T14:04:05.420 INFO:tasks.workunit.client.1.smithi174.stdout:9/242: mknod dc/d1c/c52 0 2024-05-06T14:04:05.420 INFO:tasks.workunit.client.1.smithi174.stdout:8/310: dwrite d4/d15/d20/f44 [585728,86016] 0 2024-05-06T14:04:05.420 INFO:tasks.workunit.client.1.smithi174.stdout:3/263: dwrite df/d10/f14 [1806336,57344] 0 2024-05-06T14:04:05.420 INFO:tasks.workunit.client.1.smithi174.stdout:3/264: stat df/d10/f16 0 2024-05-06T14:04:05.421 INFO:tasks.workunit.client.1.smithi174.stdout:3/265: write df/d2d/f31 [405034,13615] 0 2024-05-06T14:04:05.421 INFO:tasks.workunit.client.1.smithi174.stdout:3/266: creat df/f55 x:0 0 0 2024-05-06T14:04:05.421 INFO:tasks.workunit.client.1.smithi174.stdout:7/225: dwrite d0/da/f38 [757760,8192] 0 2024-05-06T14:04:05.421 INFO:tasks.workunit.client.1.smithi174.stdout:3/267: creat df/d10/d1b/f56 x:0 0 0 2024-05-06T14:04:05.421 INFO:tasks.workunit.client.1.smithi174.stdout:6/265: dwrite d0/f15 [507904,40960] 0 2024-05-06T14:04:05.421 INFO:tasks.workunit.client.1.smithi174.stdout:6/266: dread - d0/d25/f51 zero size 2024-05-06T14:04:05.491 INFO:teuthology.orchestra.run.smithi174.stdout:Deleting cluster with fsid: f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T14:04:05.491 INFO:tasks.workunit.client.1.smithi174.stdout:4/245: fdatasync d1/d9/d15/f21 0 2024-05-06T14:04:05.498 INFO:tasks.workunit.client.1.smithi174.stdout:6/267: mkdir d0/df/d45/d56 0 2024-05-06T14:04:05.498 INFO:tasks.workunit.client.1.smithi174.stdout:6/268: mknod d0/d25/c57 0 2024-05-06T14:04:05.498 INFO:tasks.workunit.client.1.smithi174.stdout:6/269: mknod d0/d25/c58 0 2024-05-06T14:04:05.498 INFO:tasks.workunit.client.1.smithi174.stdout:7/226: dread d0/da/d11/f3e [471040,36864] 0 2024-05-06T14:04:05.498 INFO:tasks.workunit.client.1.smithi174.stdout:7/227: truncate d0/f6 2641318 0 2024-05-06T14:04:05.498 INFO:tasks.workunit.client.1.smithi174.stdout:6/270: symlink d0/df/l59 0 2024-05-06T14:04:05.498 INFO:tasks.workunit.client.1.smithi174.stdout:6/271: truncate d0/df/d45/f47 720266 0 2024-05-06T14:04:05.499 INFO:tasks.workunit.client.1.smithi174.stdout:7/228: creat d0/da/d28/d37/f4e x:0 0 0 2024-05-06T14:04:05.499 INFO:tasks.workunit.client.1.smithi174.stdout:7/229: mknod d0/da/d28/c4f 0 2024-05-06T14:04:05.499 INFO:tasks.workunit.client.1.smithi174.stdout:7/230: dread d0/d1d/d41/f4b [4595712,81920] 0 2024-05-06T14:04:05.499 INFO:tasks.workunit.client.1.smithi174.stdout:6/272: write d0/f3a [384467,122892] 0 2024-05-06T14:04:05.499 INFO:tasks.workunit.client.1.smithi174.stdout:7/231: chown d0/d1d 1445706 1 2024-05-06T14:04:05.499 INFO:tasks.workunit.client.1.smithi174.stdout:6/273: mknod d0/d48/c5a 0 2024-05-06T14:04:05.499 INFO:tasks.workunit.client.1.smithi174.stdout:7/232: dread d0/f6 [1409024,57344] 0 2024-05-06T14:04:05.499 INFO:tasks.workunit.client.1.smithi174.stdout:7/233: creat d0/da/d19/d24/d47/f50 x:0 0 0 2024-05-06T14:04:05.499 INFO:tasks.workunit.client.1.smithi174.stdout:7/234: dread d0/d1d/d41/f4b [1961984,118784] 0 2024-05-06T14:04:05.500 INFO:tasks.workunit.client.1.smithi174.stdout:8/311: rename d4/de/d24/d5e/c67 to d4/de/d23/d3c/c68 0 2024-05-06T14:04:05.500 INFO:tasks.workunit.client.1.smithi174.stdout:8/312: readlink d4/ld 0 2024-05-06T14:04:05.500 INFO:tasks.workunit.client.1.smithi174.stdout:8/313: chown d4/d15/d20/d3e/f62 5 1 2024-05-06T14:04:05.500 INFO:tasks.workunit.client.1.smithi174.stdout:5/231: sync 2024-05-06T14:04:05.500 INFO:tasks.workunit.client.1.smithi174.stdout:2/198: sync 2024-05-06T14:04:05.500 INFO:tasks.workunit.client.1.smithi174.stdout:2/199: truncate d0/da/f34 232740 0 2024-05-06T14:04:05.500 INFO:tasks.workunit.client.1.smithi174.stdout:2/200: mkdir d0/d1/d2/d4/d6/d3c 0 2024-05-06T14:04:05.500 INFO:tasks.workunit.client.1.smithi174.stdout:5/232: write d1/d6/f34 [1215311,114942] 0 2024-05-06T14:04:05.500 INFO:tasks.workunit.client.1.smithi174.stdout:5/233: rename d1/d6/c14 to d1/d6/df/d35/d3a/db/d1e/c4e 0 2024-05-06T14:04:05.501 INFO:tasks.workunit.client.1.smithi174.stdout:5/234: chown d1/d6/d7/d36/f2c 127 1 2024-05-06T14:04:05.501 INFO:tasks.workunit.client.1.smithi174.stdout:5/235: rename d1/d6/df/d35/l42 to d1/d6/df/d35/d3a/de/l4f 0 2024-05-06T14:04:05.501 INFO:tasks.workunit.client.1.smithi174.stdout:5/236: symlink d1/l50 0 2024-05-06T14:04:05.501 INFO:tasks.workunit.client.1.smithi174.stdout:4/246: dwrite d1/d9/d15/d41/f49 [331776,8192] 0 2024-05-06T14:04:05.501 INFO:tasks.workunit.client.1.smithi174.stdout:4/247: dread - d1/d1a/d3c/f55 zero size 2024-05-06T14:04:05.501 INFO:tasks.workunit.client.1.smithi174.stdout:2/201: write d0/d24/f27 [1184502,92583] 0 2024-05-06T14:04:05.501 INFO:tasks.workunit.client.1.smithi174.stdout:4/248: mknod d1/d9/d53/c64 0 2024-05-06T14:04:05.501 INFO:tasks.workunit.client.1.smithi174.stdout:2/202: symlink d0/d1/d2/d4/d6/l3d 0 2024-05-06T14:04:05.502 INFO:tasks.workunit.client.1.smithi174.stdout:2/203: rmdir d0/d1 39 2024-05-06T14:04:05.502 INFO:tasks.workunit.client.1.smithi174.stdout:6/274: dwrite d0/df/f14 [192512,20480] 0 2024-05-06T14:04:05.502 INFO:tasks.workunit.client.1.smithi174.stdout:6/275: link d0/df/l59 d0/df/d45/l5b 0 2024-05-06T14:04:05.502 INFO:tasks.workunit.client.1.smithi174.stdout:2/204: write d0/d1/f5 [1156796,91620] 0 2024-05-06T14:04:05.502 INFO:tasks.workunit.client.1.smithi174.stdout:2/205: chown d0/db/c33 18910198 1 2024-05-06T14:04:05.502 INFO:tasks.workunit.client.1.smithi174.stdout:2/206: truncate d0/d1/f5 1443230 0 2024-05-06T14:04:05.502 INFO:tasks.workunit.client.1.smithi174.stdout:6/276: write d0/d25/f40 [420922,63904] 0 2024-05-06T14:04:05.502 INFO:tasks.workunit.client.1.smithi174.stdout:2/207: chown d0/d1/d2/d4/f22 47011 1 2024-05-06T14:04:05.502 INFO:tasks.workunit.client.1.smithi174.stdout:6/277: creat d0/df/d45/d4b/f5c x:0 0 0 2024-05-06T14:04:05.503 INFO:tasks.workunit.client.1.smithi174.stdout:6/278: dread d0/d25/d52/d3b/f53 [110592,40960] 0 2024-05-06T14:04:05.503 INFO:tasks.workunit.client.1.smithi174.stdout:6/279: mknod d0/df/d45/d4b/c5d 0 2024-05-06T14:04:05.503 INFO:tasks.workunit.client.1.smithi174.stdout:6/280: creat d0/df/f5e x:0 0 0 2024-05-06T14:04:05.503 INFO:tasks.workunit.client.1.smithi174.stdout:6/281: readlink d0/df/l1e 0 2024-05-06T14:04:05.503 INFO:tasks.workunit.client.1.smithi174.stdout:6/282: truncate d0/d25/f40 49904 0 2024-05-06T14:04:05.503 INFO:tasks.workunit.client.1.smithi174.stdout:6/283: write d0/f16 [778476,72014] 0 2024-05-06T14:04:05.548 INFO:tasks.workunit.client.1.smithi174.stdout:1/193: fsync f5 0 2024-05-06T14:04:05.666 INFO:tasks.workunit.client.1.smithi174.stdout:1/194: write f5 [1232688,130437] 0 2024-05-06T14:04:05.666 INFO:tasks.workunit.client.1.smithi174.stdout:5/237: fsync d1/d6/d7/d36/f43 0 2024-05-06T14:04:05.666 INFO:tasks.workunit.client.1.smithi174.stdout:4/249: fsync d1/d1a/f26 0 2024-05-06T14:04:05.666 INFO:tasks.workunit.client.1.smithi174.stdout:3/268: fsync df/d10/d1b/f20 0 2024-05-06T14:04:05.668 INFO:tasks.workunit.client.1.smithi174.stdout:6/284: dwrite d0/df/f20 [1564672,53248] 0 2024-05-06T14:04:05.668 INFO:tasks.workunit.client.1.smithi174.stdout:1/195: truncate d11/d1f/d27/f2b 1489709 0 2024-05-06T14:04:05.668 INFO:tasks.workunit.client.1.smithi174.stdout:2/208: dwrite d0/da/f3b [614400,98304] 0 2024-05-06T14:04:05.668 INFO:tasks.workunit.client.1.smithi174.stdout:2/209: stat d0/d1/d2/d1b 0 2024-05-06T14:04:05.669 INFO:tasks.workunit.client.1.smithi174.stdout:1/196: rename c9 to d11/d41/d4a/c4c 0 2024-05-06T14:04:05.669 INFO:tasks.workunit.client.1.smithi174.stdout:3/269: truncate df/f28 1885 0 2024-05-06T14:04:05.669 INFO:tasks.workunit.client.1.smithi174.stdout:1/197: rename c0 to d11/d41/c4d 0 2024-05-06T14:04:05.669 INFO:tasks.workunit.client.1.smithi174.stdout:4/250: symlink d1/d1f/d27/d3e/l65 0 2024-05-06T14:04:05.669 INFO:tasks.workunit.client.1.smithi174.stdout:7/235: dwrite d0/d1d/f2c [479232,49152] 0 2024-05-06T14:04:05.669 INFO:tasks.workunit.client.1.smithi174.stdout:6/285: mkdir d0/d25/d52/d2c/d5f 0 2024-05-06T14:04:05.669 INFO:tasks.workunit.client.1.smithi174.stdout:2/210: creat d0/f3e x:0 0 0 2024-05-06T14:04:05.669 INFO:tasks.workunit.client.1.smithi174.stdout:3/270: write df/d10/f2f [271347,16970] 0 2024-05-06T14:04:05.670 INFO:tasks.workunit.client.1.smithi174.stdout:1/198: dread d11/d1f/d27/d2d/f3a [57344,24576] 0 2024-05-06T14:04:05.670 INFO:tasks.workunit.client.1.smithi174.stdout:4/251: dread d1/d2e/f39 [589824,4096] 0 2024-05-06T14:04:05.670 INFO:tasks.workunit.client.1.smithi174.stdout:1/199: creat d11/d1f/d27/d32/f4e x:0 0 0 2024-05-06T14:04:05.670 INFO:tasks.workunit.client.1.smithi174.stdout:2/211: mkdir d0/da/d3f 0 2024-05-06T14:04:05.670 INFO:tasks.workunit.client.1.smithi174.stdout:4/252: creat d1/d1a/f66 x:0 0 0 2024-05-06T14:04:05.670 INFO:tasks.workunit.client.1.smithi174.stdout:3/271: mkdir df/d2d/d4b/d57 0 2024-05-06T14:04:05.670 INFO:tasks.workunit.client.1.smithi174.stdout:6/286: write d0/df/d45/f47 [1011520,52712] 0 2024-05-06T14:04:05.670 INFO:tasks.workunit.client.1.smithi174.stdout:4/253: dread d1/fc [36864,32768] 0 2024-05-06T14:04:05.670 INFO:tasks.workunit.client.1.smithi174.stdout:6/287: stat d0/df/l1e 0 2024-05-06T14:04:05.671 INFO:tasks.workunit.client.1.smithi174.stdout:5/238: unlink d1/d6/df/d35/d3a/db/d1e/f29 0 2024-05-06T14:04:05.671 INFO:tasks.workunit.client.1.smithi174.stdout:6/288: chown d0/d25/d52/l34 0 1 2024-05-06T14:04:05.671 INFO:tasks.workunit.client.1.smithi174.stdout:5/239: dread d1/d6/df/d35/d3a/de/f3f [135168,28672] 0 2024-05-06T14:04:05.671 INFO:tasks.workunit.client.1.smithi174.stdout:4/254: symlink d1/d9/d15/l67 0 2024-05-06T14:04:05.671 INFO:tasks.workunit.client.1.smithi174.stdout:4/255: unlink d1/d9/f12 0 2024-05-06T14:04:05.671 INFO:tasks.workunit.client.1.smithi174.stdout:8/314: dread d4/de/d24/f33 [679936,73728] 0 2024-05-06T14:04:05.671 INFO:tasks.workunit.client.1.smithi174.stdout:8/315: write d4/d15/f1e [227753,117766] 0 2024-05-06T14:04:05.671 INFO:tasks.workunit.client.1.smithi174.stdout:8/316: link d4/de/f17 d4/d53/f69 0 2024-05-06T14:04:05.671 INFO:tasks.workunit.client.1.smithi174.stdout:2/212: dwrite d0/d1/d2/f1c [1138688,110592] 0 2024-05-06T14:04:05.672 INFO:tasks.workunit.client.1.smithi174.stdout:2/213: truncate d0/d1/d2/f1a 1269655 0 2024-05-06T14:04:05.672 INFO:tasks.workunit.client.1.smithi174.stdout:2/214: write d0/d1/d2/d4/d6/f26 [842245,50083] 0 2024-05-06T14:04:05.672 INFO:tasks.workunit.client.1.smithi174.stdout:8/317: dwrite d4/d15/d20/f44 [1298432,24576] 0 2024-05-06T14:04:05.672 INFO:tasks.workunit.client.1.smithi174.stdout:8/318: mknod d4/de/d23/d41/d56/c6a 0 2024-05-06T14:04:05.672 INFO:tasks.workunit.client.1.smithi174.stdout:2/215: mkdir d0/d40 0 2024-05-06T14:04:05.672 INFO:tasks.workunit.client.1.smithi174.stdout:8/319: readlink d4/l1d 0 2024-05-06T14:04:05.672 INFO:tasks.workunit.client.1.smithi174.stdout:2/216: symlink d0/d1/d2/d4/d6/d3c/l41 0 2024-05-06T14:04:05.672 INFO:tasks.workunit.client.1.smithi174.stdout:2/217: write d0/d1/d2/f1a [72118,39962] 0 2024-05-06T14:04:05.673 INFO:tasks.workunit.client.1.smithi174.stdout:2/218: chown d0/da 3956 1 2024-05-06T14:04:05.687 INFO:tasks.workunit.client.1.smithi174.stdout:7/236: fsync d0/da/d19/d24/f48 0 2024-05-06T14:04:05.687 INFO:tasks.workunit.client.1.smithi174.stdout:4/256: fdatasync d1/d9/d15/f21 0 2024-05-06T14:04:05.687 INFO:tasks.workunit.client.1.smithi174.stdout:1/200: fsync d11/f24 0 2024-05-06T14:04:05.687 INFO:tasks.workunit.client.1.smithi174.stdout:7/237: chown d0/d3a 1 1 2024-05-06T14:04:05.687 INFO:tasks.workunit.client.1.smithi174.stdout:4/257: dread - d1/d9/d15/f32 zero size 2024-05-06T14:04:05.687 INFO:tasks.workunit.client.1.smithi174.stdout:1/201: dread - d11/d1f/d27/d2d/f47 zero size 2024-05-06T14:04:05.688 INFO:tasks.workunit.client.1.smithi174.stdout:7/238: mknod d0/d3a/d43/c51 0 2024-05-06T14:04:05.688 INFO:tasks.workunit.client.1.smithi174.stdout:1/202: write fc [3090408,17781] 0 2024-05-06T14:04:05.688 INFO:tasks.workunit.client.1.smithi174.stdout:1/203: write d11/f22 [554698,14430] 0 2024-05-06T14:04:05.688 INFO:tasks.workunit.client.1.smithi174.stdout:1/204: chown d11/d1f/l2a 6 1 2024-05-06T14:04:05.695 INFO:tasks.workunit.client.1.smithi174.stdout:8/320: dwrite d4/d15/f30 [438272,81920] 0 2024-05-06T14:04:05.695 INFO:tasks.workunit.client.1.smithi174.stdout:2/219: dwrite d0/d1/d2/d4/f22 [880640,24576] 0 2024-05-06T14:04:05.695 INFO:tasks.workunit.client.1.smithi174.stdout:4/258: rename d1/d1a/d3c/d50/d59 to d1/d48/d5a/d61/d68 0 2024-05-06T14:04:05.695 INFO:tasks.workunit.client.1.smithi174.stdout:7/239: rename d0/da/d11 to d0/da/d19/d24/d14/d52 0 2024-05-06T14:04:05.695 INFO:tasks.workunit.client.1.smithi174.stdout:1/205: symlink d11/d1f/l4f 0 2024-05-06T14:04:05.695 INFO:tasks.workunit.client.1.smithi174.stdout:8/321: symlink d4/de/d24/l6b 0 2024-05-06T14:04:05.695 INFO:tasks.workunit.client.1.smithi174.stdout:1/206: dread - d11/f3c zero size 2024-05-06T14:04:05.695 INFO:tasks.workunit.client.1.smithi174.stdout:7/240: truncate d0/da/d19/d24/d14/d52/f3e 1263575 0 2024-05-06T14:04:05.696 INFO:tasks.workunit.client.1.smithi174.stdout:8/322: truncate d4/d53/f69 4699954 0 2024-05-06T14:04:05.696 INFO:tasks.workunit.client.1.smithi174.stdout:8/323: dread - d4/de/d24/d46/f61 zero size 2024-05-06T14:04:05.696 INFO:tasks.workunit.client.1.smithi174.stdout:1/207: creat d11/d1f/d27/d32/f50 x:0 0 0 2024-05-06T14:04:05.696 INFO:tasks.workunit.client.1.smithi174.stdout:8/324: truncate d4/de/d24/f33 1042422 0 2024-05-06T14:04:05.696 INFO:tasks.workunit.client.1.smithi174.stdout:4/259: write d1/d9/d15/f21 [1294944,100160] 0 2024-05-06T14:04:05.699 INFO:tasks.workunit.client.1.smithi174.stdout:2/220: dwrite d0/d1/d2/f1a [1445888,118784] 0 2024-05-06T14:04:05.699 INFO:tasks.workunit.client.1.smithi174.stdout:2/221: symlink d0/db/d15/l42 0 2024-05-06T14:04:05.699 INFO:tasks.workunit.client.1.smithi174.stdout:2/222: mkdir d0/d1/d2/d4/d43 0 2024-05-06T14:04:05.699 INFO:tasks.workunit.client.1.smithi174.stdout:2/223: dread d0/d1/d2/f20 [323584,118784] 0 2024-05-06T14:04:05.699 INFO:tasks.workunit.client.1.smithi174.stdout:1/208: dwrite d11/d1f/f38 [503808,4096] 0 2024-05-06T14:04:05.700 INFO:tasks.workunit.client.1.smithi174.stdout:1/209: mkdir d11/d41/d51 0 2024-05-06T14:04:05.700 INFO:tasks.workunit.client.1.smithi174.stdout:1/210: creat d11/d1f/d27/d2d/f52 x:0 0 0 2024-05-06T14:04:05.700 INFO:tasks.workunit.client.1.smithi174.stdout:1/211: mkdir d11/d41/d53 0 2024-05-06T14:04:05.700 INFO:tasks.workunit.client.1.smithi174.stdout:1/212: rename d11/l34 to d11/d1f/d27/d32/l54 0 2024-05-06T14:04:05.700 INFO:tasks.workunit.client.1.smithi174.stdout:1/213: chown d11/d1f/l48 109862 1 2024-05-06T14:04:05.700 INFO:tasks.workunit.client.1.smithi174.stdout:1/214: readlink d11/l18 0 2024-05-06T14:04:05.700 INFO:tasks.workunit.client.1.smithi174.stdout:1/215: truncate d11/d1f/d27/d32/f4e 801151 0 2024-05-06T14:04:05.700 INFO:tasks.workunit.client.1.smithi174.stdout:1/216: mkdir d11/d1f/d55 0 2024-05-06T14:04:05.701 INFO:tasks.workunit.client.1.smithi174.stdout:4/260: dwrite d1/d9/d15/f21 [2060288,118784] 0 2024-05-06T14:04:05.701 INFO:tasks.workunit.client.1.smithi174.stdout:1/217: creat d11/d41/d4a/f56 x:0 0 0 2024-05-06T14:04:05.701 INFO:tasks.workunit.client.1.smithi174.stdout:1/218: mkdir d11/d57 0 2024-05-06T14:04:05.798 INFO:tasks.workunit.client.1.smithi174.stdout:8/325: fsync d4/d15/f4d 0 2024-05-06T14:04:05.801 INFO:tasks.workunit.client.1.smithi174.stdout:4/261: rename d1/d1f/d27/d2c/d45/f52 to d1/d9/d53/f69 0 2024-05-06T14:04:05.801 INFO:tasks.workunit.client.1.smithi174.stdout:4/262: write d1/d9/f23 [1140392,111395] 0 2024-05-06T14:04:05.801 INFO:tasks.workunit.client.1.smithi174.stdout:0/177: sync 2024-05-06T14:04:05.801 INFO:tasks.workunit.client.1.smithi174.stdout:4/263: creat d1/d2e/f6a x:0 0 0 2024-05-06T14:04:05.801 INFO:tasks.workunit.client.1.smithi174.stdout:4/264: write d1/d9/f22 [796322,105866] 0 2024-05-06T14:04:05.801 INFO:tasks.workunit.client.1.smithi174.stdout:4/265: write d1/d9/fe [1488507,64557] 0 2024-05-06T14:04:05.802 INFO:tasks.workunit.client.1.smithi174.stdout:4/266: stat d1/d1f/d27/d2c/c43 0 2024-05-06T14:04:05.802 INFO:tasks.workunit.client.1.smithi174.stdout:4/267: rename d1/d1f/d27/d3e/d5d to d1/d9/d53/d6b 0 2024-05-06T14:04:05.803 INFO:tasks.workunit.client.1.smithi174.stdout:2/224: dwrite d0/d16/f19 [1347584,114688] 0 2024-05-06T14:04:05.803 INFO:tasks.workunit.client.1.smithi174.stdout:2/225: creat d0/d1/d2/d4/d6/f44 x:0 0 0 2024-05-06T14:04:05.803 INFO:tasks.workunit.client.1.smithi174.stdout:2/226: symlink d0/d1/d2/d2a/l45 0 2024-05-06T14:04:05.851 INFO:tasks.workunit.client.1.smithi174.stdout:6/289: fsync d0/f16 0 2024-05-06T14:04:05.851 INFO:tasks.workunit.client.1.smithi174.stdout:0/178: fsync d0/d1a/f1e 0 2024-05-06T14:04:05.851 INFO:tasks.workunit.client.1.smithi174.stdout:0/179: stat d0/d1a/d17/c33 0 2024-05-06T14:04:05.857 INFO:tasks.workunit.client.1.smithi174.stdout:9/243: sync 2024-05-06T14:04:05.857 INFO:tasks.workunit.client.1.smithi174.stdout:3/272: sync 2024-05-06T14:04:05.858 INFO:tasks.workunit.client.1.smithi174.stdout:2/227: dwrite d0/d1/f35 [1703936,24576] 0 2024-05-06T14:04:05.858 INFO:tasks.workunit.client.1.smithi174.stdout:9/244: mknod dc/c53 0 2024-05-06T14:04:05.858 INFO:tasks.workunit.client.1.smithi174.stdout:0/180: unlink d0/d1a/d17/ff 0 2024-05-06T14:04:05.858 INFO:tasks.workunit.client.1.smithi174.stdout:3/273: write df/d10/d1b/f2b [1077188,688] 0 2024-05-06T14:04:05.858 INFO:tasks.workunit.client.1.smithi174.stdout:0/181: getdents d0/d4 0 2024-05-06T14:04:05.859 INFO:tasks.workunit.client.1.smithi174.stdout:0/182: write d0/d1a/f22 [225046,98472] 0 2024-05-06T14:04:05.859 INFO:tasks.workunit.client.1.smithi174.stdout:6/290: dwrite d0/d25/f40 [851968,28672] 0 2024-05-06T14:04:05.952 INFO:tasks.workunit.client.1.smithi174.stdout:2/228: dwrite d0/d1/d2/d2a/f3a [1208320,49152] 0 2024-05-06T14:04:05.953 INFO:tasks.workunit.client.1.smithi174.stdout:2/229: truncate d0/db/d15/f29 1269816 0 2024-05-06T14:04:05.953 INFO:tasks.workunit.client.1.smithi174.stdout:2/230: chown d0/d1/d2/d4/d18/d2d 127342863 1 2024-05-06T14:04:05.953 INFO:tasks.workunit.client.1.smithi174.stdout:2/231: creat d0/d1/d2/d4/f46 x:0 0 0 2024-05-06T14:04:05.953 INFO:tasks.workunit.client.1.smithi174.stdout:2/232: creat d0/d1/d2/d4/d18/d2d/d32/f47 x:0 0 0 2024-05-06T14:04:05.953 INFO:tasks.workunit.client.1.smithi174.stdout:2/233: creat d0/d1/d2/d2a/f48 x:0 0 0 2024-05-06T14:04:05.953 INFO:tasks.workunit.client.1.smithi174.stdout:2/234: write d0/d1/d2/f1a [1993578,8111] 0 2024-05-06T14:04:05.954 INFO:tasks.workunit.client.1.smithi174.stdout:2/235: write d0/d1/d2/d4/d18/d2d/d32/f38 [328536,92963] 0 2024-05-06T14:04:05.954 INFO:tasks.workunit.client.1.smithi174.stdout:2/236: creat d0/d1/d2/d4/d18/f49 x:0 0 0 2024-05-06T14:04:05.954 INFO:tasks.workunit.client.1.smithi174.stdout:6/291: dwrite d0/df/f5e [102400,40960] 0 2024-05-06T14:04:05.954 INFO:tasks.workunit.client.1.smithi174.stdout:6/292: write d0/d25/d52/d2c/f37 [2202868,25248] 0 2024-05-06T14:04:05.954 INFO:tasks.workunit.client.1.smithi174.stdout:6/293: readlink d0/d25/l4f 0 2024-05-06T14:04:05.954 INFO:tasks.workunit.client.1.smithi174.stdout:9/245: dread dc/f36 [36864,106496] 0 2024-05-06T14:04:05.954 INFO:tasks.workunit.client.1.smithi174.stdout:9/246: read - dc/f4e zero size 2024-05-06T14:04:05.987 INFO:tasks.workunit.client.1.smithi174.stdout:3/274: fsync fc 0 2024-05-06T14:04:05.987 INFO:tasks.workunit.client.1.smithi174.stdout:3/275: truncate df/d10/f3a 2843907 0 2024-05-06T14:04:05.988 INFO:tasks.workunit.client.1.smithi174.stdout:3/276: dread df/d10/d1b/f33 [94208,73728] 0 2024-05-06T14:04:05.988 INFO:tasks.workunit.client.1.smithi174.stdout:6/294: fdatasync d0/d25/f30 0 2024-05-06T14:04:05.991 INFO:tasks.workunit.client.1.smithi174.stdout:9/247: dwrite dc/f30 [561152,106496] 0 2024-05-06T14:04:05.991 INFO:tasks.workunit.client.1.smithi174.stdout:9/248: creat dc/f54 x:0 0 0 2024-05-06T14:04:05.993 INFO:tasks.workunit.client.1.smithi174.stdout:6/295: dwrite d0/df/d45/f47 [716800,73728] 0 2024-05-06T14:04:05.993 INFO:tasks.workunit.client.1.smithi174.stdout:6/296: mknod d0/d25/d52/d2c/c60 0 2024-05-06T14:04:05.994 INFO:tasks.workunit.client.1.smithi174.stdout:3/277: dwrite df/d2d/f53 [536576,53248] 0 2024-05-06T14:04:05.994 INFO:tasks.workunit.client.1.smithi174.stdout:9/249: dwrite dc/de/f2e [2043904,16384] 0 2024-05-06T14:04:05.994 INFO:tasks.workunit.client.1.smithi174.stdout:3/278: truncate df/d10/d1b/f2b 798304 0 2024-05-06T14:04:05.994 INFO:tasks.workunit.client.1.smithi174.stdout:9/250: rename dc/d17/f29 to dc/d1c/f55 0 2024-05-06T14:04:05.994 INFO:tasks.workunit.client.1.smithi174.stdout:9/251: creat dc/d1c/f56 x:0 0 0 2024-05-06T14:04:05.994 INFO:tasks.workunit.client.1.smithi174.stdout:3/279: creat df/d2d/f58 x:0 0 0 2024-05-06T14:04:05.994 INFO:tasks.workunit.client.1.smithi174.stdout:9/252: read dc/df/f12 [3428871,42020] 0 2024-05-06T14:04:05.995 INFO:tasks.workunit.client.1.smithi174.stdout:9/253: mknod dc/d14/d43/c57 0 2024-05-06T14:04:05.995 INFO:tasks.workunit.client.1.smithi174.stdout:9/254: truncate dc/f3b 499888 0 2024-05-06T14:04:06.068 INFO:tasks.workunit.client.1.smithi174.stdout:3/280: mkdir df/d10/d1b/d59 0 2024-05-06T14:04:06.068 INFO:tasks.workunit.client.1.smithi174.stdout:3/281: stat df/d10/d1b/l49 0 2024-05-06T14:04:06.068 INFO:tasks.workunit.client.1.smithi174.stdout:3/282: stat df/d10/d1b/f24 0 2024-05-06T14:04:06.071 INFO:tasks.workunit.client.1.smithi174.stdout:3/283: unlink df/d10/f1a 0 2024-05-06T14:04:06.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/240: sync 2024-05-06T14:04:06.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/241: truncate d1/d6/df/d35/d3a/f28 1335 0 2024-05-06T14:04:06.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/242: rmdir d1/d6/d2a 39 2024-05-06T14:04:06.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/243: link d1/d6/df/d35/d3a/de/l4f d1/d6/d7/l51 0 2024-05-06T14:04:06.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/244: mkdir d1/d6/d52 0 2024-05-06T14:04:06.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/245: rename d1/d6/d52 to d1/d6/d7/d36/d53 0 2024-05-06T14:04:06.072 INFO:tasks.workunit.client.1.smithi174.stdout:9/255: dwrite dc/df/f12 [4210688,57344] 0 2024-05-06T14:04:06.072 INFO:tasks.workunit.client.1.smithi174.stdout:9/256: creat dc/d1c/f58 x:0 0 0 2024-05-06T14:04:06.072 INFO:tasks.workunit.client.1.smithi174.stdout:9/257: creat dc/d14/d43/f59 x:0 0 0 2024-05-06T14:04:06.072 INFO:tasks.workunit.client.1.smithi174.stdout:9/258: creat dc/df/f5a x:0 0 0 2024-05-06T14:04:06.102 INFO:tasks.workunit.client.1.smithi174.stdout:6/297: fdatasync d0/d25/d35/f4d 0 2024-05-06T14:04:06.102 INFO:tasks.workunit.client.1.smithi174.stdout:6/298: write d0/df/d45/f50 [793647,32787] 0 2024-05-06T14:04:06.102 INFO:tasks.workunit.client.1.smithi174.stdout:6/299: mknod d0/df/d3c/c61 0 2024-05-06T14:04:06.102 INFO:tasks.workunit.client.1.smithi174.stdout:3/284: fdatasync df/f44 0 2024-05-06T14:04:06.103 INFO:tasks.workunit.client.1.smithi174.stdout:9/259: fsync dc/de/f3e 0 2024-05-06T14:04:06.107 INFO:tasks.workunit.client.1.smithi174.stdout:5/246: dwrite d1/d6/d7/f44 [532480,61440] 0 2024-05-06T14:04:06.108 INFO:tasks.workunit.client.1.smithi174.stdout:9/260: mknod dc/d27/d51/c5b 0 2024-05-06T14:04:06.108 INFO:tasks.workunit.client.1.smithi174.stdout:3/285: mkdir df/d2d/d4b/d5a 0 2024-05-06T14:04:06.108 INFO:tasks.workunit.client.1.smithi174.stdout:5/247: dread - d1/d6/df/d35/f3d zero size 2024-05-06T14:04:06.108 INFO:tasks.workunit.client.1.smithi174.stdout:6/300: write d0/f16 [1108398,73946] 0 2024-05-06T14:04:06.108 INFO:tasks.workunit.client.1.smithi174.stdout:3/286: mkdir df/d2d/d5b 0 2024-05-06T14:04:06.108 INFO:tasks.workunit.client.1.smithi174.stdout:9/261: symlink dc/d27/l5c 0 2024-05-06T14:04:06.108 INFO:tasks.workunit.client.1.smithi174.stdout:3/287: dread - df/f1f zero size 2024-05-06T14:04:06.109 INFO:tasks.workunit.client.1.smithi174.stdout:9/262: readlink dc/df/l33 0 2024-05-06T14:04:06.109 INFO:tasks.workunit.client.1.smithi174.stdout:5/248: creat d1/d6/f54 x:0 0 0 2024-05-06T14:04:06.109 INFO:tasks.workunit.client.1.smithi174.stdout:6/301: mknod d0/df/d45/d56/c62 0 2024-05-06T14:04:06.109 INFO:tasks.workunit.client.1.smithi174.stdout:6/302: chown d0/d25/d52/d2c/c3d 0 1 2024-05-06T14:04:06.109 INFO:tasks.workunit.client.1.smithi174.stdout:9/263: read dc/df/f11 [1541506,26870] 0 2024-05-06T14:04:06.109 INFO:tasks.workunit.client.1.smithi174.stdout:6/303: creat d0/d25/d52/d2c/f63 x:0 0 0 2024-05-06T14:04:06.109 INFO:tasks.workunit.client.1.smithi174.stdout:6/304: symlink d0/d25/d52/d4c/l64 0 2024-05-06T14:04:06.109 INFO:tasks.workunit.client.1.smithi174.stdout:2/237: sync 2024-05-06T14:04:06.110 INFO:tasks.workunit.client.1.smithi174.stdout:8/326: sync 2024-05-06T14:04:06.110 INFO:tasks.workunit.client.1.smithi174.stdout:1/219: sync 2024-05-06T14:04:06.110 INFO:tasks.workunit.client.1.smithi174.stdout:0/183: sync 2024-05-06T14:04:06.110 INFO:tasks.workunit.client.1.smithi174.stdout:1/220: stat f1 0 2024-05-06T14:04:06.110 INFO:tasks.workunit.client.1.smithi174.stdout:2/238: creat d0/db/d15/f4a x:0 0 0 2024-05-06T14:04:06.110 INFO:tasks.workunit.client.1.smithi174.stdout:8/327: truncate d4/d53/f69 3125718 0 2024-05-06T14:04:06.110 INFO:tasks.workunit.client.1.smithi174.stdout:7/241: sync 2024-05-06T14:04:06.110 INFO:tasks.workunit.client.1.smithi174.stdout:4/268: sync 2024-05-06T14:04:06.111 INFO:tasks.workunit.client.1.smithi174.stdout:4/269: dread - d1/d2e/f6a zero size 2024-05-06T14:04:06.111 INFO:tasks.workunit.client.1.smithi174.stdout:8/328: creat d4/f6c x:0 0 0 2024-05-06T14:04:06.111 INFO:tasks.workunit.client.1.smithi174.stdout:8/329: chown d4/de/d24/f45 2132 1 2024-05-06T14:04:06.111 INFO:tasks.workunit.client.1.smithi174.stdout:4/270: link d1/l14 d1/d48/d5a/d61/d68/l6c 0 2024-05-06T14:04:06.111 INFO:tasks.workunit.client.1.smithi174.stdout:7/242: symlink d0/da/l53 0 2024-05-06T14:04:06.111 INFO:tasks.workunit.client.1.smithi174.stdout:4/271: write d1/d1a/f26 [1143271,34527] 0 2024-05-06T14:04:06.111 INFO:tasks.workunit.client.1.smithi174.stdout:8/330: write d4/d48/f5c [256149,49847] 0 2024-05-06T14:04:06.111 INFO:tasks.workunit.client.1.smithi174.stdout:4/272: dread d1/d1a/f28 [454656,24576] 0 2024-05-06T14:04:06.112 INFO:tasks.workunit.client.1.smithi174.stdout:8/331: mknod d4/d48/c6d 0 2024-05-06T14:04:06.112 INFO:tasks.workunit.client.1.smithi174.stdout:4/273: rename d1/d1a/f26 to d1/d9/d15/f6d 0 2024-05-06T14:04:06.112 INFO:tasks.workunit.client.1.smithi174.stdout:4/274: write d1/d9/f18 [86017,120710] 0 2024-05-06T14:04:06.162 INFO:tasks.workunit.client.1.smithi174.stdout:9/264: dwrite dc/d1c/f56 [24576,49152] 0 2024-05-06T14:04:06.163 INFO:tasks.workunit.client.1.smithi174.stdout:9/265: symlink dc/df/l5d 0 2024-05-06T14:04:06.163 INFO:tasks.workunit.client.1.smithi174.stdout:5/249: dwrite d1/d6/df/d35/d3a/f28 [126976,90112] 0 2024-05-06T14:04:06.163 INFO:tasks.workunit.client.1.smithi174.stdout:9/266: symlink dc/d27/l5e 0 2024-05-06T14:04:06.163 INFO:tasks.workunit.client.1.smithi174.stdout:9/267: unlink dc/d27/l5c 0 2024-05-06T14:04:06.163 INFO:tasks.workunit.client.1.smithi174.stdout:9/268: truncate dc/d1c/f38 461746 0 2024-05-06T14:04:06.163 INFO:tasks.workunit.client.1.smithi174.stdout:3/288: dwrite f5 [897024,73728] 0 2024-05-06T14:04:06.163 INFO:tasks.workunit.client.1.smithi174.stdout:5/250: write d1/f45 [468587,81151] 0 2024-05-06T14:04:06.164 INFO:tasks.workunit.client.1.smithi174.stdout:3/289: dread - df/f1f zero size 2024-05-06T14:04:06.164 INFO:tasks.workunit.client.1.smithi174.stdout:3/290: rename df/d10/f14 to df/d10/d1b/f5c 0 2024-05-06T14:04:06.164 INFO:tasks.workunit.client.1.smithi174.stdout:3/291: readlink l3 0 2024-05-06T14:04:06.164 INFO:tasks.workunit.client.1.smithi174.stdout:1/221: dwrite d11/d1f/f38 [1421312,32768] 0 2024-05-06T14:04:06.164 INFO:tasks.workunit.client.1.smithi174.stdout:3/292: creat df/d2d/d4b/d57/f5d x:0 0 0 2024-05-06T14:04:06.164 INFO:tasks.workunit.client.1.smithi174.stdout:3/293: unlink f2 0 2024-05-06T14:04:06.164 INFO:tasks.workunit.client.1.smithi174.stdout:3/294: mknod df/d10/d1b/d59/c5e 0 2024-05-06T14:04:06.164 INFO:tasks.workunit.client.1.smithi174.stdout:3/295: mknod df/d10/d1b/d59/c5f 0 2024-05-06T14:04:06.165 INFO:tasks.workunit.client.1.smithi174.stdout:3/296: truncate df/f18 103338 0 2024-05-06T14:04:06.165 INFO:tasks.workunit.client.1.smithi174.stdout:3/297: symlink df/d2d/d4b/d5a/l60 0 2024-05-06T14:04:06.165 INFO:tasks.workunit.client.1.smithi174.stdout:3/298: write df/f44 [411516,85505] 0 2024-05-06T14:04:06.165 INFO:tasks.workunit.client.1.smithi174.stdout:8/332: dwrite d4/d15/d20/f5f [954368,73728] 0 2024-05-06T14:04:06.165 INFO:tasks.workunit.client.1.smithi174.stdout:8/333: creat d4/f6e x:0 0 0 2024-05-06T14:04:06.165 INFO:tasks.workunit.client.1.smithi174.stdout:8/334: creat d4/de/d24/d46/d63/f6f x:0 0 0 2024-05-06T14:04:06.165 INFO:tasks.workunit.client.1.smithi174.stdout:8/335: readlink d4/l1c 0 2024-05-06T14:04:06.165 INFO:tasks.workunit.client.1.smithi174.stdout:8/336: write d4/d15/d20/d3e/f54 [414263,93178] 0 2024-05-06T14:04:06.165 INFO:tasks.workunit.client.1.smithi174.stdout:8/337: write d4/de/d23/f65 [2198179,103649] 0 2024-05-06T14:04:06.166 INFO:tasks.workunit.client.1.smithi174.stdout:8/338: mkdir d4/d15/d20/d70 0 2024-05-06T14:04:06.166 INFO:tasks.workunit.client.1.smithi174.stdout:8/339: write d4/de/d24/f33 [540407,33996] 0 2024-05-06T14:04:06.166 INFO:tasks.workunit.client.1.smithi174.stdout:8/340: creat d4/de/d23/d41/d56/f71 x:0 0 0 2024-05-06T14:04:06.166 INFO:tasks.workunit.client.1.smithi174.stdout:8/341: dread - d4/d15/f4d zero size 2024-05-06T14:04:06.221 INFO:tasks.workunit.client.1.smithi174.stdout:6/305: fdatasync d0/df/f5e 0 2024-05-06T14:04:06.222 INFO:tasks.workunit.client.1.smithi174.stdout:1/222: fsync d11/d1f/d27/d2d/f31 0 2024-05-06T14:04:06.222 INFO:tasks.workunit.client.1.smithi174.stdout:3/299: fdatasync df/d2d/d4b/f51 0 2024-05-06T14:04:06.222 INFO:tasks.workunit.client.1.smithi174.stdout:1/223: chown d11/d1f/d27/l35 3907 1 2024-05-06T14:04:06.222 INFO:tasks.workunit.client.1.smithi174.stdout:1/224: chown d11/l18 1873555 1 2024-05-06T14:04:06.222 INFO:tasks.workunit.client.1.smithi174.stdout:1/225: chown d11/d41/c4d 16 1 2024-05-06T14:04:06.222 INFO:tasks.workunit.client.1.smithi174.stdout:6/306: fsync d0/f15 0 2024-05-06T14:04:06.225 INFO:tasks.workunit.client.1.smithi174.stdout:8/342: dwrite d4/de/f13 [385024,94208] 0 2024-05-06T14:04:06.225 INFO:tasks.workunit.client.1.smithi174.stdout:9/269: dread dc/d1c/f56 [65536,32768] 0 2024-05-06T14:04:06.225 INFO:tasks.workunit.client.1.smithi174.stdout:5/251: dwrite d1/f45 [233472,36864] 0 2024-05-06T14:04:06.225 INFO:tasks.workunit.client.1.smithi174.stdout:3/300: truncate df/d10/f3f 779415 0 2024-05-06T14:04:06.225 INFO:tasks.workunit.client.1.smithi174.stdout:6/307: mkdir d0/d48/d65 0 2024-05-06T14:04:06.225 INFO:tasks.workunit.client.1.smithi174.stdout:9/270: link dc/d1c/f24 dc/d1c/f5f 0 2024-05-06T14:04:06.226 INFO:tasks.workunit.client.1.smithi174.stdout:9/271: chown dc/de 6 1 2024-05-06T14:04:06.226 INFO:tasks.workunit.client.1.smithi174.stdout:5/252: rename d1/d6/d7/d36/f43 to d1/d6/d7/d3e/d4c/f55 0 2024-05-06T14:04:06.226 INFO:tasks.workunit.client.1.smithi174.stdout:6/308: mknod d0/d25/c66 0 2024-05-06T14:04:06.226 INFO:tasks.workunit.client.1.smithi174.stdout:3/301: creat df/d2d/d4b/d57/f61 x:0 0 0 2024-05-06T14:04:06.226 INFO:tasks.workunit.client.1.smithi174.stdout:8/343: write d4/f49 [2344170,48106] 0 2024-05-06T14:04:06.226 INFO:tasks.workunit.client.1.smithi174.stdout:3/302: write df/d2d/f4a [1044603,58655] 0 2024-05-06T14:04:06.226 INFO:tasks.workunit.client.1.smithi174.stdout:1/226: dwrite d11/f20 [417792,86016] 0 2024-05-06T14:04:06.227 INFO:tasks.workunit.client.1.smithi174.stdout:3/303: write df/f17 [619511,57821] 0 2024-05-06T14:04:06.227 INFO:tasks.workunit.client.1.smithi174.stdout:3/304: getdents df/d10/d1b 0 2024-05-06T14:04:06.227 INFO:tasks.workunit.client.1.smithi174.stdout:3/305: read df/d2d/f31 [331607,97625] 0 2024-05-06T14:04:06.227 INFO:tasks.workunit.client.1.smithi174.stdout:3/306: chown df/d10/f3b 715058 1 2024-05-06T14:04:06.227 INFO:tasks.workunit.client.1.smithi174.stdout:3/307: dread df/d10/d1b/f5c [696320,36864] 0 2024-05-06T14:04:06.227 INFO:tasks.workunit.client.1.smithi174.stdout:3/308: stat df/d10 0 2024-05-06T14:04:06.227 INFO:tasks.workunit.client.1.smithi174.stdout:3/309: symlink df/d2d/d4b/l62 0 2024-05-06T14:04:06.228 INFO:tasks.workunit.client.1.smithi174.stdout:3/310: link df/d2d/f58 df/d2d/d4b/d57/f63 0 2024-05-06T14:04:06.246 INFO:tasks.workunit.client.1.smithi174.stdout:8/344: dwrite d4/f6c [638976,126976] 0 2024-05-06T14:04:06.246 INFO:tasks.workunit.client.1.smithi174.stdout:8/345: creat d4/de/f72 x:0 0 0 2024-05-06T14:04:06.246 INFO:tasks.workunit.client.1.smithi174.stdout:8/346: truncate d4/de/f19 467022 0 2024-05-06T14:04:06.249 INFO:tasks.workunit.client.1.smithi174.stdout:6/309: dwrite d0/d25/d35/f4d [32768,4096] 0 2024-05-06T14:04:06.250 INFO:tasks.workunit.client.1.smithi174.stdout:9/272: dwrite dc/f4e [311296,4096] 0 2024-05-06T14:04:06.250 INFO:tasks.workunit.client.1.smithi174.stdout:9/273: mkdir dc/d27/d60 0 2024-05-06T14:04:06.250 INFO:tasks.workunit.client.1.smithi174.stdout:3/311: dwrite df/d10/d1b/f2b [786432,65536] 0 2024-05-06T14:04:06.250 INFO:tasks.workunit.client.1.smithi174.stdout:3/312: link df/d10/d1b/l40 df/d2d/d4b/d5a/l64 0 2024-05-06T14:04:06.251 INFO:tasks.workunit.client.1.smithi174.stdout:8/347: dwrite d4/de/d23/d3c/f55 [884736,94208] 0 2024-05-06T14:04:06.252 INFO:tasks.workunit.client.1.smithi174.stdout:8/348: readlink d4/d15/d20/l3a 0 2024-05-06T14:04:06.252 INFO:tasks.workunit.client.1.smithi174.stdout:8/349: rename d4/f6c to d4/d15/f73 0 2024-05-06T14:04:06.252 INFO:tasks.workunit.client.1.smithi174.stdout:8/350: write d4/de/d23/f25 [586125,90688] 0 2024-05-06T14:04:06.252 INFO:tasks.workunit.client.1.smithi174.stdout:8/351: write d4/d48/f5c [505318,97970] 0 2024-05-06T14:04:06.252 INFO:tasks.workunit.client.1.smithi174.stdout:8/352: creat d4/d15/d64/f74 x:0 0 0 2024-05-06T14:04:06.252 INFO:tasks.workunit.client.1.smithi174.stdout:8/353: symlink d4/d15/d66/l75 0 2024-05-06T14:04:06.252 INFO:tasks.workunit.client.1.smithi174.stdout:8/354: truncate d4/fb 1276893 0 2024-05-06T14:04:06.252 INFO:tasks.workunit.client.1.smithi174.stdout:8/355: truncate d4/de/d23/d41/d56/f71 1046932 0 2024-05-06T14:04:06.253 INFO:tasks.workunit.client.1.smithi174.stdout:8/356: stat d4/d15/f16 0 2024-05-06T14:04:06.253 INFO:tasks.workunit.client.1.smithi174.stdout:8/357: chown d4/de/f1f 3468 1 2024-05-06T14:04:06.253 INFO:tasks.workunit.client.1.smithi174.stdout:8/358: rmdir d4 39 2024-05-06T14:04:06.348 INFO:tasks.workunit.client.1.smithi174.stdout:1/227: fdatasync fc 0 2024-05-06T14:04:06.348 INFO:tasks.workunit.client.1.smithi174.stdout:1/228: write d11/d1f/d27/f45 [1677787,13535] 0 2024-05-06T14:04:06.352 INFO:tasks.workunit.client.1.smithi174.stdout:1/229: symlink d11/d1f/d27/l58 0 2024-05-06T14:04:06.354 INFO:tasks.workunit.client.1.smithi174.stdout:9/274: dwrite dc/d17/f2f [73728,49152] 0 2024-05-06T14:04:06.354 INFO:tasks.workunit.client.1.smithi174.stdout:6/310: dwrite d0/df/f5e [1105920,86016] 0 2024-05-06T14:04:06.355 INFO:tasks.workunit.client.1.smithi174.stdout:8/359: dwrite d4/de/f19 [229376,102400] 0 2024-05-06T14:04:06.355 INFO:tasks.workunit.client.1.smithi174.stdout:3/313: dwrite fc [86016,4096] 0 2024-05-06T14:04:06.355 INFO:tasks.workunit.client.1.smithi174.stdout:9/275: dread dc/de/f3e [16384,61440] 0 2024-05-06T14:04:06.355 INFO:tasks.workunit.client.1.smithi174.stdout:1/230: write d11/f3c [362188,40186] 0 2024-05-06T14:04:06.355 INFO:tasks.workunit.client.1.smithi174.stdout:8/360: chown d4/d15/d20/d3e/f54 103 1 2024-05-06T14:04:06.355 INFO:tasks.workunit.client.1.smithi174.stdout:1/231: rmdir d11/d1f 39 2024-05-06T14:04:06.355 INFO:tasks.workunit.client.1.smithi174.stdout:3/314: unlink df/d10/f2c 0 2024-05-06T14:04:06.356 INFO:tasks.workunit.client.1.smithi174.stdout:3/315: dread df/d10/d1b/f24 [86016,98304] 0 2024-05-06T14:04:06.356 INFO:tasks.workunit.client.1.smithi174.stdout:1/232: truncate d11/d1f/d27/d2d/f3a 1883386 0 2024-05-06T14:04:06.356 INFO:tasks.workunit.client.1.smithi174.stdout:3/316: creat df/d10/d1b/f65 x:0 0 0 2024-05-06T14:04:06.356 INFO:tasks.workunit.client.1.smithi174.stdout:1/233: write d11/d1f/d27/d32/f50 [929557,108892] 0 2024-05-06T14:04:06.357 INFO:tasks.workunit.client.1.smithi174.stdout:1/234: creat d11/d1f/d27/d32/f59 x:0 0 0 2024-05-06T14:04:06.419 INFO:tasks.workunit.client.1.smithi174.stdout:9/276: dwrite dc/de/f26 [262144,126976] 0 2024-05-06T14:04:06.419 INFO:tasks.workunit.client.1.smithi174.stdout:6/311: dwrite d0/d25/f40 [1191936,8192] 0 2024-05-06T14:04:06.419 INFO:tasks.workunit.client.1.smithi174.stdout:9/277: symlink dc/df/l61 0 2024-05-06T14:04:06.419 INFO:tasks.workunit.client.1.smithi174.stdout:9/278: chown dc/d14/d43/c57 20888611 1 2024-05-06T14:04:06.419 INFO:tasks.workunit.client.1.smithi174.stdout:9/279: write f7 [972489,39814] 0 2024-05-06T14:04:06.419 INFO:tasks.workunit.client.1.smithi174.stdout:8/361: rename d4/de/d24/f43 to d4/d53/f76 0 2024-05-06T14:04:06.420 INFO:tasks.workunit.client.1.smithi174.stdout:9/280: write dc/de/f2e [3004318,81143] 0 2024-05-06T14:04:06.420 INFO:tasks.workunit.client.1.smithi174.stdout:9/281: stat dc 0 2024-05-06T14:04:06.420 INFO:tasks.workunit.client.1.smithi174.stdout:8/362: getdents d4/de/d24 0 2024-05-06T14:04:06.420 INFO:tasks.workunit.client.1.smithi174.stdout:8/363: stat d4/de/d23/d3c 0 2024-05-06T14:04:06.421 INFO:tasks.workunit.client.1.smithi174.stdout:8/364: stat d4/de/c14 0 2024-05-06T14:04:06.421 INFO:tasks.workunit.client.1.smithi174.stdout:8/365: write d4/de/f12 [1008753,102916] 0 2024-05-06T14:04:06.421 INFO:tasks.workunit.client.1.smithi174.stdout:8/366: chown d4/de/d23/f32 997 1 2024-05-06T14:04:06.421 INFO:tasks.workunit.client.1.smithi174.stdout:3/317: link fc df/d2d/d5b/f66 0 2024-05-06T14:04:06.421 INFO:tasks.workunit.client.1.smithi174.stdout:0/184: sync 2024-05-06T14:04:06.421 INFO:tasks.workunit.client.1.smithi174.stdout:4/275: sync 2024-05-06T14:04:06.422 INFO:tasks.workunit.client.1.smithi174.stdout:2/239: sync 2024-05-06T14:04:06.422 INFO:tasks.workunit.client.1.smithi174.stdout:7/243: sync 2024-05-06T14:04:06.422 INFO:tasks.workunit.client.1.smithi174.stdout:3/318: dread - df/d10/d1b/f65 zero size 2024-05-06T14:04:06.422 INFO:tasks.workunit.client.1.smithi174.stdout:4/276: rename d1/d1a/d3c to d1/d1f/d27/d3e/d6e 0 2024-05-06T14:04:06.422 INFO:tasks.workunit.client.1.smithi174.stdout:0/185: creat d0/d1a/d17/d2e/f39 x:0 0 0 2024-05-06T14:04:06.422 INFO:tasks.workunit.client.1.smithi174.stdout:3/319: rename df/l13 to df/d2d/d4e/l67 0 2024-05-06T14:04:06.423 INFO:tasks.workunit.client.1.smithi174.stdout:4/277: creat d1/d48/d5a/d61/f6f x:0 0 0 2024-05-06T14:04:06.423 INFO:tasks.workunit.client.1.smithi174.stdout:7/244: symlink d0/da/d19/d39/l54 0 2024-05-06T14:04:06.423 INFO:tasks.workunit.client.1.smithi174.stdout:3/320: creat df/d2d/d4d/f68 x:0 0 0 2024-05-06T14:04:06.424 INFO:tasks.workunit.client.1.smithi174.stdout:0/186: creat d0/d16/f3a x:0 0 0 2024-05-06T14:04:06.424 INFO:tasks.workunit.client.1.smithi174.stdout:4/278: creat d1/d1f/d27/d3e/f70 x:0 0 0 2024-05-06T14:04:06.424 INFO:tasks.workunit.client.1.smithi174.stdout:4/279: mknod d1/d9/d15/d35/c71 0 2024-05-06T14:04:06.424 INFO:tasks.workunit.client.1.smithi174.stdout:7/245: truncate d0/d1d/f2c 185612 0 2024-05-06T14:04:06.424 INFO:tasks.workunit.client.1.smithi174.stdout:7/246: dread - d0/da/d19/d24/f48 zero size 2024-05-06T14:04:06.424 INFO:tasks.workunit.client.1.smithi174.stdout:7/247: creat d0/d1d/f55 x:0 0 0 2024-05-06T14:04:06.425 INFO:tasks.workunit.client.1.smithi174.stdout:7/248: creat d0/da/d19/d24/d47/f56 x:0 0 0 2024-05-06T14:04:06.425 INFO:tasks.workunit.client.1.smithi174.stdout:0/187: write d0/d4/d8/d25/d32/d38/f28 [353947,122678] 0 2024-05-06T14:04:06.425 INFO:tasks.workunit.client.1.smithi174.stdout:0/188: chown d0 344121 1 2024-05-06T14:04:06.426 INFO:tasks.workunit.client.1.smithi174.stdout:0/189: creat d0/d36/f3b x:0 0 0 2024-05-06T14:04:06.426 INFO:tasks.workunit.client.1.smithi174.stdout:0/190: creat d0/d1a/d17/d2e/f3c x:0 0 0 2024-05-06T14:04:06.426 INFO:tasks.workunit.client.1.smithi174.stdout:0/191: chown d0/d3/c21 201896602 1 2024-05-06T14:04:06.465 INFO:tasks.workunit.client.1.smithi174.stdout:2/240: fdatasync d0/d1/d2/d4/d18/d2d/d32/f38 0 2024-05-06T14:04:06.466 INFO:tasks.workunit.client.1.smithi174.stdout:3/321: fsync df/f28 0 2024-05-06T14:04:06.466 INFO:tasks.workunit.client.1.smithi174.stdout:9/282: fsync dc/d1c/f24 0 2024-05-06T14:04:06.469 INFO:tasks.workunit.client.1.smithi174.stdout:9/283: write dc/df/f34 [1447643,8409] 0 2024-05-06T14:04:06.473 INFO:tasks.workunit.client.1.smithi174.stdout:5/253: sync 2024-05-06T14:04:06.481 INFO:tasks.workunit.client.1.smithi174.stdout:0/192: dwrite d0/d1a/f1b [737280,126976] 0 2024-05-06T14:04:06.481 INFO:tasks.workunit.client.1.smithi174.stdout:6/312: dwrite d0/d25/d52/d2c/f37 [2457600,53248] 0 2024-05-06T14:04:06.481 INFO:tasks.workunit.client.1.smithi174.stdout:5/254: creat d1/d6/df/d35/d3a/db/d1e/f56 x:0 0 0 2024-05-06T14:04:06.482 INFO:tasks.workunit.client.1.smithi174.stdout:4/280: dwrite d1/d9/f20 [573440,102400] 0 2024-05-06T14:04:06.482 INFO:tasks.workunit.client.1.smithi174.stdout:5/255: creat d1/d6/df/d35/d3a/de/f57 x:0 0 0 2024-05-06T14:04:06.482 INFO:tasks.workunit.client.1.smithi174.stdout:5/256: chown d1/d6/d7/f2e 58074 1 2024-05-06T14:04:06.482 INFO:tasks.workunit.client.1.smithi174.stdout:0/193: creat d0/d4/f3d x:0 0 0 2024-05-06T14:04:06.482 INFO:tasks.workunit.client.1.smithi174.stdout:2/241: write d0/d16/f19 [379053,85442] 0 2024-05-06T14:04:06.483 INFO:tasks.workunit.client.1.smithi174.stdout:0/194: rename d0/d16/f20 to d0/d1a/d17/d2e/f3e 0 2024-05-06T14:04:06.483 INFO:tasks.workunit.client.1.smithi174.stdout:2/242: write d0/d1/d2/d2a/f48 [395904,32223] 0 2024-05-06T14:04:06.483 INFO:tasks.workunit.client.1.smithi174.stdout:2/243: link d0/db/c33 d0/d1/d2/d4/d18/c4b 0 2024-05-06T14:04:06.483 INFO:tasks.workunit.client.1.smithi174.stdout:0/195: mkdir d0/d36/d3f 0 2024-05-06T14:04:06.483 INFO:tasks.workunit.client.1.smithi174.stdout:0/196: creat d0/d3/f40 x:0 0 0 2024-05-06T14:04:06.484 INFO:tasks.workunit.client.1.smithi174.stdout:0/197: truncate d0/d3/f40 760286 0 2024-05-06T14:04:06.484 INFO:tasks.workunit.client.1.smithi174.stdout:0/198: dread - d0/d36/f3b zero size 2024-05-06T14:04:06.484 INFO:tasks.workunit.client.1.smithi174.stdout:0/199: creat d0/d1a/f41 x:0 0 0 2024-05-06T14:04:06.484 INFO:tasks.workunit.client.1.smithi174.stdout:0/200: symlink d0/d4/d8/d25/d32/l42 0 2024-05-06T14:04:06.484 INFO:tasks.workunit.client.1.smithi174.stdout:0/201: write d0/d1a/f13 [781133,89261] 0 2024-05-06T14:04:06.484 INFO:tasks.workunit.client.1.smithi174.stdout:0/202: rename d0/d1a/f41 to d0/d4/d8/d25/d32/f43 0 2024-05-06T14:04:06.484 INFO:tasks.workunit.client.1.smithi174.stdout:0/203: truncate d0/d3/f40 1574485 0 2024-05-06T14:04:06.485 INFO:tasks.workunit.client.1.smithi174.stdout:8/367: dread d4/de/f12 [1024000,90112] 0 2024-05-06T14:04:06.485 INFO:tasks.workunit.client.1.smithi174.stdout:8/368: unlink d4/de/f1f 0 2024-05-06T14:04:06.485 INFO:tasks.workunit.client.1.smithi174.stdout:9/284: dwrite dc/df/f4b [40960,49152] 0 2024-05-06T14:04:06.485 INFO:tasks.workunit.client.1.smithi174.stdout:9/285: link dc/d27/f39 dc/de/f62 0 2024-05-06T14:04:06.485 INFO:tasks.workunit.client.1.smithi174.stdout:9/286: mkdir dc/d27/d63 0 2024-05-06T14:04:06.486 INFO:tasks.workunit.client.1.smithi174.stdout:9/287: rmdir dc/d14 39 2024-05-06T14:04:06.486 INFO:tasks.workunit.client.1.smithi174.stdout:9/288: mknod dc/d17/c64 0 2024-05-06T14:04:06.486 INFO:tasks.workunit.client.1.smithi174.stdout:9/289: write dc/df/f34 [925448,4615] 0 2024-05-06T14:04:06.486 INFO:tasks.workunit.client.1.smithi174.stdout:9/290: write dc/df/f34 [1107066,47991] 0 2024-05-06T14:04:06.486 INFO:tasks.workunit.client.1.smithi174.stdout:9/291: creat dc/d27/d51/f65 x:0 0 0 2024-05-06T14:04:06.487 INFO:tasks.workunit.client.1.smithi174.stdout:9/292: read dc/d17/f50 [1085855,53456] 0 2024-05-06T14:04:06.487 INFO:tasks.workunit.client.1.smithi174.stdout:9/293: write dc/d14/f1e [1531618,37289] 0 2024-05-06T14:04:06.487 INFO:tasks.workunit.client.1.smithi174.stdout:9/294: readlink dc/df/l2c 0 2024-05-06T14:04:06.487 INFO:tasks.workunit.client.1.smithi174.stdout:9/295: mknod dc/d27/c66 0 2024-05-06T14:04:06.582 INFO:tasks.workunit.client.1.smithi174.stdout:2/244: dwrite d0/d1/d2/f17 [1798144,45056] 0 2024-05-06T14:04:06.582 INFO:tasks.workunit.client.1.smithi174.stdout:2/245: creat d0/d1/d2/d1b/f4c x:0 0 0 2024-05-06T14:04:06.582 INFO:tasks.workunit.client.1.smithi174.stdout:2/246: dread - d0/d1/d2/d4/d6/f44 zero size 2024-05-06T14:04:06.584 INFO:tasks.workunit.client.1.smithi174.stdout:3/322: dwrite df/f28 [360448,110592] 0 2024-05-06T14:04:06.584 INFO:tasks.workunit.client.1.smithi174.stdout:4/281: dwrite d1/f19 [802816,77824] 0 2024-05-06T14:04:06.584 INFO:tasks.workunit.client.1.smithi174.stdout:4/282: getdents d1/d48/d5a/d61 0 2024-05-06T14:04:06.584 INFO:tasks.workunit.client.1.smithi174.stdout:4/283: write d1/d1a/f66 [239940,86317] 0 2024-05-06T14:04:06.584 INFO:tasks.workunit.client.1.smithi174.stdout:8/369: dread d4/d15/f73 [737280,86016] 0 2024-05-06T14:04:06.584 INFO:tasks.workunit.client.1.smithi174.stdout:4/284: write d1/d2e/f39 [615761,957] 0 2024-05-06T14:04:06.585 INFO:tasks.workunit.client.1.smithi174.stdout:4/285: read d1/d9/f16 [336848,126612] 0 2024-05-06T14:04:06.585 INFO:tasks.workunit.client.1.smithi174.stdout:4/286: dread d1/d48/d5a/d61/f63 [638976,106496] 0 2024-05-06T14:04:06.585 INFO:tasks.workunit.client.1.smithi174.stdout:4/287: chown d1/d1a/f1c 5 1 2024-05-06T14:04:06.585 INFO:tasks.workunit.client.1.smithi174.stdout:4/288: symlink d1/d1a/l72 0 2024-05-06T14:04:06.585 INFO:tasks.workunit.client.1.smithi174.stdout:4/289: symlink d1/d9/d15/l73 0 2024-05-06T14:04:06.585 INFO:tasks.workunit.client.1.smithi174.stdout:4/290: chown d1/d1f/d27/d2c/c43 821426 1 2024-05-06T14:04:06.667 INFO:tasks.workunit.client.1.smithi174.stdout:9/296: fdatasync dc/de/f62 0 2024-05-06T14:04:06.668 INFO:tasks.workunit.client.1.smithi174.stdout:6/313: fdatasync d0/d25/f30 0 2024-05-06T14:04:06.668 INFO:tasks.workunit.client.1.smithi174.stdout:1/235: fdatasync f5 0 2024-05-06T14:04:06.668 INFO:tasks.workunit.client.1.smithi174.stdout:7/249: fdatasync d0/d1d/f2c 0 2024-05-06T14:04:06.668 INFO:tasks.workunit.client.1.smithi174.stdout:9/297: write dc/d17/f50 [728662,83095] 0 2024-05-06T14:04:06.668 INFO:tasks.workunit.client.1.smithi174.stdout:1/236: dread - d11/f2c zero size 2024-05-06T14:04:06.668 INFO:tasks.workunit.client.1.smithi174.stdout:7/250: chown d0/da/d19/d35 33111255 1 2024-05-06T14:04:06.668 INFO:tasks.workunit.client.1.smithi174.stdout:1/237: dread - d11/d41/d4a/f56 zero size 2024-05-06T14:04:06.668 INFO:tasks.workunit.client.1.smithi174.stdout:6/314: write d0/df/f1f [517999,118844] 0 2024-05-06T14:04:06.669 INFO:tasks.workunit.client.1.smithi174.stdout:7/251: link d0/d1d/f55 d0/da/d19/d39/d46/f57 0 2024-05-06T14:04:06.669 INFO:tasks.workunit.client.1.smithi174.stdout:6/315: rename d0/d25/d52/l32 to d0/d25/l67 0 2024-05-06T14:04:06.669 INFO:tasks.workunit.client.1.smithi174.stdout:7/252: rename d0/d1d/f55 to d0/da/d19/d39/d46/f58 0 2024-05-06T14:04:06.669 INFO:tasks.workunit.client.1.smithi174.stdout:8/370: fdatasync d4/f35 0 2024-05-06T14:04:06.669 INFO:tasks.workunit.client.1.smithi174.stdout:4/291: fdatasync d1/d9/d15/f21 0 2024-05-06T14:04:06.688 INFO:tasks.workunit.client.1.smithi174.stdout:1/238: fsync d11/d1f/d27/d32/f59 0 2024-05-06T14:04:06.688 INFO:tasks.workunit.client.1.smithi174.stdout:6/316: fsync d0/d25/d35/f4d 0 2024-05-06T14:04:06.688 INFO:tasks.workunit.client.1.smithi174.stdout:0/204: fdatasync d0/d16/f3a 0 2024-05-06T14:04:06.688 INFO:tasks.workunit.client.1.smithi174.stdout:6/317: chown d0/d48/c5a 4 1 2024-05-06T14:04:06.689 INFO:tasks.workunit.client.1.smithi174.stdout:9/298: dread dc/de/f62 [1458176,81920] 0 2024-05-06T14:04:06.690 INFO:tasks.workunit.client.1.smithi174.stdout:2/247: dwrite d0/db/d15/f4a [434176,8192] 0 2024-05-06T14:04:06.690 INFO:tasks.workunit.client.1.smithi174.stdout:9/299: mknod dc/d27/c67 0 2024-05-06T14:04:06.690 INFO:tasks.workunit.client.1.smithi174.stdout:0/205: write d0/d1a/f30 [142254,14154] 0 2024-05-06T14:04:06.690 INFO:tasks.workunit.client.1.smithi174.stdout:9/300: getdents dc/d14 0 2024-05-06T14:04:06.691 INFO:tasks.workunit.client.1.smithi174.stdout:2/248: symlink d0/d1/d2/l4d 0 2024-05-06T14:04:06.691 INFO:tasks.workunit.client.1.smithi174.stdout:9/301: creat dc/de/f68 x:0 0 0 2024-05-06T14:04:06.691 INFO:tasks.workunit.client.1.smithi174.stdout:0/206: mkdir d0/d3/dc/d44 0 2024-05-06T14:04:06.691 INFO:tasks.workunit.client.1.smithi174.stdout:4/292: getdents d1/d48/d5a 0 2024-05-06T14:04:06.691 INFO:tasks.workunit.client.1.smithi174.stdout:4/293: stat d1/d48/f58 0 2024-05-06T14:04:06.691 INFO:tasks.workunit.client.1.smithi174.stdout:0/207: dread d0/d4/d8/d25/d32/f35 [69632,45056] 0 2024-05-06T14:04:06.691 INFO:tasks.workunit.client.1.smithi174.stdout:0/208: rename d0/d34 to d0/d36/d45 0 2024-05-06T14:04:06.691 INFO:tasks.workunit.client.1.smithi174.stdout:8/371: truncate d4/d15/f30 506459 0 2024-05-06T14:04:06.691 INFO:tasks.workunit.client.1.smithi174.stdout:8/372: chown d4/d15/d20/f44 3 1 2024-05-06T14:04:06.692 INFO:tasks.workunit.client.1.smithi174.stdout:8/373: rmdir d4/d15 39 2024-05-06T14:04:06.692 INFO:tasks.workunit.client.1.smithi174.stdout:8/374: truncate d4/d15/d20/d3e/f62 641657 0 2024-05-06T14:04:06.703 INFO:tasks.workunit.client.1.smithi174.stdout:1/239: dwrite d11/d1f/d27/d2d/f31 [1134592,106496] 0 2024-05-06T14:04:06.703 INFO:tasks.workunit.client.1.smithi174.stdout:1/240: chown d11/c3b 2963 1 2024-05-06T14:04:06.704 INFO:tasks.workunit.client.1.smithi174.stdout:8/375: rename d4/l47 to d4/d53/l77 0 2024-05-06T14:04:06.704 INFO:tasks.workunit.client.1.smithi174.stdout:8/376: unlink d4/de/d23/d3c/c3d 0 2024-05-06T14:04:06.704 INFO:tasks.workunit.client.1.smithi174.stdout:8/377: truncate d4/d15/d20/f42 1185924 0 2024-05-06T14:04:06.704 INFO:tasks.workunit.client.1.smithi174.stdout:8/378: readlink d4/d15/l18 0 2024-05-06T14:04:06.704 INFO:tasks.workunit.client.1.smithi174.stdout:2/249: write d0/d1/f35 [577056,89616] 0 2024-05-06T14:04:06.704 INFO:tasks.workunit.client.1.smithi174.stdout:2/250: creat d0/db/d15/f4e x:0 0 0 2024-05-06T14:04:06.705 INFO:tasks.workunit.client.1.smithi174.stdout:2/251: getdents d0/d1/d2/d4/d18/d2d 0 2024-05-06T14:04:06.705 INFO:tasks.workunit.client.1.smithi174.stdout:2/252: unlink d0/c2c 0 2024-05-06T14:04:06.705 INFO:tasks.workunit.client.1.smithi174.stdout:2/253: chown d0/db/d15/f4a 2925211 1 2024-05-06T14:04:06.706 INFO:tasks.workunit.client.1.smithi174.stdout:0/209: dwrite d0/d1a/f1e [827392,16384] 0 2024-05-06T14:04:06.706 INFO:tasks.workunit.client.1.smithi174.stdout:0/210: link d0/d4/f3d d0/d3/dc/d44/f46 0 2024-05-06T14:04:06.706 INFO:tasks.workunit.client.1.smithi174.stdout:0/211: creat d0/d4/d8/f47 x:0 0 0 2024-05-06T14:04:06.706 INFO:tasks.workunit.client.1.smithi174.stdout:6/318: dwrite d0/df/f24 [3272704,98304] 0 2024-05-06T14:04:06.706 INFO:tasks.workunit.client.1.smithi174.stdout:0/212: symlink d0/d4/d8/d25/l48 0 2024-05-06T14:04:06.707 INFO:tasks.workunit.client.1.smithi174.stdout:6/319: stat d0/df/l3e 0 2024-05-06T14:04:06.707 INFO:tasks.workunit.client.1.smithi174.stdout:0/213: symlink d0/d4/d8/l49 0 2024-05-06T14:04:06.707 INFO:tasks.workunit.client.1.smithi174.stdout:6/320: symlink d0/df/d45/l68 0 2024-05-06T14:04:06.707 INFO:tasks.workunit.client.1.smithi174.stdout:6/321: chown d0/df/d3c/c43 241 1 2024-05-06T14:04:06.707 INFO:tasks.workunit.client.1.smithi174.stdout:8/379: dwrite d4/d48/f5c [1404928,94208] 0 2024-05-06T14:04:06.707 INFO:tasks.workunit.client.1.smithi174.stdout:8/380: creat d4/de/d23/f78 x:0 0 0 2024-05-06T14:04:06.707 INFO:tasks.workunit.client.1.smithi174.stdout:8/381: mkdir d4/d15/d20/d3e/d79 0 2024-05-06T14:04:06.707 INFO:tasks.workunit.client.1.smithi174.stdout:8/382: write d4/de/f13 [522952,118538] 0 2024-05-06T14:04:06.769 INFO:tasks.workunit.client.1.smithi174.stdout:9/302: fsync dc/f30 0 2024-05-06T14:04:06.769 INFO:tasks.workunit.client.1.smithi174.stdout:9/303: creat dc/d27/d60/f69 x:0 0 0 2024-05-06T14:04:06.769 INFO:tasks.workunit.client.1.smithi174.stdout:2/254: dread d0/d1/d2/d2a/f48 [409600,20480] 0 2024-05-06T14:04:06.770 INFO:tasks.workunit.client.1.smithi174.stdout:2/255: mknod d0/d24/c4f 0 2024-05-06T14:04:06.771 INFO:tasks.workunit.client.1.smithi174.stdout:0/214: dwrite d0/d1a/d17/fe [221184,90112] 0 2024-05-06T14:04:06.771 INFO:tasks.workunit.client.1.smithi174.stdout:0/215: chown d0/d3/dc/c1d 43845 1 2024-05-06T14:04:06.771 INFO:tasks.workunit.client.1.smithi174.stdout:0/216: mkdir d0/d3/dc/d4a 0 2024-05-06T14:04:06.771 INFO:tasks.workunit.client.1.smithi174.stdout:0/217: readlink d0/d4/d8/l49 0 2024-05-06T14:04:06.771 INFO:tasks.workunit.client.1.smithi174.stdout:0/218: symlink d0/d36/d3f/l4b 0 2024-05-06T14:04:06.771 INFO:tasks.workunit.client.1.smithi174.stdout:0/219: creat d0/d3/dc/f4c x:0 0 0 2024-05-06T14:04:06.772 INFO:tasks.workunit.client.1.smithi174.stdout:0/220: readlink d0/d36/d3f/l4b 0 2024-05-06T14:04:06.772 INFO:tasks.workunit.client.1.smithi174.stdout:0/221: creat d0/d36/d45/f4d x:0 0 0 2024-05-06T14:04:06.781 INFO:tasks.workunit.client.1.smithi174.stdout:6/322: fdatasync d0/df/d45/d4b/f5c 0 2024-05-06T14:04:06.781 INFO:tasks.workunit.client.1.smithi174.stdout:6/323: chown d0/d25/d52/l4a 87 1 2024-05-06T14:04:06.781 INFO:tasks.workunit.client.1.smithi174.stdout:6/324: creat d0/d25/d52/d2c/f69 x:0 0 0 2024-05-06T14:04:06.781 INFO:tasks.workunit.client.1.smithi174.stdout:6/325: creat d0/d25/d52/d2c/f6a x:0 0 0 2024-05-06T14:04:06.781 INFO:tasks.workunit.client.1.smithi174.stdout:6/326: chown d0/d25/d52/l4a 9 1 2024-05-06T14:04:06.781 INFO:tasks.workunit.client.1.smithi174.stdout:6/327: dread d0/df/f20 [987136,94208] 0 2024-05-06T14:04:06.783 INFO:tasks.workunit.client.1.smithi174.stdout:2/256: dwrite d0/d24/f27 [1388544,12288] 0 2024-05-06T14:04:06.783 INFO:tasks.workunit.client.1.smithi174.stdout:2/257: creat d0/d24/f50 x:0 0 0 2024-05-06T14:04:06.783 INFO:tasks.workunit.client.1.smithi174.stdout:2/258: mkdir d0/d1/d2/d4/d51 0 2024-05-06T14:04:06.783 INFO:tasks.workunit.client.1.smithi174.stdout:2/259: write d0/da/f1d [310014,99213] 0 2024-05-06T14:04:06.784 INFO:tasks.workunit.client.1.smithi174.stdout:9/304: dwrite dc/f30 [1712128,69632] 0 2024-05-06T14:04:06.784 INFO:tasks.workunit.client.1.smithi174.stdout:2/260: rmdir d0/d1/d2 39 2024-05-06T14:04:06.784 INFO:tasks.workunit.client.1.smithi174.stdout:2/261: rename d0/d1/l9 to d0/d1/d2/d2a/l52 0 2024-05-06T14:04:06.784 INFO:tasks.workunit.client.1.smithi174.stdout:9/305: creat dc/d27/d60/f6a x:0 0 0 2024-05-06T14:04:06.784 INFO:tasks.workunit.client.1.smithi174.stdout:9/306: chown dc/d17/c64 54846 1 2024-05-06T14:04:06.784 INFO:tasks.workunit.client.1.smithi174.stdout:2/262: read d0/db/d15/f2e [305928,13823] 0 2024-05-06T14:04:06.784 INFO:tasks.workunit.client.1.smithi174.stdout:9/307: read dc/df/f11 [175653,115980] 0 2024-05-06T14:04:06.784 INFO:tasks.workunit.client.1.smithi174.stdout:6/328: dwrite d0/d25/f51 [872448,61440] 0 2024-05-06T14:04:06.856 INFO:tasks.workunit.client.1.smithi174.stdout:0/222: fsync d0/d3/f40 0 2024-05-06T14:04:06.857 INFO:tasks.workunit.client.1.smithi174.stdout:2/263: dwrite d0/d1/d2/d4/d18/d2d/d32/f47 [73728,114688] 0 2024-05-06T14:04:06.857 INFO:tasks.workunit.client.1.smithi174.stdout:2/264: write d0/d1/d2/d4/d18/d2d/d32/f47 [657217,113420] 0 2024-05-06T14:04:06.859 INFO:tasks.workunit.client.1.smithi174.stdout:5/257: sync 2024-05-06T14:04:06.861 INFO:tasks.workunit.client.1.smithi174.stdout:5/258: readlink d1/d6/df/d35/d3a/de/l4f 0 2024-05-06T14:04:06.861 INFO:tasks.workunit.client.1.smithi174.stdout:2/265: unlink d0/db/d15/f29 0 2024-05-06T14:04:06.861 INFO:tasks.workunit.client.1.smithi174.stdout:6/329: readlink d0/d25/l67 0 2024-05-06T14:04:06.861 INFO:tasks.workunit.client.1.smithi174.stdout:0/223: getdents d0/d1a 0 2024-05-06T14:04:06.861 INFO:tasks.workunit.client.1.smithi174.stdout:2/266: rmdir d0/da 39 2024-05-06T14:04:06.862 INFO:tasks.workunit.client.1.smithi174.stdout:5/259: truncate d1/d6/f18 1483627 0 2024-05-06T14:04:06.862 INFO:tasks.workunit.client.1.smithi174.stdout:2/267: unlink d0/d1/d2/f20 0 2024-05-06T14:04:06.862 INFO:tasks.workunit.client.1.smithi174.stdout:6/330: creat d0/df/d45/d4b/f6b x:0 0 0 2024-05-06T14:04:06.862 INFO:tasks.workunit.client.1.smithi174.stdout:2/268: truncate d0/d1/d2/f17 1001474 0 2024-05-06T14:04:06.862 INFO:tasks.workunit.client.1.smithi174.stdout:2/269: chown d0/d24/f27 1 1 2024-05-06T14:04:06.862 INFO:tasks.workunit.client.1.smithi174.stdout:2/270: getdents d0/d1/d2/d4/d18 0 2024-05-06T14:04:06.862 INFO:tasks.workunit.client.1.smithi174.stdout:0/224: write d0/d1a/d17/fe [688495,40080] 0 2024-05-06T14:04:06.862 INFO:tasks.workunit.client.1.smithi174.stdout:0/225: stat d0/d3/f40 0 2024-05-06T14:04:06.863 INFO:tasks.workunit.client.1.smithi174.stdout:6/331: write d0/df/d45/d4b/f5c [440278,57966] 0 2024-05-06T14:04:06.929 INFO:tasks.workunit.client.1.smithi174.stdout:9/308: dwrite dc/df/f34 [1728512,110592] 0 2024-05-06T14:04:06.931 INFO:tasks.workunit.client.1.smithi174.stdout:6/332: dwrite d0/f26 [294912,12288] 0 2024-05-06T14:04:06.932 INFO:tasks.workunit.client.1.smithi174.stdout:6/333: symlink d0/d25/d52/d2c/l6c 0 2024-05-06T14:04:06.932 INFO:tasks.workunit.client.1.smithi174.stdout:2/271: dread d0/d24/f27 [1146880,90112] 0 2024-05-06T14:04:06.932 INFO:tasks.workunit.client.1.smithi174.stdout:2/272: getdents d0/d40 0 2024-05-06T14:04:06.971 INFO:tasks.workunit.client.1.smithi174.stdout:5/260: fdatasync d1/d6/df/f30 0 2024-05-06T14:04:06.972 INFO:tasks.workunit.client.1.smithi174.stdout:0/226: fdatasync d0/fa 0 2024-05-06T14:04:06.979 INFO:tasks.workunit.client.1.smithi174.stdout:5/261: fdatasync d1/d6/df/d35/d3a/f25 0 2024-05-06T14:04:06.980 INFO:tasks.workunit.client.1.smithi174.stdout:0/227: fdatasync d0/d1a/f1e 0 2024-05-06T14:04:06.984 INFO:tasks.workunit.client.1.smithi174.stdout:5/262: truncate d1/d6/df/d35/d3a/f33 206888 0 2024-05-06T14:04:06.984 INFO:tasks.workunit.client.1.smithi174.stdout:2/273: dwrite d0/d1/f35 [1167360,126976] 0 2024-05-06T14:04:06.987 INFO:tasks.workunit.client.1.smithi174.stdout:5/263: link d1/d6/df/f30 d1/d6/df/d35/d3a/f58 0 2024-05-06T14:04:06.987 INFO:tasks.workunit.client.1.smithi174.stdout:5/264: write d1/d6/df/d35/d3a/de/f26 [872332,76604] 0 2024-05-06T14:04:06.987 INFO:tasks.workunit.client.1.smithi174.stdout:5/265: read d1/d6/f18 [920229,121660] 0 2024-05-06T14:04:06.987 INFO:tasks.workunit.client.1.smithi174.stdout:5/266: mkdir d1/d6/d7/d36/d53/d59 0 2024-05-06T14:04:06.988 INFO:tasks.workunit.client.1.smithi174.stdout:5/267: dread d1/d6/df/d35/d3a/db/f1d [172032,73728] 0 2024-05-06T14:04:06.988 INFO:tasks.workunit.client.1.smithi174.stdout:5/268: dread d1/d6/f9 [876544,61440] 0 2024-05-06T14:04:06.988 INFO:tasks.workunit.client.1.smithi174.stdout:5/269: link d1/d6/df/l20 d1/d6/df/d35/l5a 0 2024-05-06T14:04:06.988 INFO:tasks.workunit.client.1.smithi174.stdout:5/270: creat d1/d6/d7/d3e/f5b x:0 0 0 2024-05-06T14:04:06.988 INFO:tasks.workunit.client.1.smithi174.stdout:0/228: dwrite d0/d1a/d17/fe [1318912,32768] 0 2024-05-06T14:04:06.988 INFO:tasks.workunit.client.1.smithi174.stdout:0/229: dread - d0/d16/f3a zero size 2024-05-06T14:04:06.988 INFO:tasks.workunit.client.1.smithi174.stdout:0/230: unlink d0/d1a/f13 0 2024-05-06T14:04:06.988 INFO:tasks.workunit.client.1.smithi174.stdout:2/274: dwrite d0/d1/d2/d4/d18/d2d/d32/f38 [1372160,118784] 0 2024-05-06T14:04:06.989 INFO:tasks.workunit.client.1.smithi174.stdout:2/275: creat d0/d1/d2/d4/d18/d2d/d32/f53 x:0 0 0 2024-05-06T14:04:06.989 INFO:tasks.workunit.client.1.smithi174.stdout:2/276: unlink d0/d24/f27 0 2024-05-06T14:04:06.989 INFO:tasks.workunit.client.1.smithi174.stdout:5/271: dwrite d1/d6/df/d35/d3a/fd [3706880,32768] 0 2024-05-06T14:04:06.989 INFO:tasks.workunit.client.1.smithi174.stdout:2/277: rmdir d0/d1/d2/d4/d6/d3c 39 2024-05-06T14:04:06.989 INFO:tasks.workunit.client.1.smithi174.stdout:2/278: creat d0/d1/d2/f54 x:0 0 0 2024-05-06T14:04:06.989 INFO:tasks.workunit.client.1.smithi174.stdout:2/279: getdents d0/d1/d2/d4/d6/d3c 0 2024-05-06T14:04:06.989 INFO:tasks.workunit.client.1.smithi174.stdout:5/272: creat d1/d6/df/d35/d3a/f5c x:0 0 0 2024-05-06T14:04:06.989 INFO:tasks.workunit.client.1.smithi174.stdout:2/280: read d0/da/f1d [970649,75128] 0 2024-05-06T14:04:06.989 INFO:tasks.workunit.client.1.smithi174.stdout:2/281: write d0/d1/d2/f17 [191837,9722] 0 2024-05-06T14:04:06.990 INFO:tasks.workunit.client.1.smithi174.stdout:2/282: stat d0/d1/d2/d4/f22 0 2024-05-06T14:04:06.990 INFO:tasks.workunit.client.1.smithi174.stdout:5/273: write d1/d6/df/d35/d3a/de/f57 [190730,31393] 0 2024-05-06T14:04:06.990 INFO:tasks.workunit.client.1.smithi174.stdout:5/274: creat d1/d6/df/d35/d3a/de/f5d x:0 0 0 2024-05-06T14:04:06.990 INFO:tasks.workunit.client.1.smithi174.stdout:5/275: rename d1/d6/df/d35/d3a/f58 to d1/d6/df/d35/d3a/db/f5e 0 2024-05-06T14:04:06.990 INFO:tasks.workunit.client.1.smithi174.stdout:5/276: rename d1/d6/df/d35/d3a/db/f5e to d1/d6/df/d35/d3a/db/f5f 0 2024-05-06T14:04:06.990 INFO:tasks.workunit.client.1.smithi174.stdout:5/277: mkdir d1/d6/df/d35/d3a/db/d60 0 2024-05-06T14:04:06.990 INFO:tasks.workunit.client.1.smithi174.stdout:5/278: mkdir d1/d6/d7/d36/d53/d59/d61 0 2024-05-06T14:04:06.990 INFO:tasks.workunit.client.1.smithi174.stdout:5/279: symlink d1/d6/d7/d3e/l62 0 2024-05-06T14:04:07.046 INFO:tasks.workunit.client.1.smithi174.stdout:3/323: sync 2024-05-06T14:04:07.047 INFO:tasks.workunit.client.1.smithi174.stdout:3/324: truncate df/d10/f19 463597 0 2024-05-06T14:04:07.047 INFO:tasks.workunit.client.1.smithi174.stdout:3/325: creat df/d2d/d4b/d5a/f69 x:0 0 0 2024-05-06T14:04:07.047 INFO:tasks.workunit.client.1.smithi174.stdout:0/231: dwrite d0/d16/f3a [401408,53248] 0 2024-05-06T14:04:07.047 INFO:tasks.workunit.client.1.smithi174.stdout:0/232: rename d0/d4/d8/cd to d0/d3/dc/c4e 0 2024-05-06T14:04:07.047 INFO:tasks.workunit.client.1.smithi174.stdout:0/233: mknod d0/d16/c4f 0 2024-05-06T14:04:07.047 INFO:tasks.workunit.client.1.smithi174.stdout:5/280: dwrite d1/d6/f54 [266240,61440] 0 2024-05-06T14:04:07.047 INFO:tasks.workunit.client.1.smithi174.stdout:3/326: write df/f28 [966825,130557] 0 2024-05-06T14:04:07.048 INFO:tasks.workunit.client.1.smithi174.stdout:5/281: write d1/d6/df/d35/f3d [905368,9726] 0 2024-05-06T14:04:07.048 INFO:tasks.workunit.client.1.smithi174.stdout:3/327: write df/d2d/f37 [2321087,41018] 0 2024-05-06T14:04:07.048 INFO:tasks.workunit.client.1.smithi174.stdout:3/328: chown df/d2d/d4b/l62 1743222393 1 2024-05-06T14:04:07.048 INFO:tasks.workunit.client.1.smithi174.stdout:5/282: dread d1/d6/df/d35/d3a/f33 [90112,32768] 0 2024-05-06T14:04:07.048 INFO:tasks.workunit.client.1.smithi174.stdout:0/234: write d0/d3/f40 [639455,99067] 0 2024-05-06T14:04:07.048 INFO:tasks.workunit.client.1.smithi174.stdout:0/235: dread - d0/d4/d8/d25/d32/f43 zero size 2024-05-06T14:04:07.048 INFO:tasks.workunit.client.1.smithi174.stdout:5/283: write d1/d6/df/d35/d3a/f33 [929119,13487] 0 2024-05-06T14:04:07.048 INFO:tasks.workunit.client.1.smithi174.stdout:5/284: creat d1/d6/df/d35/d3a/de/f63 x:0 0 0 2024-05-06T14:04:07.048 INFO:tasks.workunit.client.1.smithi174.stdout:0/236: symlink d0/d3/dc/d44/l50 0 2024-05-06T14:04:07.049 INFO:tasks.workunit.client.1.smithi174.stdout:5/285: getdents d1/d6/d7/d36/d53/d59 0 2024-05-06T14:04:07.049 INFO:tasks.workunit.client.1.smithi174.stdout:0/237: creat d0/f51 x:0 0 0 2024-05-06T14:04:07.049 INFO:tasks.workunit.client.1.smithi174.stdout:2/283: dwrite d0/db/d15/f4e [557056,102400] 0 2024-05-06T14:04:07.086 INFO:tasks.workunit.client.1.smithi174.stdout:3/329: fdatasync fc 0 2024-05-06T14:04:07.086 INFO:tasks.workunit.client.1.smithi174.stdout:5/286: fsync d1/d6/df/d35/d3a/db/d1e/f56 0 2024-05-06T14:04:07.087 INFO:tasks.workunit.client.1.smithi174.stdout:0/238: fsync d0/d4/d8/d25/d32/f43 0 2024-05-06T14:04:07.087 INFO:tasks.workunit.client.1.smithi174.stdout:3/330: getdents df/d10/d1b/d59 0 2024-05-06T14:04:07.087 INFO:tasks.workunit.client.1.smithi174.stdout:5/287: chown d1/d6/df/f30 289 1 2024-05-06T14:04:07.087 INFO:tasks.workunit.client.1.smithi174.stdout:5/288: stat d1/d6/d7/d36/d53/d59/d61 0 2024-05-06T14:04:07.087 INFO:tasks.workunit.client.1.smithi174.stdout:0/239: chown d0/d4/d8/d25/d32/l42 4649 1 2024-05-06T14:04:07.087 INFO:tasks.workunit.client.1.smithi174.stdout:5/289: dread - d1/d6/df/d35/d3a/de/f63 zero size 2024-05-06T14:04:07.088 INFO:tasks.workunit.client.1.smithi174.stdout:2/284: fdatasync d0/d16/f19 0 2024-05-06T14:04:07.090 INFO:tasks.workunit.client.1.smithi174.stdout:3/331: rename df/d10/f3b to df/d2d/d4b/d5a/f6a 0 2024-05-06T14:04:07.094 INFO:tasks.workunit.client.1.smithi174.stdout:6/334: sync 2024-05-06T14:04:07.094 INFO:tasks.workunit.client.1.smithi174.stdout:7/253: sync 2024-05-06T14:04:07.094 INFO:tasks.workunit.client.1.smithi174.stdout:9/309: sync 2024-05-06T14:04:07.094 INFO:tasks.workunit.client.1.smithi174.stdout:8/383: sync 2024-05-06T14:04:07.094 INFO:tasks.workunit.client.1.smithi174.stdout:1/241: sync 2024-05-06T14:04:07.095 INFO:tasks.workunit.client.1.smithi174.stdout:4/294: sync 2024-05-06T14:04:07.095 INFO:tasks.workunit.client.1.smithi174.stdout:9/310: chown dc/d14/f1e 843 1 2024-05-06T14:04:07.095 INFO:tasks.workunit.client.1.smithi174.stdout:7/254: unlink d0/f5 0 2024-05-06T14:04:07.095 INFO:tasks.workunit.client.1.smithi174.stdout:7/255: rename d0/da/d19/d35 to d0/da/d28/d59 0 2024-05-06T14:04:07.095 INFO:tasks.workunit.client.1.smithi174.stdout:8/384: symlink d4/d15/l7a 0 2024-05-06T14:04:07.095 INFO:tasks.workunit.client.1.smithi174.stdout:1/242: creat d11/f5a x:0 0 0 2024-05-06T14:04:07.095 INFO:tasks.workunit.client.1.smithi174.stdout:1/243: symlink d11/d41/d51/l5b 0 2024-05-06T14:04:07.095 INFO:tasks.workunit.client.1.smithi174.stdout:7/256: symlink d0/da/d19/d39/d46/l5a 0 2024-05-06T14:04:07.095 INFO:tasks.workunit.client.1.smithi174.stdout:7/257: chown d0/da/d19/d24/d14/l1f 0 1 2024-05-06T14:04:07.096 INFO:tasks.workunit.client.1.smithi174.stdout:7/258: rmdir d0/da/d19/d24/d47 39 2024-05-06T14:04:07.096 INFO:tasks.workunit.client.1.smithi174.stdout:7/259: dread - d0/da/d19/d39/d46/f58 zero size 2024-05-06T14:04:07.096 INFO:tasks.workunit.client.1.smithi174.stdout:7/260: creat d0/da/d19/f5b x:0 0 0 2024-05-06T14:04:07.096 INFO:tasks.workunit.client.1.smithi174.stdout:7/261: dread d0/da/d19/d24/d14/f33 [737280,65536] 0 2024-05-06T14:04:07.096 INFO:tasks.workunit.client.1.smithi174.stdout:7/262: unlink d0/da/d19/c29 0 2024-05-06T14:04:07.193 INFO:tasks.workunit.client.1.smithi174.stdout:4/295: dwrite d1/d1f/d27/d3e/d6e/f55 [8192,122880] 0 2024-05-06T14:04:07.193 INFO:tasks.workunit.client.1.smithi174.stdout:8/385: dwrite d4/de/d24/d46/d63/f6f [139264,53248] 0 2024-05-06T14:04:07.193 INFO:tasks.workunit.client.1.smithi174.stdout:8/386: truncate d4/d15/f4d 530757 0 2024-05-06T14:04:07.193 INFO:tasks.workunit.client.1.smithi174.stdout:8/387: stat d4/de/f19 0 2024-05-06T14:04:07.193 INFO:tasks.workunit.client.1.smithi174.stdout:9/311: dwrite dc/d1c/f38 [610304,49152] 0 2024-05-06T14:04:07.193 INFO:tasks.workunit.client.1.smithi174.stdout:9/312: dread - dc/f42 zero size 2024-05-06T14:04:07.194 INFO:tasks.workunit.client.1.smithi174.stdout:9/313: mkdir dc/de/d6b 0 2024-05-06T14:04:07.194 INFO:tasks.workunit.client.1.smithi174.stdout:7/263: dwrite d0/da/d19/d39/d46/f58 [593920,53248] 0 2024-05-06T14:04:07.250 INFO:tasks.workunit.client.1.smithi174.stdout:6/335: fsync d0/f15 0 2024-05-06T14:04:07.251 INFO:tasks.workunit.client.1.smithi174.stdout:1/244: fsync d11/d1f/d27/f2b 0 2024-05-06T14:04:07.251 INFO:tasks.workunit.client.1.smithi174.stdout:6/336: truncate d0/f26 1307329 0 2024-05-06T14:04:07.251 INFO:tasks.workunit.client.1.smithi174.stdout:1/245: rename d11/d1f/d27/d2d/f47 to d11/d41/f5c 0 2024-05-06T14:04:07.251 INFO:tasks.workunit.client.1.smithi174.stdout:5/290: fdatasync d1/d6/d2a/f2d 0 2024-05-06T14:04:07.251 INFO:tasks.workunit.client.1.smithi174.stdout:6/337: dread d0/d25/f51 [245760,77824] 0 2024-05-06T14:04:07.251 INFO:tasks.workunit.client.1.smithi174.stdout:1/246: link d11/d1f/d27/f2b d11/d1f/d27/f5d 0 2024-05-06T14:04:07.251 INFO:tasks.workunit.client.1.smithi174.stdout:6/338: dread - d0/df/d45/d4b/f6b zero size 2024-05-06T14:04:07.252 INFO:tasks.workunit.client.1.smithi174.stdout:6/339: chown d0/d25/d52/d2c/c60 1557665 1 2024-05-06T14:04:07.252 INFO:tasks.workunit.client.1.smithi174.stdout:5/291: dread d1/d6/df/d35/d3a/db/f1d [155648,45056] 0 2024-05-06T14:04:07.252 INFO:tasks.workunit.client.1.smithi174.stdout:7/264: dwrite d0/da/d28/d59/f3f [581632,20480] 0 2024-05-06T14:04:07.276 INFO:tasks.workunit.client.1.smithi174.stdout:6/340: fsync d0/df/f14 0 2024-05-06T14:04:07.277 INFO:tasks.workunit.client.1.smithi174.stdout:6/341: dread - d0/d25/d52/d2c/f6a zero size 2024-05-06T14:04:07.277 INFO:tasks.workunit.client.1.smithi174.stdout:8/388: dwrite d4/d15/d20/d3e/f62 [1163264,106496] 0 2024-05-06T14:04:07.278 INFO:tasks.workunit.client.1.smithi174.stdout:9/314: dwrite dc/f54 [65536,102400] 0 2024-05-06T14:04:07.278 INFO:tasks.workunit.client.1.smithi174.stdout:7/265: link d0/da/d19/f2d d0/da/f5c 0 2024-05-06T14:04:07.278 INFO:tasks.workunit.client.1.smithi174.stdout:4/296: dwrite d1/d1f/d27/d3e/d6e/d50/f57 [757760,4096] 0 2024-05-06T14:04:07.278 INFO:tasks.workunit.client.1.smithi174.stdout:1/247: rmdir d11/d41/d53 0 2024-05-06T14:04:07.279 INFO:tasks.workunit.client.1.smithi174.stdout:6/342: symlink d0/d25/d52/d4c/l6d 0 2024-05-06T14:04:07.279 INFO:tasks.workunit.client.1.smithi174.stdout:1/248: write d11/d1f/d27/d2d/f31 [2273250,27149] 0 2024-05-06T14:04:07.279 INFO:tasks.workunit.client.1.smithi174.stdout:1/249: mkdir d11/d41/d4a/d5e 0 2024-05-06T14:04:07.279 INFO:tasks.workunit.client.1.smithi174.stdout:1/250: symlink d11/d41/d51/l5f 0 2024-05-06T14:04:07.295 INFO:tasks.workunit.client.1.smithi174.stdout:5/292: dwrite d1/d6/f34 [1757184,86016] 0 2024-05-06T14:04:07.296 INFO:tasks.workunit.client.1.smithi174.stdout:6/343: dwrite d0/d25/f40 [397312,16384] 0 2024-05-06T14:04:07.296 INFO:tasks.workunit.client.1.smithi174.stdout:6/344: truncate d0/df/f1f 179657 0 2024-05-06T14:04:07.296 INFO:tasks.workunit.client.1.smithi174.stdout:6/345: creat d0/df/f6e x:0 0 0 2024-05-06T14:04:07.296 INFO:tasks.workunit.client.1.smithi174.stdout:6/346: chown d0/df/d45/f47 0 1 2024-05-06T14:04:07.297 INFO:tasks.workunit.client.1.smithi174.stdout:8/389: dwrite d4/f35 [634880,90112] 0 2024-05-06T14:04:07.297 INFO:tasks.workunit.client.1.smithi174.stdout:8/390: write d4/f35 [1404283,128563] 0 2024-05-06T14:04:07.297 INFO:tasks.workunit.client.1.smithi174.stdout:8/391: symlink d4/de/l7b 0 2024-05-06T14:04:07.297 INFO:tasks.workunit.client.1.smithi174.stdout:8/392: unlink d4/c2c 0 2024-05-06T14:04:07.298 INFO:tasks.workunit.client.1.smithi174.stdout:8/393: creat d4/d15/d64/f7c x:0 0 0 2024-05-06T14:04:07.298 INFO:tasks.workunit.client.1.smithi174.stdout:8/394: creat d4/d15/d20/d3e/d79/f7d x:0 0 0 2024-05-06T14:04:07.299 INFO:tasks.workunit.client.1.smithi174.stdout:7/266: dread d0/da/d19/d24/d14/d52/f20 [1421312,49152] 0 2024-05-06T14:04:07.299 INFO:tasks.workunit.client.1.smithi174.stdout:7/267: dread - d0/da/d19/d24/f3c zero size 2024-05-06T14:04:07.352 INFO:tasks.workunit.client.1.smithi174.stdout:9/315: fdatasync dc/d27/d60/f69 0 2024-05-06T14:04:07.353 INFO:tasks.workunit.client.1.smithi174.stdout:4/297: fdatasync d1/d1a/f1c 0 2024-05-06T14:04:07.353 INFO:tasks.workunit.client.1.smithi174.stdout:4/298: mkdir d1/d9/d15/d74 0 2024-05-06T14:04:07.353 INFO:tasks.workunit.client.1.smithi174.stdout:6/347: dwrite d0/df/d45/f47 [1245184,77824] 0 2024-05-06T14:04:07.353 INFO:tasks.workunit.client.1.smithi174.stdout:6/348: rename d0/d48 to d0/d25/d52/d2c/d6f 0 2024-05-06T14:04:07.353 INFO:tasks.workunit.client.1.smithi174.stdout:6/349: mknod d0/d25/d52/d2c/c70 0 2024-05-06T14:04:07.354 INFO:tasks.workunit.client.1.smithi174.stdout:6/350: rename d0/df/d45/d4b/f6b to d0/d25/d52/d2c/d6f/f71 0 2024-05-06T14:04:07.354 INFO:tasks.workunit.client.1.smithi174.stdout:7/268: dwrite d0/da/d28/d37/f40 [94208,28672] 0 2024-05-06T14:04:07.354 INFO:tasks.workunit.client.1.smithi174.stdout:6/351: creat d0/d25/d52/d2c/d6f/f72 x:0 0 0 2024-05-06T14:04:07.354 INFO:tasks.workunit.client.1.smithi174.stdout:7/269: mkdir d0/da/d19/d24/d5d 0 2024-05-06T14:04:07.362 INFO:tasks.workunit.client.1.smithi174.stdout:5/293: fdatasync d1/d6/d7/d3e/d4c/f55 0 2024-05-06T14:04:07.362 INFO:tasks.workunit.client.1.smithi174.stdout:5/294: truncate d1/d6/df/d35/f3d 301106 0 2024-05-06T14:04:07.362 INFO:tasks.workunit.client.1.smithi174.stdout:5/295: write d1/d6/df/d35/d3a/db/f1b [693269,81209] 0 2024-05-06T14:04:07.362 INFO:tasks.workunit.client.1.smithi174.stdout:5/296: dread - d1/d6/d7/d36/f47 zero size 2024-05-06T14:04:07.362 INFO:tasks.workunit.client.1.smithi174.stdout:8/395: fsync d4/d15/d20/d3e/f54 0 2024-05-06T14:04:07.363 INFO:tasks.workunit.client.1.smithi174.stdout:9/316: dwrite dc/f4e [860160,61440] 0 2024-05-06T14:04:07.363 INFO:tasks.workunit.client.1.smithi174.stdout:9/317: rename dc/df/f4b to dc/d14/f6c 0 2024-05-06T14:04:07.363 INFO:tasks.workunit.client.1.smithi174.stdout:9/318: dread dc/df/f4a [319488,40960] 0 2024-05-06T14:04:07.363 INFO:tasks.workunit.client.1.smithi174.stdout:9/319: unlink dc/de/f3e 0 2024-05-06T14:04:07.363 INFO:tasks.workunit.client.1.smithi174.stdout:9/320: dread - dc/d14/d43/f59 zero size 2024-05-06T14:04:07.363 INFO:tasks.workunit.client.1.smithi174.stdout:9/321: mkdir dc/d27/d6d 0 2024-05-06T14:04:07.363 INFO:tasks.workunit.client.1.smithi174.stdout:9/322: unlink dc/d17/d3a/f47 0 2024-05-06T14:04:07.365 INFO:tasks.workunit.client.1.smithi174.stdout:4/299: dwrite d1/d48/f58 [876544,12288] 0 2024-05-06T14:04:07.365 INFO:tasks.workunit.client.1.smithi174.stdout:4/300: rename d1/d48/d5a/d61/f6f to d1/d1f/d27/d3e/f75 0 2024-05-06T14:04:07.365 INFO:tasks.workunit.client.1.smithi174.stdout:4/301: creat d1/d1a/f76 x:0 0 0 2024-05-06T14:04:07.365 INFO:tasks.workunit.client.1.smithi174.stdout:4/302: dread - d1/d1f/d27/d2c/f3f zero size 2024-05-06T14:04:07.366 INFO:tasks.workunit.client.1.smithi174.stdout:4/303: write d1/d1a/f66 [1138510,27252] 0 2024-05-06T14:04:07.366 INFO:tasks.workunit.client.1.smithi174.stdout:4/304: dread - d1/f31 zero size 2024-05-06T14:04:07.366 INFO:tasks.workunit.client.1.smithi174.stdout:4/305: mknod d1/d9/d15/c77 0 2024-05-06T14:04:07.366 INFO:tasks.workunit.client.1.smithi174.stdout:4/306: creat d1/d1a/d56/f78 x:0 0 0 2024-05-06T14:04:07.367 INFO:tasks.workunit.client.1.smithi174.stdout:4/307: mkdir d1/d1f/d27/d3e/d6e/d50/d79 0 2024-05-06T14:04:07.367 INFO:tasks.workunit.client.1.smithi174.stdout:4/308: stat d1/d1a/f1c 0 2024-05-06T14:04:07.367 INFO:tasks.workunit.client.1.smithi174.stdout:4/309: dread d1/d9/d15/f6d [274432,106496] 0 2024-05-06T14:04:07.367 INFO:tasks.workunit.client.1.smithi174.stdout:5/297: creat d1/d6/df/d35/d3a/db/d60/f64 x:0 0 0 2024-05-06T14:04:07.367 INFO:tasks.workunit.client.1.smithi174.stdout:5/298: link d1/d6/df/d35/d3a/de/l4f d1/d6/d7/d36/d53/d59/l65 0 2024-05-06T14:04:07.367 INFO:tasks.workunit.client.1.smithi174.stdout:6/352: dwrite d0/df/d45/d4b/f5c [1179648,77824] 0 2024-05-06T14:04:07.368 INFO:tasks.workunit.client.1.smithi174.stdout:6/353: stat d0/df/d3c/c43 0 2024-05-06T14:04:07.368 INFO:tasks.workunit.client.1.smithi174.stdout:7/270: dwrite d0/f2e [1314816,57344] 0 2024-05-06T14:04:07.395 INFO:tasks.workunit.client.1.smithi174.stdout:9/323: fsync dc/de/f26 0 2024-05-06T14:04:07.395 INFO:tasks.workunit.client.1.smithi174.stdout:7/271: dwrite d0/da/d19/f5b [446464,118784] 0 2024-05-06T14:04:07.396 INFO:tasks.workunit.client.1.smithi174.stdout:7/272: link d0/d1d/f1e d0/da/d19/d24/d47/f5e 0 2024-05-06T14:04:07.462 INFO:tasks.workunit.client.1.smithi174.stdout:0/240: sync 2024-05-06T14:04:07.462 INFO:tasks.workunit.client.1.smithi174.stdout:2/285: sync 2024-05-06T14:04:07.462 INFO:tasks.workunit.client.1.smithi174.stdout:3/332: sync 2024-05-06T14:04:07.463 INFO:tasks.workunit.client.1.smithi174.stdout:0/241: dread - d0/d1a/d17/d2e/f3c zero size 2024-05-06T14:04:07.463 INFO:tasks.workunit.client.1.smithi174.stdout:0/242: chown d0/d3/c7 2 1 2024-05-06T14:04:07.463 INFO:tasks.workunit.client.1.smithi174.stdout:2/286: creat d0/f55 x:0 0 0 2024-05-06T14:04:07.463 INFO:tasks.workunit.client.1.smithi174.stdout:0/243: link d0/d1a/d17/c2d d0/d3/dc/d44/c52 0 2024-05-06T14:04:07.463 INFO:tasks.workunit.client.1.smithi174.stdout:0/244: chown d0/d36/f3b 61433501 1 2024-05-06T14:04:07.463 INFO:tasks.workunit.client.1.smithi174.stdout:2/287: chown d0/db/d15/f4a 0 1 2024-05-06T14:04:07.464 INFO:tasks.workunit.client.1.smithi174.stdout:0/245: truncate d0/d4/f37 2391573 0 2024-05-06T14:04:07.464 INFO:tasks.workunit.client.1.smithi174.stdout:0/246: dread - d0/d4/d8/f47 zero size 2024-05-06T14:04:07.464 INFO:tasks.workunit.client.1.smithi174.stdout:2/288: dread d0/d1/d2/d4/d6/f26 [81920,81920] 0 2024-05-06T14:04:07.464 INFO:tasks.workunit.client.1.smithi174.stdout:2/289: creat d0/da/f56 x:0 0 0 2024-05-06T14:04:07.465 INFO:tasks.workunit.client.1.smithi174.stdout:2/290: chown d0/d1/d2/d4/d18/f49 391491401 1 2024-05-06T14:04:07.465 INFO:tasks.workunit.client.1.smithi174.stdout:2/291: readlink d0/d1/d2/l2f 0 2024-05-06T14:04:07.465 INFO:tasks.workunit.client.1.smithi174.stdout:2/292: creat d0/d1/d2/d4/f57 x:0 0 0 2024-05-06T14:04:07.466 INFO:tasks.workunit.client.1.smithi174.stdout:2/293: mkdir d0/d24/d58 0 2024-05-06T14:04:07.519 INFO:tasks.workunit.client.1.smithi174.stdout:9/324: fsync dc/d27/d51/f65 0 2024-05-06T14:04:07.519 INFO:tasks.workunit.client.1.smithi174.stdout:9/325: readlink dc/l19 0 2024-05-06T14:04:07.520 INFO:tasks.workunit.client.1.smithi174.stdout:0/247: dwrite d0/d4/d8/d25/d32/f35 [466944,32768] 0 2024-05-06T14:04:07.520 INFO:tasks.workunit.client.1.smithi174.stdout:0/248: chown d0/d3/dc/d44 75828 1 2024-05-06T14:04:07.521 INFO:tasks.workunit.client.1.smithi174.stdout:3/333: dwrite f5 [2576384,28672] 0 2024-05-06T14:04:07.522 INFO:tasks.workunit.client.1.smithi174.stdout:0/249: link d0/d4/d8/d25/d32/d38/f28 d0/d1a/d17/d2e/f53 0 2024-05-06T14:04:07.522 INFO:tasks.workunit.client.1.smithi174.stdout:6/354: dwrite d0/df/d45/f50 [2527232,4096] 0 2024-05-06T14:04:07.522 INFO:tasks.workunit.client.1.smithi174.stdout:9/326: symlink dc/d27/d6d/l6e 0 2024-05-06T14:04:07.522 INFO:tasks.workunit.client.1.smithi174.stdout:6/355: chown d0/df/l1b 455338631 1 2024-05-06T14:04:07.523 INFO:tasks.workunit.client.1.smithi174.stdout:9/327: chown dc/f30 37981 1 2024-05-06T14:04:07.523 INFO:tasks.workunit.client.1.smithi174.stdout:9/328: truncate dc/de/f4f 183600 0 2024-05-06T14:04:07.523 INFO:tasks.workunit.client.1.smithi174.stdout:6/356: write d0/df/f14 [182137,89314] 0 2024-05-06T14:04:07.523 INFO:tasks.workunit.client.1.smithi174.stdout:6/357: creat d0/f73 x:0 0 0 2024-05-06T14:04:07.523 INFO:tasks.workunit.client.1.smithi174.stdout:6/358: symlink d0/df/d45/d4b/l74 0 2024-05-06T14:04:07.550 INFO:tasks.workunit.client.1.smithi174.stdout:3/334: fsync df/d10/f16 0 2024-05-06T14:04:07.551 INFO:tasks.workunit.client.1.smithi174.stdout:3/335: readlink df/d10/l26 0 2024-05-06T14:04:07.555 INFO:tasks.workunit.client.1.smithi174.stdout:6/359: creat d0/df/d3c/f75 x:0 0 0 2024-05-06T14:04:07.555 INFO:tasks.workunit.client.1.smithi174.stdout:6/360: mkdir d0/d25/d52/d2c/d76 0 2024-05-06T14:04:07.555 INFO:tasks.workunit.client.1.smithi174.stdout:6/361: mknod d0/d25/d52/d2c/d5f/c77 0 2024-05-06T14:04:07.555 INFO:tasks.workunit.client.1.smithi174.stdout:6/362: dread d0/d25/f51 [299008,49152] 0 2024-05-06T14:04:07.555 INFO:tasks.workunit.client.1.smithi174.stdout:6/363: chown d0/df/d3c/c43 127806628 1 2024-05-06T14:04:07.555 INFO:tasks.workunit.client.1.smithi174.stdout:6/364: link d0/df/c55 d0/df/d45/d4b/c78 0 2024-05-06T14:04:07.555 INFO:tasks.workunit.client.1.smithi174.stdout:6/365: symlink d0/d25/d52/d2c/l79 0 2024-05-06T14:04:07.556 INFO:tasks.workunit.client.1.smithi174.stdout:6/366: getdents d0/d25/d52/d2c/d76 0 2024-05-06T14:04:07.556 INFO:tasks.workunit.client.1.smithi174.stdout:6/367: mkdir d0/df/d3c/d7a 0 2024-05-06T14:04:07.556 INFO:tasks.workunit.client.1.smithi174.stdout:6/368: chown d0/l9 40258758 1 2024-05-06T14:04:07.556 INFO:tasks.workunit.client.1.smithi174.stdout:6/369: symlink d0/d25/d52/d2c/d6f/l7b 0 2024-05-06T14:04:07.556 INFO:tasks.workunit.client.1.smithi174.stdout:3/336: truncate df/d2d/f39 764852 0 2024-05-06T14:04:07.556 INFO:tasks.workunit.client.1.smithi174.stdout:3/337: read df/d10/d1b/f33 [60213,106668] 0 2024-05-06T14:04:07.556 INFO:tasks.workunit.client.1.smithi174.stdout:3/338: mkdir df/d2d/d4b/d5a/d6b 0 2024-05-06T14:04:07.556 INFO:tasks.workunit.client.1.smithi174.stdout:3/339: creat df/d2d/f6c x:0 0 0 2024-05-06T14:04:07.610 INFO:tasks.workunit.client.1.smithi174.stdout:6/370: dwrite d0/d25/d52/d2c/d6f/f72 [647168,106496] 0 2024-05-06T14:04:07.617 INFO:tasks.workunit.client.1.smithi174.stdout:6/371: rename d0/f16 to d0/f7c 0 2024-05-06T14:04:07.617 INFO:tasks.workunit.client.1.smithi174.stdout:6/372: rename d0/d25/d52/c44 to d0/c7d 0 2024-05-06T14:04:07.617 INFO:tasks.workunit.client.1.smithi174.stdout:6/373: rename d0/df/d45/l68 to d0/d25/l7e 0 2024-05-06T14:04:07.617 INFO:tasks.workunit.client.1.smithi174.stdout:6/374: truncate d0/df/d45/f50 2819761 0 2024-05-06T14:04:07.617 INFO:tasks.workunit.client.1.smithi174.stdout:6/375: readlink d0/df/l10 0 2024-05-06T14:04:07.617 INFO:tasks.workunit.client.1.smithi174.stdout:6/376: creat d0/f7f x:0 0 0 2024-05-06T14:04:07.618 INFO:tasks.workunit.client.1.smithi174.stdout:6/377: rename d0/d25/d52/d2c/d6f/d65 to d0/d25/d52/d80 0 2024-05-06T14:04:07.618 INFO:tasks.workunit.client.1.smithi174.stdout:6/378: chown d0/d25/d52/d2c/c3d 201265072 1 2024-05-06T14:04:07.618 INFO:tasks.workunit.client.1.smithi174.stdout:2/294: sync 2024-05-06T14:04:07.618 INFO:tasks.workunit.client.1.smithi174.stdout:5/299: sync 2024-05-06T14:04:07.618 INFO:tasks.workunit.client.1.smithi174.stdout:4/310: sync 2024-05-06T14:04:07.618 INFO:tasks.workunit.client.1.smithi174.stdout:2/295: stat d0/d1/d2/d4/f46 0 2024-05-06T14:04:07.618 INFO:tasks.workunit.client.1.smithi174.stdout:2/296: chown d0 31299922 1 2024-05-06T14:04:07.618 INFO:tasks.workunit.client.1.smithi174.stdout:8/396: sync 2024-05-06T14:04:07.619 INFO:tasks.workunit.client.1.smithi174.stdout:7/273: sync 2024-05-06T14:04:07.619 INFO:tasks.workunit.client.1.smithi174.stdout:1/251: sync 2024-05-06T14:04:07.619 INFO:tasks.workunit.client.1.smithi174.stdout:8/397: rmdir d4/d15/d20 39 2024-05-06T14:04:07.619 INFO:tasks.workunit.client.1.smithi174.stdout:2/297: mknod d0/d1/d2/d2a/c59 0 2024-05-06T14:04:07.619 INFO:tasks.workunit.client.1.smithi174.stdout:8/398: stat d4/de/d23/d3c/c4b 0 2024-05-06T14:04:07.619 INFO:tasks.workunit.client.1.smithi174.stdout:5/300: symlink d1/d6/d7/d36/d53/d59/l66 0 2024-05-06T14:04:07.619 INFO:tasks.workunit.client.1.smithi174.stdout:2/298: dread - d0/d1/d2/d4/f57 zero size 2024-05-06T14:04:07.619 INFO:tasks.workunit.client.1.smithi174.stdout:7/274: write d0/f2e [464250,35326] 0 2024-05-06T14:04:07.620 INFO:tasks.workunit.client.1.smithi174.stdout:7/275: rmdir d0/da/d19 39 2024-05-06T14:04:07.620 INFO:tasks.workunit.client.1.smithi174.stdout:2/299: write d0/db/d15/f2e [863224,78865] 0 2024-05-06T14:04:07.620 INFO:tasks.workunit.client.1.smithi174.stdout:5/301: dread d1/d6/df/d35/d3a/fd [2883584,122880] 0 2024-05-06T14:04:07.620 INFO:tasks.workunit.client.1.smithi174.stdout:2/300: write d0/d1/d2/d4/f46 [657165,290] 0 2024-05-06T14:04:07.620 INFO:tasks.workunit.client.1.smithi174.stdout:4/311: write d1/d1a/f66 [1197328,106964] 0 2024-05-06T14:04:07.620 INFO:tasks.workunit.client.1.smithi174.stdout:5/302: creat d1/d6/df/f67 x:0 0 0 2024-05-06T14:04:07.620 INFO:tasks.workunit.client.1.smithi174.stdout:8/399: write d4/d15/f16 [1365723,122537] 0 2024-05-06T14:04:07.620 INFO:tasks.workunit.client.1.smithi174.stdout:5/303: rename d1/d6/df/d35 to d1/d6/df/d35/d3a/db/d68 22 2024-05-06T14:04:07.621 INFO:tasks.workunit.client.1.smithi174.stdout:4/312: creat d1/d1f/d27/f7a x:0 0 0 2024-05-06T14:04:07.621 INFO:tasks.workunit.client.1.smithi174.stdout:8/400: creat d4/de/d23/d41/d56/f7e x:0 0 0 2024-05-06T14:04:07.621 INFO:tasks.workunit.client.1.smithi174.stdout:5/304: mkdir d1/d6/d7/d36/d53/d59/d61/d69 0 2024-05-06T14:04:07.621 INFO:tasks.workunit.client.1.smithi174.stdout:4/313: creat d1/d1f/d27/d3e/f7b x:0 0 0 2024-05-06T14:04:07.621 INFO:tasks.workunit.client.1.smithi174.stdout:8/401: creat d4/de/d23/d3c/f7f x:0 0 0 2024-05-06T14:04:07.621 INFO:tasks.workunit.client.1.smithi174.stdout:8/402: chown d4/d15 74 1 2024-05-06T14:04:07.621 INFO:tasks.workunit.client.1.smithi174.stdout:4/314: symlink d1/d1f/d27/d3e/l7c 0 2024-05-06T14:04:07.621 INFO:tasks.workunit.client.1.smithi174.stdout:8/403: read d4/d15/d20/d3e/f62 [869064,122194] 0 2024-05-06T14:04:07.622 INFO:tasks.workunit.client.1.smithi174.stdout:4/315: dread d1/d9/d15/f21 [376832,4096] 0 2024-05-06T14:04:07.622 INFO:tasks.workunit.client.1.smithi174.stdout:4/316: dread - d1/d1f/d27/d2c/f3f zero size 2024-05-06T14:04:07.622 INFO:tasks.workunit.client.1.smithi174.stdout:8/404: mknod d4/de/d23/d41/d4e/c80 0 2024-05-06T14:04:07.622 INFO:tasks.workunit.client.1.smithi174.stdout:5/305: write d1/d6/df/d35/f3d [438600,85597] 0 2024-05-06T14:04:07.622 INFO:tasks.workunit.client.1.smithi174.stdout:5/306: mknod d1/d6/df/d35/d3a/db/d1e/c6a 0 2024-05-06T14:04:07.622 INFO:tasks.workunit.client.1.smithi174.stdout:5/307: mkdir d1/d6/df/d35/d3a/de/d6b 0 2024-05-06T14:04:07.622 INFO:tasks.workunit.client.1.smithi174.stdout:8/405: write d4/de/d23/d3c/f7f [927831,118303] 0 2024-05-06T14:04:07.622 INFO:tasks.workunit.client.1.smithi174.stdout:8/406: mknod d4/d15/c81 0 2024-05-06T14:04:07.623 INFO:tasks.workunit.client.1.smithi174.stdout:5/308: rename d1/d6/df/d35/d3a/c2b to d1/d6/df/d35/d3a/de/d6b/c6c 0 2024-05-06T14:04:07.623 INFO:tasks.workunit.client.1.smithi174.stdout:5/309: getdents d1/d6/df/d35/d3a/de 0 2024-05-06T14:04:07.623 INFO:tasks.workunit.client.1.smithi174.stdout:5/310: mknod d1/d6/df/d35/d3a/de/c6d 0 2024-05-06T14:04:07.623 INFO:tasks.workunit.client.1.smithi174.stdout:5/311: creat d1/d6/d7/d36/d53/d59/f6e x:0 0 0 2024-05-06T14:04:07.623 INFO:tasks.workunit.client.1.smithi174.stdout:5/312: creat d1/d6/df/d35/d3a/de/d6b/f6f x:0 0 0 2024-05-06T14:04:07.623 INFO:tasks.workunit.client.1.smithi174.stdout:5/313: write d1/d6/df/d35/d3a/f25 [3349276,43337] 0 2024-05-06T14:04:07.623 INFO:tasks.workunit.client.1.smithi174.stdout:5/314: mknod d1/d6/df/d35/d3a/db/d60/c70 0 2024-05-06T14:04:07.624 INFO:tasks.workunit.client.1.smithi174.stdout:5/315: symlink d1/d6/df/d35/d3a/db/l71 0 2024-05-06T14:04:07.624 INFO:tasks.workunit.client.1.smithi174.stdout:3/340: dread df/d10/f4c [753664,4096] 0 2024-05-06T14:04:07.624 INFO:tasks.workunit.client.1.smithi174.stdout:3/341: creat df/d2d/d4b/f6d x:0 0 0 2024-05-06T14:04:07.685 INFO:tasks.workunit.client.1.smithi174.stdout:6/379: dwrite d0/d25/d52/d2c/d6f/f72 [1048576,114688] 0 2024-05-06T14:04:07.686 INFO:tasks.workunit.client.1.smithi174.stdout:6/380: mkdir d0/d81 0 2024-05-06T14:04:07.686 INFO:tasks.workunit.client.1.smithi174.stdout:6/381: chown d0/d25/d52/d2c/f6a 1300 1 2024-05-06T14:04:07.686 INFO:tasks.workunit.client.1.smithi174.stdout:6/382: creat d0/df/d45/d4b/f82 x:0 0 0 2024-05-06T14:04:07.727 INFO:tasks.workunit.client.1.smithi174.stdout:2/301: fdatasync d0/d1/d2/d4/d18/d2d/d32/f47 0 2024-05-06T14:04:07.727 INFO:tasks.workunit.client.1.smithi174.stdout:0/250: fsync d0/d1a/d17/d2e/f53 0 2024-05-06T14:04:07.727 INFO:tasks.workunit.client.1.smithi174.stdout:2/302: readlink d0/db/l13 0 2024-05-06T14:04:07.727 INFO:tasks.workunit.client.1.smithi174.stdout:0/251: creat d0/d3/dc/d44/f54 x:0 0 0 2024-05-06T14:04:07.728 INFO:tasks.workunit.client.1.smithi174.stdout:0/252: read d0/d4/d8/d25/d32/d38/f28 [166838,13283] 0 2024-05-06T14:04:07.728 INFO:tasks.workunit.client.1.smithi174.stdout:0/253: dread - d0/f51 zero size 2024-05-06T14:04:07.728 INFO:tasks.workunit.client.1.smithi174.stdout:8/407: fdatasync d4/f6e 0 2024-05-06T14:04:07.738 INFO:tasks.workunit.client.1.smithi174.stdout:5/316: fdatasync d1/d6/d7/f2e 0 2024-05-06T14:04:07.742 INFO:tasks.workunit.client.1.smithi174.stdout:0/254: rename d0/d1a/d17/c33 to d0/d4/d8/d25/d32/d38/c55 0 2024-05-06T14:04:07.742 INFO:tasks.workunit.client.1.smithi174.stdout:5/317: link d1/d6/df/l20 d1/d6/df/d35/d3a/de/d6b/l72 0 2024-05-06T14:04:07.742 INFO:tasks.workunit.client.1.smithi174.stdout:8/408: mkdir d4/d15/d20/d3e/d79/d82 0 2024-05-06T14:04:07.742 INFO:tasks.workunit.client.1.smithi174.stdout:0/255: symlink d0/d3/dc/l56 0 2024-05-06T14:04:07.743 INFO:tasks.workunit.client.1.smithi174.stdout:5/318: symlink d1/d6/df/l73 0 2024-05-06T14:04:07.743 INFO:tasks.workunit.client.1.smithi174.stdout:8/409: link d4/de/d24/f45 d4/de/d24/d5e/f83 0 2024-05-06T14:04:07.743 INFO:tasks.workunit.client.1.smithi174.stdout:5/319: dread d1/d6/d7/d36/f2c [1839104,57344] 0 2024-05-06T14:04:07.743 INFO:tasks.workunit.client.1.smithi174.stdout:6/383: dwrite d0/d25/d52/d2c/f63 [618496,20480] 0 2024-05-06T14:04:07.743 INFO:tasks.workunit.client.1.smithi174.stdout:6/384: creat d0/d25/d52/d3b/f83 x:0 0 0 2024-05-06T14:04:07.743 INFO:tasks.workunit.client.1.smithi174.stdout:5/320: write d1/d6/df/d35/d3a/db/f1b [746280,123629] 0 2024-05-06T14:04:07.743 INFO:tasks.workunit.client.1.smithi174.stdout:6/385: chown d0/d25/d35 12 1 2024-05-06T14:04:07.743 INFO:tasks.workunit.client.1.smithi174.stdout:5/321: readlink d1/d6/df/d35/d3a/d41/l49 0 2024-05-06T14:04:07.744 INFO:tasks.workunit.client.1.smithi174.stdout:5/322: write d1/d6/df/d35/d3a/de/f3f [2284516,27688] 0 2024-05-06T14:04:07.744 INFO:tasks.workunit.client.1.smithi174.stdout:5/323: getdents d1/d6/df/d35/d3a 0 2024-05-06T14:04:07.744 INFO:tasks.workunit.client.1.smithi174.stdout:6/386: write d0/f73 [1026479,101398] 0 2024-05-06T14:04:07.744 INFO:tasks.workunit.client.1.smithi174.stdout:5/324: rename d1/d6/df/d35/d3a/db/f5f to d1/d6/d7/d36/d53/f74 0 2024-05-06T14:04:07.744 INFO:tasks.workunit.client.1.smithi174.stdout:5/325: chown d1/d6/df/d35/d3a/de/f26 1138597 1 2024-05-06T14:04:07.744 INFO:tasks.workunit.client.1.smithi174.stdout:6/387: read d0/d25/d52/d3b/f53 [554994,26128] 0 2024-05-06T14:04:07.744 INFO:tasks.workunit.client.1.smithi174.stdout:5/326: dread d1/d6/f54 [98304,61440] 0 2024-05-06T14:04:07.744 INFO:tasks.workunit.client.1.smithi174.stdout:2/303: dwrite d0/f3e [282624,49152] 0 2024-05-06T14:04:07.745 INFO:tasks.workunit.client.1.smithi174.stdout:5/327: write d1/d6/df/d35/d3a/de/f26 [537534,94563] 0 2024-05-06T14:04:07.745 INFO:tasks.workunit.client.1.smithi174.stdout:2/304: read d0/d1/d2/d4/d6/f26 [378599,115493] 0 2024-05-06T14:04:07.745 INFO:tasks.workunit.client.1.smithi174.stdout:2/305: creat d0/d1/d2/d4/d51/f5a x:0 0 0 2024-05-06T14:04:07.745 INFO:tasks.workunit.client.1.smithi174.stdout:2/306: stat d0/d1/d2/f17 0 2024-05-06T14:04:07.745 INFO:tasks.workunit.client.1.smithi174.stdout:2/307: dread - d0/d1/d2/d4/d18/f49 zero size 2024-05-06T14:04:07.745 INFO:tasks.workunit.client.1.smithi174.stdout:2/308: chown d0/d24/d58 45 1 2024-05-06T14:04:07.745 INFO:tasks.workunit.client.1.smithi174.stdout:2/309: mknod d0/db/c5b 0 2024-05-06T14:04:07.745 INFO:tasks.workunit.client.1.smithi174.stdout:2/310: rename d0/d1/d2/d4/d18/d2d/d32/f38 to d0/d1/d2/d2a/f5c 0 2024-05-06T14:04:07.745 INFO:tasks.workunit.client.1.smithi174.stdout:2/311: unlink d0/d1/d2/d4/l37 0 2024-05-06T14:04:07.746 INFO:tasks.workunit.client.1.smithi174.stdout:2/312: mknod d0/da/d3f/c5d 0 2024-05-06T14:04:07.770 INFO:tasks.workunit.client.1.smithi174.stdout:0/256: write d0/d1a/f1b [659884,105107] 0 2024-05-06T14:04:07.770 INFO:tasks.workunit.client.1.smithi174.stdout:0/257: write d0/d1a/f22 [1595044,17706] 0 2024-05-06T14:04:07.770 INFO:tasks.workunit.client.1.smithi174.stdout:0/258: truncate d0/d1a/d17/d2e/f39 825618 0 2024-05-06T14:04:07.770 INFO:tasks.workunit.client.1.smithi174.stdout:0/259: chown d0/d3/dc/d4a 189680 1 2024-05-06T14:04:07.770 INFO:tasks.workunit.client.1.smithi174.stdout:0/260: write d0/d1a/d17/d2e/f3e [282036,41522] 0 2024-05-06T14:04:07.772 INFO:tasks.workunit.client.1.smithi174.stdout:2/313: dwrite d0/d1/d2/d4/f22 [1933312,118784] 0 2024-05-06T14:04:07.772 INFO:tasks.workunit.client.1.smithi174.stdout:2/314: creat d0/d1/f5e x:0 0 0 2024-05-06T14:04:07.772 INFO:tasks.workunit.client.1.smithi174.stdout:2/315: rename d0/d1/d2/d4/d18/f49 to d0/d16/f5f 0 2024-05-06T14:04:07.773 INFO:tasks.workunit.client.1.smithi174.stdout:8/410: dwrite d4/de/d23/d41/d56/f5d [1798144,110592] 0 2024-05-06T14:04:07.773 INFO:tasks.workunit.client.1.smithi174.stdout:0/261: dwrite d0/d1a/f22 [1646592,28672] 0 2024-05-06T14:04:07.773 INFO:tasks.workunit.client.1.smithi174.stdout:0/262: stat d0/d3/dc/d44/f54 0 2024-05-06T14:04:07.773 INFO:tasks.workunit.client.1.smithi174.stdout:0/263: creat d0/d4/f57 x:0 0 0 2024-05-06T14:04:07.773 INFO:tasks.workunit.client.1.smithi174.stdout:0/264: readlink d0/d3/dc/l26 0 2024-05-06T14:04:07.773 INFO:tasks.workunit.client.1.smithi174.stdout:0/265: write d0/d4/f3d [375564,29219] 0 2024-05-06T14:04:07.773 INFO:tasks.workunit.client.1.smithi174.stdout:0/266: truncate d0/d1a/f30 667424 0 2024-05-06T14:04:07.774 INFO:tasks.workunit.client.1.smithi174.stdout:0/267: dread d0/d4/d8/d25/d32/d38/f31 [393216,40960] 0 2024-05-06T14:04:07.774 INFO:tasks.workunit.client.1.smithi174.stdout:0/268: write d0/d3/dc/d44/f46 [927804,26155] 0 2024-05-06T14:04:07.827 INFO:tasks.workunit.client.1.smithi174.stdout:6/388: fdatasync d0/df/d45/f47 0 2024-05-06T14:04:07.827 INFO:tasks.workunit.client.1.smithi174.stdout:6/389: symlink d0/df/l84 0 2024-05-06T14:04:07.827 INFO:tasks.workunit.client.1.smithi174.stdout:6/390: dread - d0/d25/d52/d3b/f83 zero size 2024-05-06T14:04:07.828 INFO:tasks.workunit.client.1.smithi174.stdout:6/391: dread - d0/d25/d52/d2c/d6f/f71 zero size 2024-05-06T14:04:07.828 INFO:tasks.workunit.client.1.smithi174.stdout:6/392: mkdir d0/df/d45/d85 0 2024-05-06T14:04:07.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/269: mkdir d0/d1a/d17/d2e/d58 0 2024-05-06T14:04:07.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/270: creat d0/f59 x:0 0 0 2024-05-06T14:04:07.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/271: getdents d0/d36/d3f 0 2024-05-06T14:04:07.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/272: mkdir d0/d36/d5a 0 2024-05-06T14:04:07.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/273: write d0/d3/f40 [2266112,125022] 0 2024-05-06T14:04:07.831 INFO:tasks.workunit.client.1.smithi174.stdout:0/274: link d0/d4/d8/d25/l48 d0/d36/d3f/l5b 0 2024-05-06T14:04:07.831 INFO:tasks.workunit.client.1.smithi174.stdout:0/275: dread d0/fa [1372160,57344] 0 2024-05-06T14:04:07.832 INFO:tasks.workunit.client.1.smithi174.stdout:2/316: write d0/db/d15/f2e [231484,81743] 0 2024-05-06T14:04:07.866 INFO:tasks.workunit.client.1.smithi174.stdout:6/393: fsync d0/df/f29 0 2024-05-06T14:04:07.871 INFO:tasks.workunit.client.1.smithi174.stdout:6/394: dread d0/df/d45/d4b/f5c [995328,20480] 0 2024-05-06T14:04:07.871 INFO:tasks.workunit.client.1.smithi174.stdout:6/395: link d0/d25/d52/d3b/f83 d0/df/d45/d4b/f86 0 2024-05-06T14:04:07.871 INFO:tasks.workunit.client.1.smithi174.stdout:2/317: rename d0/d1/d2/d2a/l45 to d0/d1/d2/d1b/l60 0 2024-05-06T14:04:07.871 INFO:tasks.workunit.client.1.smithi174.stdout:2/318: rmdir d0/d1/d2/d4/d6 39 2024-05-06T14:04:07.871 INFO:tasks.workunit.client.1.smithi174.stdout:6/396: creat d0/d25/d35/f87 x:0 0 0 2024-05-06T14:04:07.871 INFO:tasks.workunit.client.1.smithi174.stdout:6/397: readlink d0/d25/d52/d2c/l79 0 2024-05-06T14:04:07.872 INFO:tasks.workunit.client.1.smithi174.stdout:6/398: creat d0/d25/d52/d2c/d5f/f88 x:0 0 0 2024-05-06T14:04:07.874 INFO:tasks.workunit.client.1.smithi174.stdout:1/252: sync 2024-05-06T14:04:07.874 INFO:tasks.workunit.client.1.smithi174.stdout:9/329: sync 2024-05-06T14:04:07.874 INFO:tasks.workunit.client.1.smithi174.stdout:1/253: creat d11/d41/f60 x:0 0 0 2024-05-06T14:04:07.875 INFO:tasks.workunit.client.1.smithi174.stdout:1/254: write d11/f5a [70550,7628] 0 2024-05-06T14:04:07.875 INFO:tasks.workunit.client.1.smithi174.stdout:9/330: dread dc/de/f62 [512000,114688] 0 2024-05-06T14:04:07.875 INFO:tasks.workunit.client.1.smithi174.stdout:1/255: rename d11/d1f/d27/l58 to d11/d41/l61 0 2024-05-06T14:04:07.875 INFO:tasks.workunit.client.1.smithi174.stdout:9/331: unlink dc/c53 0 2024-05-06T14:04:07.875 INFO:tasks.workunit.client.1.smithi174.stdout:1/256: mknod d11/d1f/d27/c62 0 2024-05-06T14:04:07.875 INFO:tasks.workunit.client.1.smithi174.stdout:9/332: chown dc/d27/d51/c5b 56 1 2024-05-06T14:04:07.875 INFO:tasks.workunit.client.1.smithi174.stdout:1/257: dread f1 [679936,122880] 0 2024-05-06T14:04:07.875 INFO:tasks.workunit.client.1.smithi174.stdout:9/333: creat dc/d27/d6d/f6f x:0 0 0 2024-05-06T14:04:07.876 INFO:tasks.workunit.client.1.smithi174.stdout:9/334: chown dc/d27/d51/f65 113 1 2024-05-06T14:04:07.876 INFO:tasks.workunit.client.1.smithi174.stdout:1/258: symlink d11/l63 0 2024-05-06T14:04:07.876 INFO:tasks.workunit.client.1.smithi174.stdout:1/259: readlink d11/d1f/l4f 0 2024-05-06T14:04:07.876 INFO:tasks.workunit.client.1.smithi174.stdout:1/260: mknod d11/d41/c64 0 2024-05-06T14:04:07.876 INFO:tasks.workunit.client.1.smithi174.stdout:9/335: symlink dc/de/l70 0 2024-05-06T14:04:07.876 INFO:tasks.workunit.client.1.smithi174.stdout:1/261: rmdir d11/d41/d4a 39 2024-05-06T14:04:07.876 INFO:tasks.workunit.client.1.smithi174.stdout:9/336: getdents dc/de 0 2024-05-06T14:04:07.876 INFO:tasks.workunit.client.1.smithi174.stdout:9/337: link dc/de/f62 dc/de/d6b/f71 0 2024-05-06T14:04:07.876 INFO:tasks.workunit.client.1.smithi174.stdout:9/338: chown dc/de/c3c 27 1 2024-05-06T14:04:07.877 INFO:tasks.workunit.client.1.smithi174.stdout:9/339: rename dc/f30 to dc/d17/d4c/f72 0 2024-05-06T14:04:07.877 INFO:tasks.workunit.client.1.smithi174.stdout:9/340: mknod dc/d17/d3a/c73 0 2024-05-06T14:04:07.877 INFO:tasks.workunit.client.1.smithi174.stdout:9/341: creat dc/d27/d63/f74 x:0 0 0 2024-05-06T14:04:07.877 INFO:tasks.workunit.client.1.smithi174.stdout:9/342: symlink dc/d27/d51/l75 0 2024-05-06T14:04:07.877 INFO:tasks.workunit.client.1.smithi174.stdout:9/343: creat dc/f76 x:0 0 0 2024-05-06T14:04:07.877 INFO:tasks.workunit.client.1.smithi174.stdout:9/344: rename dc/d17/f50 to dc/d27/f77 0 2024-05-06T14:04:07.877 INFO:tasks.workunit.client.1.smithi174.stdout:9/345: rmdir dc/de/d6b 39 2024-05-06T14:04:07.877 INFO:tasks.workunit.client.1.smithi174.stdout:9/346: write dc/f3b [496013,56055] 0 2024-05-06T14:04:07.938 INFO:tasks.workunit.client.1.smithi174.stdout:2/319: dwrite d0/db/d15/f30 [1376256,102400] 0 2024-05-06T14:04:07.938 INFO:tasks.workunit.client.1.smithi174.stdout:2/320: mkdir d0/d1/d2/d4/d6/d3c/d61 0 2024-05-06T14:04:07.938 INFO:tasks.workunit.client.1.smithi174.stdout:2/321: rmdir d0/d40 0 2024-05-06T14:04:07.938 INFO:tasks.workunit.client.1.smithi174.stdout:2/322: write d0/d1/d2/f54 [653670,4973] 0 2024-05-06T14:04:07.938 INFO:tasks.workunit.client.1.smithi174.stdout:2/323: write d0/d1/d2/d4/d6/f26 [1120751,76674] 0 2024-05-06T14:04:07.938 INFO:tasks.workunit.client.1.smithi174.stdout:2/324: mknod d0/d1/d2/d4/d43/c62 0 2024-05-06T14:04:07.939 INFO:tasks.workunit.client.1.smithi174.stdout:2/325: dwrite d0/d1/d2/d4/f57 [446464,16384] 0 2024-05-06T14:04:07.976 INFO:tasks.workunit.client.1.smithi174.stdout:6/399: fsync d0/df/d45/f50 0 2024-05-06T14:04:07.976 INFO:tasks.workunit.client.1.smithi174.stdout:6/400: stat d0 0 2024-05-06T14:04:07.976 INFO:tasks.workunit.client.1.smithi174.stdout:6/401: mknod d0/d25/d52/d2c/d76/c89 0 2024-05-06T14:04:07.976 INFO:tasks.workunit.client.1.smithi174.stdout:5/328: fdatasync d1/d6/df/d35/d3a/f25 0 2024-05-06T14:04:07.977 INFO:tasks.workunit.client.1.smithi174.stdout:5/329: rename d1/c5 to d1/d6/d7/d36/d53/d59/c75 0 2024-05-06T14:04:07.981 INFO:tasks.workunit.client.1.smithi174.stdout:1/262: fsync d11/d41/f5c 0 2024-05-06T14:04:07.986 INFO:tasks.workunit.client.1.smithi174.stdout:6/402: creat d0/f8a x:0 0 0 2024-05-06T14:04:07.988 INFO:tasks.workunit.client.1.smithi174.stdout:2/326: dwrite d0/f55 [913408,40960] 0 2024-05-06T14:04:07.988 INFO:tasks.workunit.client.1.smithi174.stdout:6/403: creat d0/df/d3c/f8b x:0 0 0 2024-05-06T14:04:07.988 INFO:tasks.workunit.client.1.smithi174.stdout:2/327: truncate d0/db/d15/f4a 1399205 0 2024-05-06T14:04:07.988 INFO:tasks.workunit.client.1.smithi174.stdout:6/404: getdents d0/d25/d52/d4c 0 2024-05-06T14:04:07.988 INFO:tasks.workunit.client.1.smithi174.stdout:6/405: chown d0/d25/d52/d2c/l36 0 1 2024-05-06T14:04:07.989 INFO:tasks.workunit.client.1.smithi174.stdout:6/406: symlink d0/df/d45/l8c 0 2024-05-06T14:04:07.989 INFO:tasks.workunit.client.1.smithi174.stdout:6/407: stat d0/d25/d35 0 2024-05-06T14:04:07.989 INFO:tasks.workunit.client.1.smithi174.stdout:6/408: mknod d0/df/d45/d56/c8d 0 2024-05-06T14:04:07.990 INFO:tasks.workunit.client.1.smithi174.stdout:5/330: dwrite d1/d6/df/d35/d3a/de/f63 [1019904,77824] 0 2024-05-06T14:04:07.991 INFO:tasks.workunit.client.1.smithi174.stdout:1/263: dwrite d11/f5a [131072,73728] 0 2024-05-06T14:04:07.991 INFO:tasks.workunit.client.1.smithi174.stdout:1/264: rename fc to d11/d1f/f65 0 2024-05-06T14:04:07.992 INFO:tasks.workunit.client.1.smithi174.stdout:7/276: sync 2024-05-06T14:04:07.992 INFO:tasks.workunit.client.1.smithi174.stdout:4/317: sync 2024-05-06T14:04:07.992 INFO:tasks.workunit.client.1.smithi174.stdout:4/318: dread d1/d48/d5a/d61/f63 [401408,32768] 0 2024-05-06T14:04:08.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:08.013+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:08.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:08.013+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-05-06T14:04:08.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:08.014+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:08.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:08.014+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-05-06T14:04:08.065 INFO:tasks.workunit.client.1.smithi174.stdout:2/328: dwrite d0/d1/d2/d4/d6/fe [151552,118784] 0 2024-05-06T14:04:08.065 INFO:tasks.workunit.client.1.smithi174.stdout:2/329: mknod d0/d16/c63 0 2024-05-06T14:04:08.066 INFO:tasks.workunit.client.1.smithi174.stdout:6/409: dwrite d0/df/f5e [1642496,24576] 0 2024-05-06T14:04:08.066 INFO:tasks.workunit.client.1.smithi174.stdout:6/410: chown d0/df/d3c/d7a 0 1 2024-05-06T14:04:08.066 INFO:tasks.workunit.client.1.smithi174.stdout:6/411: rename d0/df/l13 to d0/d25/d52/d4c/l8e 0 2024-05-06T14:04:08.067 INFO:tasks.workunit.client.1.smithi174.stdout:7/277: dwrite d0/da/d19/d24/d47/f56 [110592,81920] 0 2024-05-06T14:04:08.067 INFO:tasks.workunit.client.1.smithi174.stdout:7/278: dread d0/da/d19/d24/d14/d52/f3e [229376,24576] 0 2024-05-06T14:04:08.067 INFO:tasks.workunit.client.1.smithi174.stdout:7/279: dread d0/da/d28/f4d [40960,53248] 0 2024-05-06T14:04:08.068 INFO:tasks.workunit.client.1.smithi174.stdout:7/280: rename d0/l26 to d0/d1d/l5f 0 2024-05-06T14:04:08.068 INFO:tasks.workunit.client.1.smithi174.stdout:5/331: dwrite d1/d6/f18 [1773568,65536] 0 2024-05-06T14:04:08.068 INFO:tasks.workunit.client.1.smithi174.stdout:1/265: dwrite d11/d1f/d27/d2d/f31 [3112960,114688] 0 2024-05-06T14:04:08.068 INFO:tasks.workunit.client.1.smithi174.stdout:1/266: rename d11/d1f/f65 to d11/d41/f66 0 2024-05-06T14:04:08.068 INFO:tasks.workunit.client.1.smithi174.stdout:1/267: truncate f5 1253133 0 2024-05-06T14:04:08.116 INFO:tasks.workunit.client.1.smithi174.stdout:5/332: dwrite d1/d6/df/d35/d3a/de/f63 [1024000,36864] 0 2024-05-06T14:04:08.116 INFO:tasks.workunit.client.1.smithi174.stdout:5/333: write d1/d6/f4a [660140,122460] 0 2024-05-06T14:04:08.121 INFO:tasks.workunit.client.1.smithi174.stdout:7/281: dwrite d0/f34 [2289664,65536] 0 2024-05-06T14:04:08.121 INFO:tasks.workunit.client.1.smithi174.stdout:6/412: dread d0/d25/d35/f4d [16384,73728] 0 2024-05-06T14:04:08.121 INFO:tasks.workunit.client.1.smithi174.stdout:7/282: creat d0/da/d28/d37/f60 x:0 0 0 2024-05-06T14:04:08.121 INFO:tasks.workunit.client.1.smithi174.stdout:6/413: mknod d0/d25/d52/d3b/c8f 0 2024-05-06T14:04:08.121 INFO:tasks.workunit.client.1.smithi174.stdout:7/283: read d0/da/d19/d24/f10 [3274053,74714] 0 2024-05-06T14:04:08.122 INFO:tasks.workunit.client.1.smithi174.stdout:7/284: rename d0/da to d0/d1d/d41/d61 0 2024-05-06T14:04:08.122 INFO:tasks.workunit.client.1.smithi174.stdout:6/414: write d0/d25/d52/d2c/f69 [702318,44874] 0 2024-05-06T14:04:08.123 INFO:tasks.workunit.client.1.smithi174.stdout:5/334: dwrite d1/d6/d7/f44 [487424,102400] 0 2024-05-06T14:04:08.123 INFO:tasks.workunit.client.1.smithi174.stdout:5/335: symlink d1/d6/d7/d36/d53/l76 0 2024-05-06T14:04:08.123 INFO:tasks.workunit.client.1.smithi174.stdout:5/336: link d1/d6/d7/d36/f2c d1/d6/d7/d3e/f77 0 2024-05-06T14:04:08.123 INFO:tasks.workunit.client.1.smithi174.stdout:5/337: link d1/d6/df/d35/d3a/db/l71 d1/d6/d7/l78 0 2024-05-06T14:04:08.123 INFO:tasks.workunit.client.1.smithi174.stdout:5/338: creat d1/d6/df/f79 x:0 0 0 2024-05-06T14:04:08.123 INFO:tasks.workunit.client.1.smithi174.stdout:6/415: dwrite d0/df/f6e [651264,61440] 0 2024-05-06T14:04:08.123 INFO:tasks.workunit.client.1.smithi174.stdout:6/416: mknod d0/d25/d52/d4c/c90 0 2024-05-06T14:04:08.224 INFO:tasks.workunit.client.1.smithi174.stdout:6/417: dwrite d0/d25/f30 [274432,126976] 0 2024-05-06T14:04:08.224 INFO:tasks.workunit.client.1.smithi174.stdout:6/418: link d0/df/d3c/f75 d0/df/d3c/f91 0 2024-05-06T14:04:08.224 INFO:tasks.workunit.client.1.smithi174.stdout:6/419: read - d0/d25/d52/d2c/d6f/f71 zero size 2024-05-06T14:04:08.228 INFO:tasks.workunit.client.1.smithi174.stdout:3/342: sync 2024-05-06T14:04:08.228 INFO:tasks.workunit.client.1.smithi174.stdout:3/343: creat df/d2d/f6e x:0 0 0 2024-05-06T14:04:08.228 INFO:tasks.workunit.client.1.smithi174.stdout:3/344: dread - df/d10/d1b/f56 zero size 2024-05-06T14:04:08.228 INFO:tasks.workunit.client.1.smithi174.stdout:3/345: mknod df/d2d/d4b/d5a/c6f 0 2024-05-06T14:04:08.228 INFO:tasks.workunit.client.1.smithi174.stdout:3/346: symlink df/d2d/d4b/l70 0 2024-05-06T14:04:08.228 INFO:tasks.workunit.client.1.smithi174.stdout:3/347: read - df/d10/f52 zero size 2024-05-06T14:04:08.228 INFO:tasks.workunit.client.1.smithi174.stdout:5/339: dwrite d1/d6/df/d35/d3a/de/f63 [1646592,114688] 0 2024-05-06T14:04:08.229 INFO:tasks.workunit.client.1.smithi174.stdout:5/340: getdents d1/d6/d7/d3e/d4c 0 2024-05-06T14:04:08.229 INFO:tasks.workunit.client.1.smithi174.stdout:5/341: chown d1/d6/df/d35/d3a/de/f5d 187 1 2024-05-06T14:04:08.229 INFO:tasks.workunit.client.1.smithi174.stdout:5/342: rmdir d1/d6/df 39 2024-05-06T14:04:08.229 INFO:tasks.workunit.client.1.smithi174.stdout:6/420: dread d0/d25/f40 [405504,106496] 0 2024-05-06T14:04:08.229 INFO:tasks.workunit.client.1.smithi174.stdout:6/421: chown d0/d25/d52/l4a 81289176 1 2024-05-06T14:04:08.229 INFO:tasks.workunit.client.1.smithi174.stdout:6/422: mkdir d0/df/d3c/d7a/d92 0 2024-05-06T14:04:08.229 INFO:tasks.workunit.client.1.smithi174.stdout:6/423: mkdir d0/d93 0 2024-05-06T14:04:08.230 INFO:tasks.workunit.client.1.smithi174.stdout:6/424: dread - d0/d25/d52/d2c/f6a zero size 2024-05-06T14:04:08.230 INFO:tasks.workunit.client.1.smithi174.stdout:6/425: write d0/d25/f40 [126654,586] 0 2024-05-06T14:04:08.230 INFO:tasks.workunit.client.1.smithi174.stdout:6/426: chown d0/c2a 234457 1 2024-05-06T14:04:08.230 INFO:tasks.workunit.client.1.smithi174.stdout:6/427: rename d0/d25/d52/d4c/l8e to d0/df/d3c/d7a/l94 0 2024-05-06T14:04:08.230 INFO:tasks.workunit.client.1.smithi174.stdout:6/428: read d0/d25/d52/d2c/f37 [1088255,99068] 0 2024-05-06T14:04:08.230 INFO:tasks.workunit.client.1.smithi174.stdout:6/429: unlink d0/df/l84 0 2024-05-06T14:04:08.230 INFO:tasks.workunit.client.1.smithi174.stdout:6/430: write d0/df/f29 [1439687,115409] 0 2024-05-06T14:04:08.258 INFO:tasks.workunit.client.1.smithi174.stdout:7/285: fdatasync d0/d1d/d41/d61/d28/d37/f40 0 2024-05-06T14:04:08.258 INFO:tasks.workunit.client.1.smithi174.stdout:7/286: creat d0/d1d/d41/d61/d28/f62 x:0 0 0 2024-05-06T14:04:08.258 INFO:tasks.workunit.client.1.smithi174.stdout:3/348: fdatasync df/d2d/d4b/d57/f5d 0 2024-05-06T14:04:08.259 INFO:tasks.workunit.client.1.smithi174.stdout:5/343: dwrite d1/d6/df/f79 [393216,28672] 0 2024-05-06T14:04:08.260 INFO:tasks.workunit.client.1.smithi174.stdout:3/349: write df/d2d/f38 [1632530,1451] 0 2024-05-06T14:04:08.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/431: dwrite d0/f7c [1581056,36864] 0 2024-05-06T14:04:08.260 INFO:tasks.workunit.client.1.smithi174.stdout:3/350: dread - df/d2d/f42 zero size 2024-05-06T14:04:08.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/432: rename d0/f15 to d0/d25/d52/d3b/f95 0 2024-05-06T14:04:08.260 INFO:tasks.workunit.client.1.smithi174.stdout:5/344: write d1/d6/df/d35/d3a/de/f63 [366722,54154] 0 2024-05-06T14:04:08.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/433: truncate d0/d25/f40 710229 0 2024-05-06T14:04:08.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/434: dread d0/df/d45/f47 [819200,45056] 0 2024-05-06T14:04:08.260 INFO:tasks.workunit.client.1.smithi174.stdout:6/435: dread d0/df/f14 [73728,45056] 0 2024-05-06T14:04:08.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/436: symlink d0/d25/d52/d2c/d5f/l96 0 2024-05-06T14:04:08.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/437: dread - d0/f7f zero size 2024-05-06T14:04:08.261 INFO:tasks.workunit.client.1.smithi174.stdout:7/287: dwrite d0/f2e [815104,77824] 0 2024-05-06T14:04:08.293 INFO:tasks.workunit.client.1.smithi174.stdout:5/345: dwrite d1/d6/f34 [2416640,122880] 0 2024-05-06T14:04:08.294 INFO:tasks.workunit.client.1.smithi174.stdout:5/346: rmdir d1/d6/df/d35/d3a/de/d6b 39 2024-05-06T14:04:08.344 INFO:tasks.workunit.client.1.smithi174.stdout:7/288: fdatasync d0/d1d/d41/d61/d19/f32 0 2024-05-06T14:04:08.347 INFO:tasks.workunit.client.1.smithi174.stdout:5/347: creat d1/d6/d7/d36/d53/d59/f7a x:0 0 0 2024-05-06T14:04:08.347 INFO:tasks.workunit.client.1.smithi174.stdout:5/348: chown d1/d6/df 10 1 2024-05-06T14:04:08.348 INFO:tasks.workunit.client.1.smithi174.stdout:5/349: rmdir d1/d6/df/d35/d3a/de/d6b 39 2024-05-06T14:04:08.348 INFO:tasks.workunit.client.1.smithi174.stdout:6/438: dread d0/d25/d52/d2c/f69 [688128,90112] 0 2024-05-06T14:04:08.348 INFO:tasks.workunit.client.1.smithi174.stdout:5/350: chown d1/d6/d2a/c32 1011908483 1 2024-05-06T14:04:08.348 INFO:tasks.workunit.client.1.smithi174.stdout:5/351: write d1/d6/df/d35/d3a/de/d6b/f6f [596089,74861] 0 2024-05-06T14:04:08.403 INFO:tasks.workunit.client.1.smithi174.stdout:7/289: fdatasync d0/d1d/d41/d61/d19/d24/f48 0 2024-05-06T14:04:08.404 INFO:tasks.workunit.client.1.smithi174.stdout:5/352: rename d1/d6/df/d35/d3a/db/d60/f64 to d1/d6/df/d35/d3a/d41/f7b 0 2024-05-06T14:04:08.404 INFO:tasks.workunit.client.1.smithi174.stdout:7/290: mkdir d0/d1d/d41/d61/d19/d24/d47/d63 0 2024-05-06T14:04:08.405 INFO:tasks.workunit.client.1.smithi174.stdout:6/439: symlink d0/d25/d52/d2c/d6f/l97 0 2024-05-06T14:04:08.405 INFO:tasks.workunit.client.1.smithi174.stdout:5/353: truncate d1/d6/df/d35/d3a/de/f63 458162 0 2024-05-06T14:04:08.405 INFO:tasks.workunit.client.1.smithi174.stdout:6/440: unlink d0/df/d45/l5b 0 2024-05-06T14:04:08.405 INFO:tasks.workunit.client.1.smithi174.stdout:6/441: readlink d0/l11 0 2024-05-06T14:04:08.405 INFO:tasks.workunit.client.1.smithi174.stdout:6/442: write d0/df/d3c/f91 [85894,28942] 0 2024-05-06T14:04:08.407 INFO:tasks.workunit.client.1.smithi174.stdout:5/354: read d1/d6/df/d35/d3a/db/f1b [164249,29219] 0 2024-05-06T14:04:08.407 INFO:tasks.workunit.client.1.smithi174.stdout:5/355: rmdir d1/d6/df/d35/d3a 39 2024-05-06T14:04:08.407 INFO:tasks.workunit.client.1.smithi174.stdout:5/356: read d1/f45 [307790,55892] 0 2024-05-06T14:04:08.407 INFO:tasks.workunit.client.1.smithi174.stdout:5/357: mkdir d1/d6/d7/d3e/d4c/d7c 0 2024-05-06T14:04:08.408 INFO:tasks.workunit.client.1.smithi174.stdout:6/443: dwrite d0/df/d45/d4b/f82 [843776,53248] 0 2024-05-06T14:04:08.408 INFO:tasks.workunit.client.1.smithi174.stdout:6/444: creat d0/d25/f98 x:0 0 0 2024-05-06T14:04:08.416 INFO:tasks.workunit.client.1.smithi174.stdout:7/291: dread d0/f2e [495616,12288] 0 2024-05-06T14:04:08.416 INFO:tasks.workunit.client.1.smithi174.stdout:7/292: write d0/d1d/d41/d61/d19/d39/d46/f58 [1057679,118407] 0 2024-05-06T14:04:08.417 INFO:tasks.workunit.client.1.smithi174.stdout:7/293: write d0/f34 [3580794,43381] 0 2024-05-06T14:04:08.480 INFO:tasks.workunit.client.1.smithi174.stdout:8/411: sync 2024-05-06T14:04:08.480 INFO:tasks.workunit.client.1.smithi174.stdout:2/330: sync 2024-05-06T14:04:08.480 INFO:tasks.workunit.client.1.smithi174.stdout:4/319: sync 2024-05-06T14:04:08.480 INFO:tasks.workunit.client.1.smithi174.stdout:0/276: sync 2024-05-06T14:04:08.480 INFO:tasks.workunit.client.1.smithi174.stdout:4/320: chown d1/d1f/d27/f7a 6089 1 2024-05-06T14:04:08.480 INFO:tasks.workunit.client.1.smithi174.stdout:9/347: sync 2024-05-06T14:04:08.481 INFO:tasks.workunit.client.1.smithi174.stdout:1/268: sync 2024-05-06T14:04:08.481 INFO:tasks.workunit.client.1.smithi174.stdout:4/321: dread - d1/d9/d15/f4e zero size 2024-05-06T14:04:08.481 INFO:tasks.workunit.client.1.smithi174.stdout:4/322: dread - d1/d1f/d27/d2c/f3f zero size 2024-05-06T14:04:08.481 INFO:tasks.workunit.client.1.smithi174.stdout:2/331: creat d0/d1/d2/d4/d18/f64 x:0 0 0 2024-05-06T14:04:08.481 INFO:tasks.workunit.client.1.smithi174.stdout:4/323: stat d1/d9/f42 0 2024-05-06T14:04:08.481 INFO:tasks.workunit.client.1.smithi174.stdout:0/277: rename d0/d3/dc to d0/d4/d8/d25/d5c 0 2024-05-06T14:04:08.481 INFO:tasks.workunit.client.1.smithi174.stdout:2/332: dread - d0/d16/f5f zero size 2024-05-06T14:04:08.481 INFO:tasks.workunit.client.1.smithi174.stdout:8/412: write d4/d15/f4d [1337316,45253] 0 2024-05-06T14:04:08.482 INFO:tasks.workunit.client.1.smithi174.stdout:0/278: rename d0/d4/d8/d25/d32 to d0/d3/d5d 0 2024-05-06T14:04:08.482 INFO:tasks.workunit.client.1.smithi174.stdout:9/348: mkdir dc/d14/d78 0 2024-05-06T14:04:08.482 INFO:tasks.workunit.client.1.smithi174.stdout:2/333: creat d0/d24/f65 x:0 0 0 2024-05-06T14:04:08.482 INFO:tasks.workunit.client.1.smithi174.stdout:1/269: mkdir d11/d67 0 2024-05-06T14:04:08.482 INFO:tasks.workunit.client.1.smithi174.stdout:8/413: creat d4/d15/d64/f84 x:0 0 0 2024-05-06T14:04:08.482 INFO:tasks.workunit.client.1.smithi174.stdout:1/270: mknod d11/d1f/d55/c68 0 2024-05-06T14:04:08.482 INFO:tasks.workunit.client.1.smithi174.stdout:0/279: mkdir d0/d36/d3f/d5e 0 2024-05-06T14:04:08.482 INFO:tasks.workunit.client.1.smithi174.stdout:7/294: dwrite d0/d1d/d41/d61/d19/f5b [1044480,57344] 0 2024-05-06T14:04:08.483 INFO:tasks.workunit.client.1.smithi174.stdout:0/280: link d0/d1a/d17/d2e/f3c d0/d1a/d17/d2e/f5f 0 2024-05-06T14:04:08.483 INFO:tasks.workunit.client.1.smithi174.stdout:1/271: read d11/d1f/d27/f2b [539829,83301] 0 2024-05-06T14:04:08.483 INFO:tasks.workunit.client.1.smithi174.stdout:0/281: write d0/d4/d8/d25/d5c/d44/f46 [852417,81265] 0 2024-05-06T14:04:08.483 INFO:tasks.workunit.client.1.smithi174.stdout:1/272: write d11/d1f/d27/d2d/f52 [512432,1562] 0 2024-05-06T14:04:08.483 INFO:tasks.workunit.client.1.smithi174.stdout:7/295: write d0/d1d/d41/d61/d28/d59/f4c [842,76635] 0 2024-05-06T14:04:08.483 INFO:tasks.workunit.client.1.smithi174.stdout:9/349: write dc/de/f26 [1448630,119588] 0 2024-05-06T14:04:08.483 INFO:tasks.workunit.client.1.smithi174.stdout:0/282: creat d0/d4/d8/d25/d5c/d4a/f60 x:0 0 0 2024-05-06T14:04:08.483 INFO:tasks.workunit.client.1.smithi174.stdout:7/296: unlink d0/d1d/d41/d61/l25 0 2024-05-06T14:04:08.484 INFO:tasks.workunit.client.1.smithi174.stdout:0/283: rename d0/d4/d8/d25/d5c/d44/c52 to d0/d1a/d17/d2e/d58/c61 0 2024-05-06T14:04:08.484 INFO:tasks.workunit.client.1.smithi174.stdout:2/334: write d0/d24/f65 [918836,122589] 0 2024-05-06T14:04:08.484 INFO:tasks.workunit.client.1.smithi174.stdout:7/297: write d0/f6 [1806465,36658] 0 2024-05-06T14:04:08.484 INFO:tasks.workunit.client.1.smithi174.stdout:0/284: truncate d0/d1a/f1b 203145 0 2024-05-06T14:04:08.484 INFO:tasks.workunit.client.1.smithi174.stdout:9/350: write dc/d27/d60/f69 [89183,110666] 0 2024-05-06T14:04:08.484 INFO:tasks.workunit.client.1.smithi174.stdout:7/298: unlink d0/d1d/d41/d61/d28/d37/f42 0 2024-05-06T14:04:08.484 INFO:tasks.workunit.client.1.smithi174.stdout:2/335: write d0/d1/d2/d4/d51/f5a [937919,107122] 0 2024-05-06T14:04:08.484 INFO:tasks.workunit.client.1.smithi174.stdout:9/351: mknod dc/d27/c79 0 2024-05-06T14:04:08.485 INFO:tasks.workunit.client.1.smithi174.stdout:7/299: rename d0/d1d/d41/d61/d19/d24/d47/d63 to d0/d1d/d41/d61/d19/d24/d47/d64 0 2024-05-06T14:04:08.485 INFO:tasks.workunit.client.1.smithi174.stdout:2/336: rename d0/da/f34 to d0/d1/d2/d4/d43/f66 0 2024-05-06T14:04:08.485 INFO:tasks.workunit.client.1.smithi174.stdout:7/300: write d0/d1d/d41/d61/d19/d24/d47/f5e [445739,83216] 0 2024-05-06T14:04:08.485 INFO:tasks.workunit.client.1.smithi174.stdout:7/301: rename d0/d1d/d41/d61/d19/c2f to d0/c65 0 2024-05-06T14:04:08.485 INFO:tasks.workunit.client.1.smithi174.stdout:2/337: truncate d0/db/d15/f30 591405 0 2024-05-06T14:04:08.485 INFO:tasks.workunit.client.1.smithi174.stdout:7/302: link d0/d1d/d41/d61/d19/d24/d14/d52/l12 d0/d1d/d41/d61/d28/l66 0 2024-05-06T14:04:08.485 INFO:tasks.workunit.client.1.smithi174.stdout:2/338: getdents d0/d1/d2/d4/d43 0 2024-05-06T14:04:08.514 INFO:tasks.workunit.client.1.smithi174.stdout:5/358: fdatasync d1/d6/d7/d36/f47 0 2024-05-06T14:04:08.515 INFO:tasks.workunit.client.1.smithi174.stdout:5/359: link d1/d6/d7/d3e/d4c/f55 d1/d6/d7/d36/d53/d59/d61/d69/f7d 0 2024-05-06T14:04:08.515 INFO:tasks.workunit.client.1.smithi174.stdout:8/414: fsync d4/de/f12 0 2024-05-06T14:04:08.515 INFO:tasks.workunit.client.1.smithi174.stdout:8/415: truncate d4/f35 2473930 0 2024-05-06T14:04:08.515 INFO:tasks.workunit.client.1.smithi174.stdout:8/416: mkdir d4/de/d24/d5e/d85 0 2024-05-06T14:04:08.515 INFO:tasks.workunit.client.1.smithi174.stdout:8/417: creat d4/de/d23/d41/d4e/f86 x:0 0 0 2024-05-06T14:04:08.515 INFO:tasks.workunit.client.1.smithi174.stdout:8/418: symlink d4/de/d24/d46/l87 0 2024-05-06T14:04:08.515 INFO:tasks.workunit.client.1.smithi174.stdout:8/419: mknod d4/de/d24/c88 0 2024-05-06T14:04:08.516 INFO:tasks.workunit.client.1.smithi174.stdout:8/420: unlink d4/f6e 0 2024-05-06T14:04:08.516 INFO:tasks.workunit.client.1.smithi174.stdout:4/324: dwrite d1/d1f/d27/d3e/f70 [704512,77824] 0 2024-05-06T14:04:08.516 INFO:tasks.workunit.client.1.smithi174.stdout:4/325: link d1/d1f/d27/d3e/f4f d1/d48/d5a/d61/d68/f7d 0 2024-05-06T14:04:08.516 INFO:tasks.workunit.client.1.smithi174.stdout:4/326: symlink d1/d48/d5a/d61/d68/l7e 0 2024-05-06T14:04:08.516 INFO:tasks.workunit.client.1.smithi174.stdout:4/327: write d1/d1f/d27/f38 [94476,186] 0 2024-05-06T14:04:08.516 INFO:tasks.workunit.client.1.smithi174.stdout:4/328: truncate d1/d9/d53/f69 1378877 0 2024-05-06T14:04:08.516 INFO:tasks.workunit.client.1.smithi174.stdout:4/329: mkdir d1/d48/d7f 0 2024-05-06T14:04:08.516 INFO:tasks.workunit.client.1.smithi174.stdout:4/330: rename d1/d9/d15/l73 to d1/d48/l80 0 2024-05-06T14:04:08.517 INFO:tasks.workunit.client.1.smithi174.stdout:4/331: truncate d1/d48/d5a/d61/d68/f7d 895116 0 2024-05-06T14:04:08.517 INFO:tasks.workunit.client.1.smithi174.stdout:4/332: creat d1/d48/d5a/d61/d68/f81 x:0 0 0 2024-05-06T14:04:08.517 INFO:tasks.workunit.client.1.smithi174.stdout:1/273: dwrite d11/d1f/d27/d32/f59 [823296,90112] 0 2024-05-06T14:04:08.518 INFO:tasks.workunit.client.1.smithi174.stdout:4/333: dwrite d1/d48/d5a/d61/d68/f81 [741376,118784] 0 2024-05-06T14:04:08.518 INFO:tasks.workunit.client.1.smithi174.stdout:4/334: chown d1/d2e/l4b 5122 1 2024-05-06T14:04:08.518 INFO:tasks.workunit.client.1.smithi174.stdout:4/335: write d1/f19 [778731,116037] 0 2024-05-06T14:04:08.518 INFO:tasks.workunit.client.1.smithi174.stdout:4/336: read d1/d9/f2b [228236,66177] 0 2024-05-06T14:04:08.519 INFO:tasks.workunit.client.1.smithi174.stdout:1/274: dwrite d11/d1f/d27/d32/f4e [733184,40960] 0 2024-05-06T14:04:08.519 INFO:tasks.workunit.client.1.smithi174.stdout:4/337: write d1/f19 [1316830,130661] 0 2024-05-06T14:04:08.558 INFO:tasks.workunit.client.1.smithi174.stdout:5/360: fdatasync d1/d6/f9 0 2024-05-06T14:04:08.560 INFO:tasks.workunit.client.1.smithi174.stdout:8/421: fdatasync d4/de/d24/d5e/f83 0 2024-05-06T14:04:08.560 INFO:tasks.workunit.client.1.smithi174.stdout:8/422: symlink d4/d53/l89 0 2024-05-06T14:04:08.560 INFO:tasks.workunit.client.1.smithi174.stdout:1/275: link d11/d1f/d27/d32/f4b d11/d57/f69 0 2024-05-06T14:04:08.561 INFO:tasks.workunit.client.1.smithi174.stdout:5/361: creat d1/d6/d7/d36/d53/d59/d61/f7e x:0 0 0 2024-05-06T14:04:08.561 INFO:tasks.workunit.client.1.smithi174.stdout:8/423: mknod d4/de/d23/d41/d4e/c8a 0 2024-05-06T14:04:08.561 INFO:tasks.workunit.client.1.smithi174.stdout:5/362: creat d1/d6/d7/d36/f7f x:0 0 0 2024-05-06T14:04:08.561 INFO:tasks.workunit.client.1.smithi174.stdout:4/338: write d1/d9/d15/f6d [1587450,26900] 0 2024-05-06T14:04:08.561 INFO:tasks.workunit.client.1.smithi174.stdout:8/424: truncate d4/de/d23/d41/d56/f7e 960983 0 2024-05-06T14:04:08.561 INFO:tasks.workunit.client.1.smithi174.stdout:1/276: creat d11/d1f/d27/f6a x:0 0 0 2024-05-06T14:04:08.561 INFO:tasks.workunit.client.1.smithi174.stdout:4/339: getdents d1/d9/d53 0 2024-05-06T14:04:08.561 INFO:tasks.workunit.client.1.smithi174.stdout:5/363: unlink d1/d6/df/d35/d3a/d41/f7b 0 2024-05-06T14:04:08.562 INFO:tasks.workunit.client.1.smithi174.stdout:5/364: creat d1/d6/df/d35/d3a/de/f80 x:0 0 0 2024-05-06T14:04:08.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/425: truncate d4/de/f17 2409275 0 2024-05-06T14:04:08.562 INFO:tasks.workunit.client.1.smithi174.stdout:4/340: mknod d1/d9/c82 0 2024-05-06T14:04:08.562 INFO:tasks.workunit.client.1.smithi174.stdout:5/365: rename d1/d6/df/d35/d3a/db to d1/d6/df/d35/d81 0 2024-05-06T14:04:08.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/426: unlink d4/l36 0 2024-05-06T14:04:08.562 INFO:tasks.workunit.client.1.smithi174.stdout:4/341: creat d1/d9/d15/d41/f83 x:0 0 0 2024-05-06T14:04:08.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/427: symlink d4/d15/d66/l8b 0 2024-05-06T14:04:08.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/428: dread d4/de/d23/f32 [65536,28672] 0 2024-05-06T14:04:08.588 INFO:tasks.workunit.client.1.smithi174.stdout:4/342: dwrite d1/d2e/f6a [393216,36864] 0 2024-05-06T14:04:08.588 INFO:tasks.workunit.client.1.smithi174.stdout:4/343: mkdir d1/d1f/d27/d84 0 2024-05-06T14:04:08.588 INFO:tasks.workunit.client.1.smithi174.stdout:4/344: chown d1/d1f/d27/d3e 4854 1 2024-05-06T14:04:08.593 INFO:tasks.workunit.client.1.smithi174.stdout:1/277: write d11/f19 [398191,78987] 0 2024-05-06T14:04:08.594 INFO:tasks.workunit.client.1.smithi174.stdout:1/278: chown d11/d41/d4a/f56 4 1 2024-05-06T14:04:08.594 INFO:tasks.workunit.client.1.smithi174.stdout:1/279: creat d11/d1f/d27/d32/f6b x:0 0 0 2024-05-06T14:04:08.594 INFO:tasks.workunit.client.1.smithi174.stdout:1/280: mkdir d11/d67/d6c 0 2024-05-06T14:04:08.594 INFO:tasks.workunit.client.1.smithi174.stdout:1/281: dread - d11/d41/d4a/f56 zero size 2024-05-06T14:04:08.632 INFO:tasks.workunit.client.1.smithi174.stdout:8/429: fsync d4/d15/f1e 0 2024-05-06T14:04:08.633 INFO:tasks.workunit.client.1.smithi174.stdout:0/285: fsync d0/d4/d8/d25/d5c/d4a/f60 0 2024-05-06T14:04:08.633 INFO:tasks.workunit.client.1.smithi174.stdout:6/445: fdatasync d0/d25/f98 0 2024-05-06T14:04:08.633 INFO:tasks.workunit.client.1.smithi174.stdout:8/430: write d4/d15/d20/d3e/f54 [650667,81806] 0 2024-05-06T14:04:08.633 INFO:tasks.workunit.client.1.smithi174.stdout:6/446: rmdir d0/d81 0 2024-05-06T14:04:08.633 INFO:tasks.workunit.client.1.smithi174.stdout:8/431: truncate d4/d15/d20/d3e/f62 1071416 0 2024-05-06T14:04:08.633 INFO:tasks.workunit.client.1.smithi174.stdout:0/286: write d0/d4/d8/d25/d5c/d44/f46 [840934,61390] 0 2024-05-06T14:04:08.633 INFO:tasks.workunit.client.1.smithi174.stdout:8/432: chown d4/de/c38 6214051 1 2024-05-06T14:04:08.634 INFO:tasks.workunit.client.1.smithi174.stdout:6/447: chown d0/d25/d52/d2c/d5f/c77 232 1 2024-05-06T14:04:08.634 INFO:tasks.workunit.client.1.smithi174.stdout:6/448: dread - d0/d25/d35/f87 zero size 2024-05-06T14:04:08.634 INFO:tasks.workunit.client.1.smithi174.stdout:0/287: write d0/fa [826912,110012] 0 2024-05-06T14:04:08.634 INFO:tasks.workunit.client.1.smithi174.stdout:4/345: fsync d1/d9/f18 0 2024-05-06T14:04:08.634 INFO:tasks.workunit.client.1.smithi174.stdout:4/346: chown d1/d1f/d27/d3e/d6e/d50/f5c 0 1 2024-05-06T14:04:08.637 INFO:tasks.workunit.client.1.smithi174.stdout:6/449: creat d0/d25/d52/d2c/d6f/f99 x:0 0 0 2024-05-06T14:04:08.637 INFO:tasks.workunit.client.1.smithi174.stdout:0/288: creat d0/d36/d3f/d5e/f62 x:0 0 0 2024-05-06T14:04:08.638 INFO:tasks.workunit.client.1.smithi174.stdout:0/289: dread - d0/d1a/d17/d2e/f3c zero size 2024-05-06T14:04:08.638 INFO:tasks.workunit.client.1.smithi174.stdout:1/282: write d11/f22 [1461182,120307] 0 2024-05-06T14:04:08.638 INFO:tasks.workunit.client.1.smithi174.stdout:0/290: truncate d0/d36/d3f/d5e/f62 38949 0 2024-05-06T14:04:08.638 INFO:tasks.workunit.client.1.smithi174.stdout:6/450: symlink d0/df/d45/d56/l9a 0 2024-05-06T14:04:08.638 INFO:tasks.workunit.client.1.smithi174.stdout:1/283: symlink d11/d1f/d55/l6d 0 2024-05-06T14:04:08.638 INFO:tasks.workunit.client.1.smithi174.stdout:1/284: rename d11/c3b to d11/d41/d51/c6e 0 2024-05-06T14:04:08.638 INFO:tasks.workunit.client.1.smithi174.stdout:1/285: creat d11/d41/d4a/d5e/f6f x:0 0 0 2024-05-06T14:04:08.640 INFO:tasks.workunit.client.1.smithi174.stdout:8/433: dwrite d4/de/d23/d3c/f59 [958464,61440] 0 2024-05-06T14:04:08.640 INFO:tasks.workunit.client.1.smithi174.stdout:8/434: dread d4/de/d23/d41/f4c [364544,45056] 0 2024-05-06T14:04:08.640 INFO:tasks.workunit.client.1.smithi174.stdout:4/347: dwrite d1/d1f/d27/d2c/f3f [241664,90112] 0 2024-05-06T14:04:08.640 INFO:tasks.workunit.client.1.smithi174.stdout:4/348: dread - d1/d9/d15/d41/f83 zero size 2024-05-06T14:04:08.640 INFO:tasks.workunit.client.1.smithi174.stdout:4/349: write d1/d9/d15/f4e [185493,81213] 0 2024-05-06T14:04:08.640 INFO:tasks.workunit.client.1.smithi174.stdout:6/451: dwrite d0/d25/f98 [958464,61440] 0 2024-05-06T14:04:08.641 INFO:tasks.workunit.client.1.smithi174.stdout:6/452: write d0/d25/d35/f87 [423284,112383] 0 2024-05-06T14:04:08.641 INFO:tasks.workunit.client.1.smithi174.stdout:6/453: dread d0/df/f6e [196608,65536] 0 2024-05-06T14:04:08.641 INFO:tasks.workunit.client.1.smithi174.stdout:1/286: dwrite d11/d41/f60 [147456,32768] 0 2024-05-06T14:04:08.717 INFO:tasks.workunit.client.1.smithi174.stdout:8/435: mknod d4/d15/d20/d3e/c8c 0 2024-05-06T14:04:08.718 INFO:tasks.workunit.client.1.smithi174.stdout:8/436: getdents d4/de/d23/d41/d4e 0 2024-05-06T14:04:08.718 INFO:tasks.workunit.client.1.smithi174.stdout:1/287: write d11/f3c [924123,77620] 0 2024-05-06T14:04:08.718 INFO:tasks.workunit.client.1.smithi174.stdout:1/288: creat d11/d67/f70 x:0 0 0 2024-05-06T14:04:08.718 INFO:tasks.workunit.client.1.smithi174.stdout:1/289: creat d11/d1f/d27/d32/f71 x:0 0 0 2024-05-06T14:04:08.758 INFO:tasks.workunit.client.1.smithi174.stdout:0/291: fsync d0/d1a/d17/d2e/f3e 0 2024-05-06T14:04:08.758 INFO:tasks.workunit.client.1.smithi174.stdout:6/454: dwrite d0/df/f14 [782336,61440] 0 2024-05-06T14:04:08.759 INFO:tasks.workunit.client.1.smithi174.stdout:6/455: read - d0/d25/d52/d2c/d6f/f71 zero size 2024-05-06T14:04:08.762 INFO:tasks.workunit.client.1.smithi174.stdout:0/292: creat d0/d4/d8/d25/f63 x:0 0 0 2024-05-06T14:04:08.763 INFO:tasks.workunit.client.1.smithi174.stdout:3/351: sync 2024-05-06T14:04:08.763 INFO:tasks.workunit.client.1.smithi174.stdout:3/352: unlink df/d2d/l35 0 2024-05-06T14:04:08.763 INFO:tasks.workunit.client.1.smithi174.stdout:3/353: dread df/d10/f19 [184320,4096] 0 2024-05-06T14:04:08.773 INFO:tasks.workunit.client.1.smithi174.stdout:8/437: dread d4/d48/f5c [438272,73728] 0 2024-05-06T14:04:08.774 INFO:tasks.workunit.client.1.smithi174.stdout:0/293: dwrite d0/d3/f29 [12288,94208] 0 2024-05-06T14:04:08.774 INFO:tasks.workunit.client.1.smithi174.stdout:0/294: chown d0/d4/d8/d25/d5c/d44/l50 0 1 2024-05-06T14:04:08.774 INFO:tasks.workunit.client.1.smithi174.stdout:0/295: rmdir d0/d4 39 2024-05-06T14:04:08.826 INFO:tasks.workunit.client.1.smithi174.stdout:6/456: fdatasync d0/df/d3c/f8b 0 2024-05-06T14:04:08.828 INFO:tasks.workunit.client.1.smithi174.stdout:3/354: dwrite df/d2d/f6e [466944,81920] 0 2024-05-06T14:04:08.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/296: dwrite d0/d1a/f1b [1044480,110592] 0 2024-05-06T14:04:08.830 INFO:tasks.workunit.client.1.smithi174.stdout:6/457: dwrite d0/d25/f51 [1744896,65536] 0 2024-05-06T14:04:08.830 INFO:tasks.workunit.client.1.smithi174.stdout:6/458: truncate d0/df/d3c/f91 1092388 0 2024-05-06T14:04:08.830 INFO:tasks.workunit.client.1.smithi174.stdout:6/459: getdents d0/d25/d52 0 2024-05-06T14:04:08.831 INFO:tasks.workunit.client.1.smithi174.stdout:3/355: dwrite df/d10/f1c [487424,102400] 0 2024-05-06T14:04:08.909 INFO:tasks.workunit.client.1.smithi174.stdout:8/438: fdatasync d4/d53/f69 0 2024-05-06T14:04:08.910 INFO:tasks.workunit.client.1.smithi174.stdout:0/297: dwrite d0/d1a/f1e [548864,12288] 0 2024-05-06T14:04:08.911 INFO:tasks.workunit.client.1.smithi174.stdout:0/298: truncate d0/d16/f3a 846108 0 2024-05-06T14:04:08.913 INFO:tasks.workunit.client.1.smithi174.stdout:8/439: dread d4/d15/d20/d3e/f62 [958464,94208] 0 2024-05-06T14:04:08.913 INFO:tasks.workunit.client.1.smithi174.stdout:8/440: read d4/de/f17 [1739963,12229] 0 2024-05-06T14:04:08.913 INFO:tasks.workunit.client.1.smithi174.stdout:3/356: creat df/d2d/d5b/f71 x:0 0 0 2024-05-06T14:04:08.913 INFO:tasks.workunit.client.1.smithi174.stdout:3/357: chown df/d2d/d4b/d57 13 1 2024-05-06T14:04:08.913 INFO:tasks.workunit.client.1.smithi174.stdout:6/460: truncate d0/d25/d52/d2c/f37 2341008 0 2024-05-06T14:04:08.913 INFO:tasks.workunit.client.1.smithi174.stdout:3/358: mknod df/d10/d1b/c72 0 2024-05-06T14:04:08.913 INFO:tasks.workunit.client.1.smithi174.stdout:3/359: creat df/d2d/d4b/d5a/f73 x:0 0 0 2024-05-06T14:04:08.914 INFO:tasks.workunit.client.1.smithi174.stdout:6/461: rmdir d0/df/d3c/d7a/d92 0 2024-05-06T14:04:08.914 INFO:tasks.workunit.client.1.smithi174.stdout:3/360: mknod df/d10/d1b/c74 0 2024-05-06T14:04:08.914 INFO:tasks.workunit.client.1.smithi174.stdout:6/462: truncate d0/f26 967295 0 2024-05-06T14:04:08.914 INFO:tasks.workunit.client.1.smithi174.stdout:3/361: creat df/d2d/d4b/f75 x:0 0 0 2024-05-06T14:04:08.914 INFO:tasks.workunit.client.1.smithi174.stdout:3/362: write df/d2d/d4b/d5a/f73 [771489,30556] 0 2024-05-06T14:04:08.914 INFO:tasks.workunit.client.1.smithi174.stdout:6/463: write d0/df/d45/d4b/f5c [1555045,109185] 0 2024-05-06T14:04:08.914 INFO:tasks.workunit.client.1.smithi174.stdout:3/363: write df/d10/d1b/f20 [225698,69500] 0 2024-05-06T14:04:08.914 INFO:tasks.workunit.client.1.smithi174.stdout:6/464: write d0/d25/f40 [376038,41226] 0 2024-05-06T14:04:08.914 INFO:tasks.workunit.client.1.smithi174.stdout:6/465: chown d0/df/d3c/f8b 1663390 1 2024-05-06T14:04:08.915 INFO:tasks.workunit.client.1.smithi174.stdout:3/364: unlink df/d2d/d5b/f66 0 2024-05-06T14:04:08.915 INFO:tasks.workunit.client.1.smithi174.stdout:6/466: dread d0/d25/d52/d3b/f53 [159744,61440] 0 2024-05-06T14:04:08.915 INFO:tasks.workunit.client.1.smithi174.stdout:6/467: creat d0/d25/d35/f9b x:0 0 0 2024-05-06T14:04:08.915 INFO:tasks.workunit.client.1.smithi174.stdout:3/365: read df/d10/d1b/f5c [647968,129641] 0 2024-05-06T14:04:08.915 INFO:tasks.workunit.client.1.smithi174.stdout:6/468: unlink d0/d25/d52/d2c/d6f/c5a 0 2024-05-06T14:04:08.915 INFO:tasks.workunit.client.1.smithi174.stdout:6/469: readlink d0/l27 0 2024-05-06T14:04:08.915 INFO:tasks.workunit.client.1.smithi174.stdout:3/366: rename fc to df/d10/d1b/f76 0 2024-05-06T14:04:08.915 INFO:tasks.workunit.client.1.smithi174.stdout:6/470: unlink d0/d25/d52/d2c/d6f/l97 0 2024-05-06T14:04:08.916 INFO:tasks.workunit.client.1.smithi174.stdout:3/367: creat df/d2d/d4b/d5a/f77 x:0 0 0 2024-05-06T14:04:08.916 INFO:tasks.workunit.client.1.smithi174.stdout:3/368: unlink df/d10/f48 0 2024-05-06T14:04:08.925 INFO:tasks.workunit.client.1.smithi174.stdout:0/299: dread d0/d1a/d17/fe [188416,102400] 0 2024-05-06T14:04:08.984 INFO:tasks.workunit.client.1.smithi174.stdout:8/441: write d4/d15/f30 [411601,64320] 0 2024-05-06T14:04:08.984 INFO:tasks.workunit.client.1.smithi174.stdout:8/442: write d4/d48/f5c [445482,80882] 0 2024-05-06T14:04:08.984 INFO:tasks.workunit.client.1.smithi174.stdout:8/443: write d4/d15/d20/f42 [2126775,47865] 0 2024-05-06T14:04:08.984 INFO:tasks.workunit.client.1.smithi174.stdout:8/444: link d4/de/d23/d41/d4e/c4f d4/de/d24/d46/d63/c8d 0 2024-05-06T14:04:08.985 INFO:tasks.workunit.client.1.smithi174.stdout:8/445: symlink d4/de/l8e 0 2024-05-06T14:04:08.985 INFO:tasks.workunit.client.1.smithi174.stdout:8/446: rmdir d4/d15/d20/d3e/d79 39 2024-05-06T14:04:08.985 INFO:tasks.workunit.client.1.smithi174.stdout:8/447: creat d4/d15/d20/d3e/d79/d82/f8f x:0 0 0 2024-05-06T14:04:08.985 INFO:tasks.workunit.client.1.smithi174.stdout:8/448: dread d4/d15/d20/d3e/f62 [536576,16384] 0 2024-05-06T14:04:08.986 INFO:tasks.workunit.client.1.smithi174.stdout:8/449: unlink d4/de/d23/d3c/f59 0 2024-05-06T14:04:08.986 INFO:tasks.workunit.client.1.smithi174.stdout:8/450: link d4/de/d23/f78 d4/d48/f90 0 2024-05-06T14:04:08.986 INFO:tasks.workunit.client.1.smithi174.stdout:8/451: mkdir d4/de/d24/d5e/d85/d91 0 2024-05-06T14:04:08.986 INFO:tasks.workunit.client.1.smithi174.stdout:8/452: creat d4/de/d23/f92 x:0 0 0 2024-05-06T14:04:08.986 INFO:tasks.workunit.client.1.smithi174.stdout:8/453: dread d4/de/d23/d41/f4c [671744,118784] 0 2024-05-06T14:04:09.059 INFO:tasks.workunit.client.1.smithi174.stdout:6/471: fdatasync d0/f8a 0 2024-05-06T14:04:09.059 INFO:tasks.workunit.client.1.smithi174.stdout:6/472: link d0/d25/d52/d2c/d6f/f99 d0/d93/f9c 0 2024-05-06T14:04:09.059 INFO:tasks.workunit.client.1.smithi174.stdout:8/454: fdatasync d4/de/d24/d46/d63/f6f 0 2024-05-06T14:04:09.059 INFO:tasks.workunit.client.1.smithi174.stdout:8/455: readlink d4/l1d 0 2024-05-06T14:04:09.059 INFO:tasks.workunit.client.1.smithi174.stdout:8/456: stat d4/d15/d20/f42 0 2024-05-06T14:04:09.062 INFO:tasks.workunit.client.1.smithi174.stdout:6/473: dwrite d0/d25/f51 [1183744,40960] 0 2024-05-06T14:04:09.062 INFO:tasks.workunit.client.1.smithi174.stdout:6/474: symlink d0/df/d45/d56/l9d 0 2024-05-06T14:04:09.062 INFO:tasks.workunit.client.1.smithi174.stdout:6/475: truncate d0/df/f20 509329 0 2024-05-06T14:04:09.062 INFO:tasks.workunit.client.1.smithi174.stdout:6/476: creat d0/d25/d35/f9e x:0 0 0 2024-05-06T14:04:09.062 INFO:tasks.workunit.client.1.smithi174.stdout:6/477: readlink d0/d25/d52/l34 0 2024-05-06T14:04:09.062 INFO:tasks.workunit.client.1.smithi174.stdout:6/478: unlink d0/d25/d52/d2c/c3d 0 2024-05-06T14:04:09.063 INFO:tasks.workunit.client.1.smithi174.stdout:6/479: rename d0/df/d45/d4b/f5c to d0/df/d3c/f9f 0 2024-05-06T14:04:09.063 INFO:tasks.workunit.client.1.smithi174.stdout:6/480: mknod d0/df/d45/ca0 0 2024-05-06T14:04:09.063 INFO:tasks.workunit.client.1.smithi174.stdout:8/457: dwrite d4/d48/f90 [28672,49152] 0 2024-05-06T14:04:09.111 INFO:tasks.workunit.client.1.smithi174.stdout:0/300: fdatasync d0/d36/d3f/d5e/f62 0 2024-05-06T14:04:09.111 INFO:tasks.workunit.client.1.smithi174.stdout:6/481: fsync d0/d25/d52/d2c/f69 0 2024-05-06T14:04:09.111 INFO:tasks.workunit.client.1.smithi174.stdout:6/482: write d0/d25/d52/d3b/f83 [465245,43650] 0 2024-05-06T14:04:09.113 INFO:tasks.workunit.client.1.smithi174.stdout:0/301: link d0/d4/d8/d25/d5c/c1d d0/d36/d5a/c64 0 2024-05-06T14:04:09.113 INFO:tasks.workunit.client.1.smithi174.stdout:6/483: symlink d0/d25/d52/d2c/d5f/la1 0 2024-05-06T14:04:09.114 INFO:tasks.workunit.client.1.smithi174.stdout:8/458: creat d4/d15/d20/d3e/f93 x:0 0 0 2024-05-06T14:04:09.114 INFO:tasks.workunit.client.1.smithi174.stdout:6/484: rmdir d0/df/d3c/d7a 39 2024-05-06T14:04:09.114 INFO:tasks.workunit.client.1.smithi174.stdout:6/485: getdents d0/d25/d52/d2c/d6f 0 2024-05-06T14:04:09.114 INFO:tasks.workunit.client.1.smithi174.stdout:0/302: read d0/d1a/d17/fe [828912,51237] 0 2024-05-06T14:04:09.114 INFO:tasks.workunit.client.1.smithi174.stdout:6/486: readlink d0/d25/d52/d4c/l64 0 2024-05-06T14:04:09.114 INFO:tasks.workunit.client.1.smithi174.stdout:0/303: dread - d0/d1a/d17/d2e/f3c zero size 2024-05-06T14:04:09.114 INFO:tasks.workunit.client.1.smithi174.stdout:8/459: truncate d4/d15/d20/d3e/f62 502881 0 2024-05-06T14:04:09.115 INFO:tasks.workunit.client.1.smithi174.stdout:0/304: truncate d0/f24 303314 0 2024-05-06T14:04:09.115 INFO:tasks.workunit.client.1.smithi174.stdout:8/460: mkdir d4/d15/d20/d3e/d79/d94 0 2024-05-06T14:04:09.115 INFO:tasks.workunit.client.1.smithi174.stdout:6/487: symlink d0/d25/d52/d2c/d6f/la2 0 2024-05-06T14:04:09.115 INFO:tasks.workunit.client.1.smithi174.stdout:8/461: chown d4/de/d24/d5e/d85/d91 75885450 1 2024-05-06T14:04:09.115 INFO:tasks.workunit.client.1.smithi174.stdout:0/305: truncate d0/d1a/f30 369104 0 2024-05-06T14:04:09.145 INFO:tasks.workunit.client.1.smithi174.stdout:8/462: dwrite d4/d15/d64/f74 [417792,73728] 0 2024-05-06T14:04:09.146 INFO:tasks.workunit.client.1.smithi174.stdout:8/463: mknod d4/d15/d20/d3e/d79/d94/c95 0 2024-05-06T14:04:09.146 INFO:tasks.workunit.client.1.smithi174.stdout:8/464: symlink d4/de/d23/l96 0 2024-05-06T14:04:09.147 INFO:tasks.workunit.client.1.smithi174.stdout:0/306: dwrite d0/d3/f29 [929792,77824] 0 2024-05-06T14:04:09.148 INFO:tasks.workunit.client.1.smithi174.stdout:0/307: symlink d0/d4/d8/l65 0 2024-05-06T14:04:09.148 INFO:tasks.workunit.client.1.smithi174.stdout:0/308: write d0/d3/d5d/f43 [502838,306] 0 2024-05-06T14:04:09.148 INFO:tasks.workunit.client.1.smithi174.stdout:0/309: write d0/d1a/f22 [2101739,32059] 0 2024-05-06T14:04:09.148 INFO:tasks.workunit.client.1.smithi174.stdout:0/310: truncate d0/d4/d8/d25/d5c/d44/f54 334431 0 2024-05-06T14:04:09.148 INFO:tasks.workunit.client.1.smithi174.stdout:0/311: mknod d0/d16/c66 0 2024-05-06T14:04:09.148 INFO:tasks.workunit.client.1.smithi174.stdout:0/312: truncate d0/d4/f3d 1109657 0 2024-05-06T14:04:09.148 INFO:tasks.workunit.client.1.smithi174.stdout:8/465: dwrite d4/d15/d20/f42 [352256,106496] 0 2024-05-06T14:04:09.148 INFO:tasks.workunit.client.1.smithi174.stdout:8/466: dread - d4/d15/d64/f7c zero size 2024-05-06T14:04:09.149 INFO:tasks.workunit.client.1.smithi174.stdout:8/467: rename d4/d15/d20/d3e/c8c to d4/de/d24/c97 0 2024-05-06T14:04:09.149 INFO:tasks.workunit.client.1.smithi174.stdout:8/468: mknod d4/de/d23/d41/c98 0 2024-05-06T14:04:09.200 INFO:tasks.workunit.client.1.smithi174.stdout:6/488: fsync d0/d25/d52/d2c/d5f/f88 0 2024-05-06T14:04:09.200 INFO:tasks.workunit.client.1.smithi174.stdout:6/489: dread d0/d25/d52/d2c/f69 [311296,73728] 0 2024-05-06T14:04:09.200 INFO:tasks.workunit.client.1.smithi174.stdout:6/490: creat d0/d25/d35/fa3 x:0 0 0 2024-05-06T14:04:09.209 INFO:tasks.workunit.client.1.smithi174.stdout:8/469: dread d4/d48/f90 [40960,28672] 0 2024-05-06T14:04:09.209 INFO:tasks.workunit.client.1.smithi174.stdout:6/491: read d0/df/d45/d4b/f82 [403651,17837] 0 2024-05-06T14:04:09.210 INFO:tasks.workunit.client.1.smithi174.stdout:0/313: dwrite d0/d1a/d17/d2e/f53 [1396736,118784] 0 2024-05-06T14:04:09.210 INFO:tasks.workunit.client.1.smithi174.stdout:0/314: mknod d0/d1a/c67 0 2024-05-06T14:04:09.210 INFO:tasks.workunit.client.1.smithi174.stdout:0/315: write d0/d1a/d17/d2e/f5f [116452,19405] 0 2024-05-06T14:04:09.210 INFO:tasks.workunit.client.1.smithi174.stdout:8/470: creat d4/de/f99 x:0 0 0 2024-05-06T14:04:09.210 INFO:tasks.workunit.client.1.smithi174.stdout:8/471: rename d4/de/l8e to d4/d48/l9a 0 2024-05-06T14:04:09.210 INFO:tasks.workunit.client.1.smithi174.stdout:8/472: rmdir d4/d48 39 2024-05-06T14:04:09.210 INFO:tasks.workunit.client.1.smithi174.stdout:8/473: chown d4/d15/f73 215 1 2024-05-06T14:04:09.211 INFO:tasks.workunit.client.1.smithi174.stdout:8/474: stat d4/d48/f90 0 2024-05-06T14:04:09.211 INFO:tasks.workunit.client.1.smithi174.stdout:8/475: truncate d4/de/d24/f33 1823022 0 2024-05-06T14:04:09.211 INFO:tasks.workunit.client.1.smithi174.stdout:8/476: mknod d4/de/d24/d5e/d85/d91/c9b 0 2024-05-06T14:04:09.211 INFO:tasks.workunit.client.1.smithi174.stdout:8/477: rename d4/de/f19 to d4/de/d23/d41/d56/f9c 0 2024-05-06T14:04:09.211 INFO:tasks.workunit.client.1.smithi174.stdout:8/478: chown d4/de/d23/d3c/c4b 737868 1 2024-05-06T14:04:09.211 INFO:tasks.workunit.client.1.smithi174.stdout:8/479: symlink d4/d15/d20/d3e/d79/l9d 0 2024-05-06T14:04:09.211 INFO:tasks.workunit.client.1.smithi174.stdout:8/480: dread - d4/de/f99 zero size 2024-05-06T14:04:09.211 INFO:tasks.workunit.client.1.smithi174.stdout:8/481: mknod d4/de/d24/d5e/d85/d91/c9e 0 2024-05-06T14:04:09.212 INFO:tasks.workunit.client.1.smithi174.stdout:8/482: symlink d4/d15/d64/l9f 0 2024-05-06T14:04:09.213 INFO:tasks.workunit.client.1.smithi174.stdout:8/483: dread - d4/de/f99 zero size 2024-05-06T14:04:09.213 INFO:tasks.workunit.client.1.smithi174.stdout:8/484: unlink d4/de/d23/l27 0 2024-05-06T14:04:09.213 INFO:tasks.workunit.client.1.smithi174.stdout:6/492: dread d0/d25/d35/f87 [495616,20480] 0 2024-05-06T14:04:09.213 INFO:tasks.workunit.client.1.smithi174.stdout:0/316: dwrite d0/d4/d8/d25/d5c/d44/f54 [356352,24576] 0 2024-05-06T14:04:09.213 INFO:tasks.workunit.client.1.smithi174.stdout:0/317: chown d0/d4/d8/d25/d5c/d4a 412146 1 2024-05-06T14:04:09.320 INFO:tasks.workunit.client.1.smithi174.stdout:8/485: dwrite d4/d15/d20/d3e/f93 [217088,114688] 0 2024-05-06T14:04:09.321 INFO:tasks.workunit.client.1.smithi174.stdout:8/486: stat d4/de/d24 0 2024-05-06T14:04:09.321 INFO:tasks.workunit.client.1.smithi174.stdout:8/487: mknod d4/de/d23/d41/ca0 0 2024-05-06T14:04:09.321 INFO:tasks.workunit.client.1.smithi174.stdout:8/488: chown d4/de/l7b 997586046 1 2024-05-06T14:04:09.321 INFO:tasks.workunit.client.1.smithi174.stdout:8/489: chown d4/de/d24/f45 3 1 2024-05-06T14:04:09.321 INFO:tasks.workunit.client.1.smithi174.stdout:8/490: read d4/d15/f4d [1237401,55753] 0 2024-05-06T14:04:09.321 INFO:tasks.workunit.client.1.smithi174.stdout:8/491: write d4/de/f12 [832064,79793] 0 2024-05-06T14:04:09.321 INFO:tasks.workunit.client.1.smithi174.stdout:8/492: truncate d4/de/d23/d41/f4c 207048 0 2024-05-06T14:04:09.322 INFO:tasks.workunit.client.1.smithi174.stdout:8/493: getdents d4/d15/d20/d3e/d79/d82 0 2024-05-06T14:04:09.322 INFO:tasks.workunit.client.1.smithi174.stdout:8/494: readlink d4/de/d24/l37 0 2024-05-06T14:04:09.322 INFO:tasks.workunit.client.1.smithi174.stdout:8/495: mkdir d4/d15/da1 0 2024-05-06T14:04:09.322 INFO:tasks.workunit.client.1.smithi174.stdout:8/496: creat d4/de/d24/d46/fa2 x:0 0 0 2024-05-06T14:04:09.322 INFO:tasks.workunit.client.1.smithi174.stdout:8/497: rename d4/d15/f73 to d4/de/fa3 0 2024-05-06T14:04:09.322 INFO:tasks.workunit.client.1.smithi174.stdout:8/498: symlink d4/d15/d20/d3e/d79/d94/la4 0 2024-05-06T14:04:09.322 INFO:tasks.workunit.client.1.smithi174.stdout:8/499: readlink d4/d15/d66/l8b 0 2024-05-06T14:04:09.323 INFO:tasks.workunit.client.1.smithi174.stdout:8/500: chown d4/de/d24/d46/l87 2 1 2024-05-06T14:04:09.323 INFO:tasks.workunit.client.1.smithi174.stdout:8/501: link d4/de/c38 d4/de/d24/d46/d63/ca5 0 2024-05-06T14:04:09.323 INFO:tasks.workunit.client.1.smithi174.stdout:8/502: mkdir d4/d15/d20/d3e/d79/d82/da6 0 2024-05-06T14:04:09.323 INFO:tasks.workunit.client.1.smithi174.stdout:8/503: chown d4/de/d23/d41/ca0 104840525 1 2024-05-06T14:04:09.323 INFO:tasks.workunit.client.1.smithi174.stdout:9/352: sync 2024-05-06T14:04:09.323 INFO:tasks.workunit.client.1.smithi174.stdout:7/303: sync 2024-05-06T14:04:09.323 INFO:tasks.workunit.client.1.smithi174.stdout:9/353: rmdir dc/d14/d78 0 2024-05-06T14:04:09.323 INFO:tasks.workunit.client.1.smithi174.stdout:9/354: rmdir dc/d27/d6d 39 2024-05-06T14:04:09.323 INFO:tasks.workunit.client.1.smithi174.stdout:9/355: read - dc/f42 zero size 2024-05-06T14:04:09.324 INFO:tasks.workunit.client.1.smithi174.stdout:9/356: symlink dc/d27/l7a 0 2024-05-06T14:04:09.324 INFO:tasks.workunit.client.1.smithi174.stdout:9/357: truncate dc/df/f11 2831709 0 2024-05-06T14:04:09.324 INFO:tasks.workunit.client.1.smithi174.stdout:9/358: readlink dc/df/l49 0 2024-05-06T14:04:09.324 INFO:tasks.workunit.client.1.smithi174.stdout:9/359: getdents dc/d14 0 2024-05-06T14:04:09.324 INFO:tasks.workunit.client.1.smithi174.stdout:9/360: rmdir dc 39 2024-05-06T14:04:09.324 INFO:tasks.workunit.client.1.smithi174.stdout:6/493: dwrite d0/d25/d35/fa3 [561152,65536] 0 2024-05-06T14:04:09.324 INFO:tasks.workunit.client.1.smithi174.stdout:9/361: symlink dc/df/l7b 0 2024-05-06T14:04:09.324 INFO:tasks.workunit.client.1.smithi174.stdout:9/362: getdents dc/de/d6b 0 2024-05-06T14:04:09.325 INFO:tasks.workunit.client.1.smithi174.stdout:9/363: stat dc/f25 0 2024-05-06T14:04:09.325 INFO:tasks.workunit.client.1.smithi174.stdout:6/494: creat d0/d25/d35/fa4 x:0 0 0 2024-05-06T14:04:09.325 INFO:tasks.workunit.client.1.smithi174.stdout:9/364: dread dc/f3b [282624,8192] 0 2024-05-06T14:04:09.325 INFO:tasks.workunit.client.1.smithi174.stdout:9/365: chown dc/de/f62 3797998 1 2024-05-06T14:04:09.325 INFO:tasks.workunit.client.1.smithi174.stdout:9/366: chown dc/de/f62 782685796 1 2024-05-06T14:04:09.325 INFO:tasks.workunit.client.1.smithi174.stdout:6/495: creat d0/d25/fa5 x:0 0 0 2024-05-06T14:04:09.325 INFO:tasks.workunit.client.1.smithi174.stdout:6/496: stat d0/df/d45/f47 0 2024-05-06T14:04:09.325 INFO:tasks.workunit.client.1.smithi174.stdout:6/497: mkdir d0/d25/d52/da6 0 2024-05-06T14:04:09.351 INFO:tasks.workunit.client.1.smithi174.stdout:0/318: fdatasync d0/d1a/f1b 0 2024-05-06T14:04:09.351 INFO:tasks.workunit.client.1.smithi174.stdout:0/319: dread d0/d1a/d17/d2e/f3e [126976,73728] 0 2024-05-06T14:04:09.351 INFO:tasks.workunit.client.1.smithi174.stdout:0/320: creat d0/f68 x:0 0 0 2024-05-06T14:04:09.352 INFO:tasks.workunit.client.1.smithi174.stdout:7/304: fdatasync d0/f6 0 2024-05-06T14:04:09.352 INFO:tasks.workunit.client.1.smithi174.stdout:0/321: creat d0/d4/d8/d25/d5c/d44/f69 x:0 0 0 2024-05-06T14:04:09.352 INFO:tasks.workunit.client.1.smithi174.stdout:0/322: symlink d0/d4/d8/d25/l6a 0 2024-05-06T14:04:09.352 INFO:tasks.workunit.client.1.smithi174.stdout:0/323: truncate d0/d1a/d17/d2e/f3e 1202933 0 2024-05-06T14:04:09.352 INFO:tasks.workunit.client.1.smithi174.stdout:0/324: write d0/d1a/d17/d2e/f5f [1039277,11534] 0 2024-05-06T14:04:09.352 INFO:tasks.workunit.client.1.smithi174.stdout:0/325: write d0/d4/d8/d25/f63 [164750,46464] 0 2024-05-06T14:04:09.352 INFO:tasks.workunit.client.1.smithi174.stdout:0/326: symlink d0/l6b 0 2024-05-06T14:04:09.354 INFO:tasks.workunit.client.1.smithi174.stdout:9/367: dwrite dc/de/d6b/f71 [2228224,73728] 0 2024-05-06T14:04:09.354 INFO:tasks.workunit.client.1.smithi174.stdout:9/368: readlink dc/df/l5d 0 2024-05-06T14:04:09.354 INFO:tasks.workunit.client.1.smithi174.stdout:9/369: dread - dc/f3d zero size 2024-05-06T14:04:09.356 INFO:tasks.workunit.client.1.smithi174.stdout:6/498: dread d0/d25/f30 [282624,61440] 0 2024-05-06T14:04:09.356 INFO:tasks.workunit.client.1.smithi174.stdout:0/327: truncate d0/d1a/f22 1538481 0 2024-05-06T14:04:09.356 INFO:tasks.workunit.client.1.smithi174.stdout:0/328: creat d0/d1a/f6c x:0 0 0 2024-05-06T14:04:09.356 INFO:tasks.workunit.client.1.smithi174.stdout:0/329: dread - d0/d4/d8/f47 zero size 2024-05-06T14:04:09.356 INFO:tasks.workunit.client.1.smithi174.stdout:6/499: write d0/f8a [250342,106480] 0 2024-05-06T14:04:09.356 INFO:tasks.workunit.client.1.smithi174.stdout:6/500: mknod d0/d25/d35/ca7 0 2024-05-06T14:04:09.357 INFO:tasks.workunit.client.1.smithi174.stdout:6/501: creat d0/d25/d52/d2c/fa8 x:0 0 0 2024-05-06T14:04:09.357 INFO:tasks.workunit.client.1.smithi174.stdout:6/502: dread d0/f73 [634880,94208] 0 2024-05-06T14:04:09.357 INFO:tasks.workunit.client.1.smithi174.stdout:6/503: mkdir d0/df/d45/da9 0 2024-05-06T14:04:09.357 INFO:tasks.workunit.client.1.smithi174.stdout:0/330: mknod d0/d3/d5d/c6d 0 2024-05-06T14:04:09.362 INFO:tasks.workunit.client.1.smithi174.stdout:6/504: mkdir d0/d25/d52/d2c/d5f/daa 0 2024-05-06T14:04:09.362 INFO:tasks.workunit.client.1.smithi174.stdout:6/505: creat d0/d25/d52/d4c/fab x:0 0 0 2024-05-06T14:04:09.362 INFO:tasks.workunit.client.1.smithi174.stdout:6/506: creat d0/d25/d52/d2c/d5f/daa/fac x:0 0 0 2024-05-06T14:04:09.362 INFO:tasks.workunit.client.1.smithi174.stdout:6/507: write d0/d25/d35/f87 [1199633,71027] 0 2024-05-06T14:04:09.362 INFO:tasks.workunit.client.1.smithi174.stdout:6/508: creat d0/df/d45/d56/fad x:0 0 0 2024-05-06T14:04:09.362 INFO:tasks.workunit.client.1.smithi174.stdout:6/509: write d0/df/f5e [1342287,109244] 0 2024-05-06T14:04:09.363 INFO:tasks.workunit.client.1.smithi174.stdout:5/366: sync 2024-05-06T14:04:09.363 INFO:tasks.workunit.client.1.smithi174.stdout:4/350: sync 2024-05-06T14:04:09.363 INFO:tasks.workunit.client.1.smithi174.stdout:1/290: sync 2024-05-06T14:04:09.363 INFO:tasks.workunit.client.1.smithi174.stdout:3/369: sync 2024-05-06T14:04:09.363 INFO:tasks.workunit.client.1.smithi174.stdout:2/339: sync 2024-05-06T14:04:09.363 INFO:tasks.workunit.client.1.smithi174.stdout:4/351: creat d1/d48/f85 x:0 0 0 2024-05-06T14:04:09.363 INFO:tasks.workunit.client.1.smithi174.stdout:2/340: mkdir d0/da/d3f/d67 0 2024-05-06T14:04:09.364 INFO:tasks.workunit.client.1.smithi174.stdout:2/341: rmdir d0/d24/d58 0 2024-05-06T14:04:09.364 INFO:tasks.workunit.client.1.smithi174.stdout:2/342: creat d0/d1/d2/d2a/f68 x:0 0 0 2024-05-06T14:04:09.364 INFO:tasks.workunit.client.1.smithi174.stdout:2/343: readlink d0/db/d15/l42 0 2024-05-06T14:04:09.364 INFO:tasks.workunit.client.1.smithi174.stdout:8/504: dread d4/de/f12 [823296,65536] 0 2024-05-06T14:04:09.364 INFO:tasks.workunit.client.1.smithi174.stdout:4/352: mkdir d1/d9/d15/d74/d86 0 2024-05-06T14:04:09.364 INFO:tasks.workunit.client.1.smithi174.stdout:4/353: rmdir d1/d9/d15/d35 39 2024-05-06T14:04:09.364 INFO:tasks.workunit.client.1.smithi174.stdout:1/291: rename d11/f2c to d11/d67/d6c/f72 0 2024-05-06T14:04:09.365 INFO:tasks.workunit.client.1.smithi174.stdout:4/354: dread - d1/d2e/f46 zero size 2024-05-06T14:04:09.365 INFO:tasks.workunit.client.1.smithi174.stdout:9/370: dwrite dc/de/f2e [1449984,86016] 0 2024-05-06T14:04:09.365 INFO:tasks.workunit.client.1.smithi174.stdout:8/505: getdents d4/d15/d20/d3e/d79 0 2024-05-06T14:04:09.365 INFO:tasks.workunit.client.1.smithi174.stdout:5/367: unlink d1/d6/d7/d36/d53/d59/f6e 0 2024-05-06T14:04:09.365 INFO:tasks.workunit.client.1.smithi174.stdout:8/506: rename d4/de/d23/f32 to d4/d48/fa7 0 2024-05-06T14:04:09.365 INFO:tasks.workunit.client.1.smithi174.stdout:5/368: mkdir d1/d6/df/d35/d81/d60/d82 0 2024-05-06T14:04:09.365 INFO:tasks.workunit.client.1.smithi174.stdout:9/371: symlink dc/d17/l7c 0 2024-05-06T14:04:09.366 INFO:tasks.workunit.client.1.smithi174.stdout:5/369: readlink d1/l50 0 2024-05-06T14:04:09.366 INFO:tasks.workunit.client.1.smithi174.stdout:3/370: rename df/d2d/c3e to df/d10/d1b/d59/c78 0 2024-05-06T14:04:09.366 INFO:tasks.workunit.client.1.smithi174.stdout:4/355: write d1/d1f/d27/f38 [831830,47163] 0 2024-05-06T14:04:09.366 INFO:tasks.workunit.client.1.smithi174.stdout:5/370: chown d1/d6/df/d35/d3a/de/f3f 496715388 1 2024-05-06T14:04:09.366 INFO:tasks.workunit.client.1.smithi174.stdout:9/372: creat dc/d1c/f7d x:0 0 0 2024-05-06T14:04:09.366 INFO:tasks.workunit.client.1.smithi174.stdout:1/292: write d11/d1f/d27/f5d [2473982,92722] 0 2024-05-06T14:04:09.366 INFO:tasks.workunit.client.1.smithi174.stdout:4/356: unlink d1/d9/d15/d35/c5e 0 2024-05-06T14:04:09.367 INFO:tasks.workunit.client.1.smithi174.stdout:9/373: rename dc/df/l21 to dc/d14/l7e 0 2024-05-06T14:04:09.367 INFO:tasks.workunit.client.1.smithi174.stdout:5/371: creat d1/d6/d7/d36/d53/d59/f83 x:0 0 0 2024-05-06T14:04:09.367 INFO:tasks.workunit.client.1.smithi174.stdout:9/374: truncate dc/d1c/f5f 41459 0 2024-05-06T14:04:09.367 INFO:tasks.workunit.client.1.smithi174.stdout:4/357: mknod d1/d9/d53/c87 0 2024-05-06T14:04:09.367 INFO:tasks.workunit.client.1.smithi174.stdout:3/371: symlink df/d2d/d4b/l79 0 2024-05-06T14:04:09.367 INFO:tasks.workunit.client.1.smithi174.stdout:5/372: mknod d1/d6/d7/d36/d53/d59/d61/c84 0 2024-05-06T14:04:09.367 INFO:tasks.workunit.client.1.smithi174.stdout:5/373: chown d1/d6/df/d35/d81/d1e/c6a 44426547 1 2024-05-06T14:04:09.367 INFO:tasks.workunit.client.1.smithi174.stdout:4/358: creat d1/d1a/d56/f88 x:0 0 0 2024-05-06T14:04:09.368 INFO:tasks.workunit.client.1.smithi174.stdout:1/293: truncate d11/d1f/d27/f45 185947 0 2024-05-06T14:04:09.368 INFO:tasks.workunit.client.1.smithi174.stdout:3/372: rmdir df/d2d/d4b/d5a/d6b 0 2024-05-06T14:04:09.368 INFO:tasks.workunit.client.1.smithi174.stdout:4/359: readlink d1/d2e/l34 0 2024-05-06T14:04:09.368 INFO:tasks.workunit.client.1.smithi174.stdout:5/374: creat d1/f85 x:0 0 0 2024-05-06T14:04:09.368 INFO:tasks.workunit.client.1.smithi174.stdout:3/373: dread - df/d2d/d4b/d5a/f6a zero size 2024-05-06T14:04:09.368 INFO:tasks.workunit.client.1.smithi174.stdout:4/360: mkdir d1/d1f/d89 0 2024-05-06T14:04:09.368 INFO:tasks.workunit.client.1.smithi174.stdout:3/374: creat df/d2d/f7a x:0 0 0 2024-05-06T14:04:09.369 INFO:tasks.workunit.client.1.smithi174.stdout:9/375: write dc/f4e [566145,118921] 0 2024-05-06T14:04:09.369 INFO:tasks.workunit.client.1.smithi174.stdout:4/361: readlink d1/d2e/l4b 0 2024-05-06T14:04:09.369 INFO:tasks.workunit.client.1.smithi174.stdout:3/375: truncate df/f55 357345 0 2024-05-06T14:04:09.369 INFO:tasks.workunit.client.1.smithi174.stdout:9/376: chown dc/d1c/c2b 145284 1 2024-05-06T14:04:09.369 INFO:tasks.workunit.client.1.smithi174.stdout:4/362: creat d1/d48/d5a/d5f/f8a x:0 0 0 2024-05-06T14:04:09.369 INFO:tasks.workunit.client.1.smithi174.stdout:3/376: write df/d2d/f4a [833815,64] 0 2024-05-06T14:04:09.369 INFO:tasks.workunit.client.1.smithi174.stdout:9/377: mkdir dc/de/d7f 0 2024-05-06T14:04:09.369 INFO:tasks.workunit.client.1.smithi174.stdout:6/510: dwrite d0/df/d45/f50 [1794048,73728] 0 2024-05-06T14:04:09.370 INFO:tasks.workunit.client.1.smithi174.stdout:6/511: mknod d0/d25/d35/cae 0 2024-05-06T14:04:09.370 INFO:tasks.workunit.client.1.smithi174.stdout:6/512: chown d0/d25/d52/d3b/c8f 2052298 1 2024-05-06T14:04:09.370 INFO:tasks.workunit.client.1.smithi174.stdout:6/513: symlink d0/d25/d52/laf 0 2024-05-06T14:04:09.370 INFO:tasks.workunit.client.1.smithi174.stdout:6/514: mkdir d0/d93/db0 0 2024-05-06T14:04:09.370 INFO:tasks.workunit.client.1.smithi174.stdout:6/515: mknod d0/df/d3c/cb1 0 2024-05-06T14:04:09.370 INFO:tasks.workunit.client.1.smithi174.stdout:6/516: write d0/f8a [298006,76959] 0 2024-05-06T14:04:09.371 INFO:tasks.workunit.client.1.smithi174.stdout:7/305: dread d0/d1d/d41/d61/d19/d24/d14/d52/f15 [737280,36864] 0 2024-05-06T14:04:09.372 INFO:tasks.workunit.client.1.smithi174.stdout:7/306: truncate d0/d1d/d41/d61/d19/d24/f48 273158 0 2024-05-06T14:04:09.372 INFO:tasks.workunit.client.1.smithi174.stdout:7/307: unlink d0/d1d/d41/d61/d19/d24/d47/f56 0 2024-05-06T14:04:09.372 INFO:tasks.workunit.client.1.smithi174.stdout:7/308: mkdir d0/d3a/d43/d67 0 2024-05-06T14:04:09.372 INFO:tasks.workunit.client.1.smithi174.stdout:7/309: mknod d0/d1d/d41/d61/d19/c68 0 2024-05-06T14:04:09.372 INFO:tasks.workunit.client.1.smithi174.stdout:7/310: rename d0/d3a/c49 to d0/d1d/d41/d61/d19/d24/d47/d64/c69 0 2024-05-06T14:04:09.372 INFO:tasks.workunit.client.1.smithi174.stdout:7/311: getdents d0/d1d/d41/d61/d19/d39/d46 0 2024-05-06T14:04:09.374 INFO:tasks.workunit.client.1.smithi174.stdout:2/344: dread d0/da/f3b [663552,114688] 0 2024-05-06T14:04:09.378 INFO:tasks.workunit.client.1.smithi174.stdout:2/345: write d0/d1/d2/d4/d6/f26 [805397,44404] 0 2024-05-06T14:04:09.378 INFO:tasks.workunit.client.1.smithi174.stdout:2/346: mkdir d0/db/d15/d69 0 2024-05-06T14:04:09.378 INFO:tasks.workunit.client.1.smithi174.stdout:2/347: creat d0/d24/f6a x:0 0 0 2024-05-06T14:04:09.378 INFO:tasks.workunit.client.1.smithi174.stdout:2/348: write d0/db/d15/f2e [1367203,99034] 0 2024-05-06T14:04:09.378 INFO:tasks.workunit.client.1.smithi174.stdout:2/349: dread d0/d1/d2/d4/d6/f7 [24576,94208] 0 2024-05-06T14:04:09.378 INFO:tasks.workunit.client.1.smithi174.stdout:2/350: dread d0/d1/d2/d4/d6/f7 [20480,77824] 0 2024-05-06T14:04:09.378 INFO:tasks.workunit.client.1.smithi174.stdout:2/351: readlink d0/d1/d2/d4/l39 0 2024-05-06T14:04:09.379 INFO:tasks.workunit.client.1.smithi174.stdout:2/352: truncate d0/d1/d2/d2a/f68 862263 0 2024-05-06T14:04:09.494 INFO:tasks.workunit.client.1.smithi174.stdout:5/375: dwrite d1/d6/df/d35/d3a/de/f26 [1761280,126976] 0 2024-05-06T14:04:09.495 INFO:tasks.workunit.client.1.smithi174.stdout:5/376: write d1/d6/f9 [630160,107433] 0 2024-05-06T14:04:09.495 INFO:tasks.workunit.client.1.smithi174.stdout:5/377: rmdir d1/d6/df/d35/d3a 39 2024-05-06T14:04:09.495 INFO:tasks.workunit.client.1.smithi174.stdout:5/378: symlink d1/d6/df/d35/d3a/de/d6b/l86 0 2024-05-06T14:04:09.495 INFO:tasks.workunit.client.1.smithi174.stdout:5/379: creat d1/d6/d7/f87 x:0 0 0 2024-05-06T14:04:09.495 INFO:tasks.workunit.client.1.smithi174.stdout:5/380: write d1/d6/df/d35/d3a/f25 [1961920,52680] 0 2024-05-06T14:04:09.497 INFO:tasks.workunit.client.1.smithi174.stdout:2/353: dwrite d0/d1/d2/f54 [925696,122880] 0 2024-05-06T14:04:09.497 INFO:tasks.workunit.client.1.smithi174.stdout:2/354: creat d0/d1/d2/d4/d18/d2d/f6b x:0 0 0 2024-05-06T14:04:09.497 INFO:tasks.workunit.client.1.smithi174.stdout:2/355: creat d0/d1/d2/d4/f6c x:0 0 0 2024-05-06T14:04:09.498 INFO:tasks.workunit.client.1.smithi174.stdout:2/356: rmdir d0/db/d15/d69 0 2024-05-06T14:04:09.498 INFO:tasks.workunit.client.1.smithi174.stdout:2/357: truncate d0/d1/d2/d2a/f48 1417462 0 2024-05-06T14:04:09.498 INFO:tasks.workunit.client.1.smithi174.stdout:4/363: dwrite d1/d2e/f39 [1335296,45056] 0 2024-05-06T14:04:09.498 INFO:tasks.workunit.client.1.smithi174.stdout:2/358: read d0/db/d15/f4e [141833,46673] 0 2024-05-06T14:04:09.498 INFO:tasks.workunit.client.1.smithi174.stdout:4/364: dread - d1/d9/f42 zero size 2024-05-06T14:04:09.498 INFO:tasks.workunit.client.1.smithi174.stdout:4/365: readlink d1/l11 0 2024-05-06T14:04:09.498 INFO:tasks.workunit.client.1.smithi174.stdout:4/366: dread - d1/d1f/f62 zero size 2024-05-06T14:04:09.499 INFO:tasks.workunit.client.1.smithi174.stdout:8/507: dwrite d4/d15/d20/f42 [2322432,126976] 0 2024-05-06T14:04:09.499 INFO:tasks.workunit.client.1.smithi174.stdout:5/381: dwrite d1/d6/d7/d36/f2c [4775936,12288] 0 2024-05-06T14:04:09.499 INFO:tasks.workunit.client.1.smithi174.stdout:8/508: symlink d4/de/d24/d46/d63/la8 0 2024-05-06T14:04:09.499 INFO:tasks.workunit.client.1.smithi174.stdout:5/382: link d1/d6/d7/d36/d53/d59/f7a d1/d6/df/d35/d3a/de/d6b/f88 0 2024-05-06T14:04:09.502 INFO:tasks.workunit.client.1.smithi174.stdout:3/377: write df/d10/d1b/f22 [76771,110876] 0 2024-05-06T14:04:09.502 INFO:tasks.workunit.client.1.smithi174.stdout:3/378: symlink df/d10/d1b/l7b 0 2024-05-06T14:04:09.538 INFO:tasks.workunit.client.1.smithi174.stdout:7/312: fsync d0/d1d/d41/d61/d28/d59/f3f 0 2024-05-06T14:04:09.538 INFO:tasks.workunit.client.1.smithi174.stdout:9/378: fdatasync dc/d1c/f38 0 2024-05-06T14:04:09.538 INFO:tasks.workunit.client.1.smithi174.stdout:7/313: link d0/d1d/d41/d61/d19/d24/d14/d52/f3e d0/d3a/f6a 0 2024-05-06T14:04:09.538 INFO:tasks.workunit.client.1.smithi174.stdout:9/379: mknod dc/d27/c80 0 2024-05-06T14:04:09.538 INFO:tasks.workunit.client.1.smithi174.stdout:7/314: write d0/d1d/d41/d61/d19/d24/d47/f5e [1326521,50714] 0 2024-05-06T14:04:09.539 INFO:tasks.workunit.client.1.smithi174.stdout:7/315: mknod d0/d1d/d41/d61/d19/d24/d47/c6b 0 2024-05-06T14:04:09.539 INFO:tasks.workunit.client.1.smithi174.stdout:7/316: rename d0/d1d/d41/d61/d19/d24/l23 to d0/d1d/d41/d61/d19/d24/d47/d64/l6c 0 2024-05-06T14:04:09.539 INFO:tasks.workunit.client.1.smithi174.stdout:7/317: getdents d0/d1d/d41/d61/d19/d24 0 2024-05-06T14:04:09.539 INFO:tasks.workunit.client.1.smithi174.stdout:7/318: creat d0/d1d/d41/d61/d19/d24/d14/f6d x:0 0 0 2024-05-06T14:04:09.539 INFO:tasks.workunit.client.1.smithi174.stdout:7/319: rmdir d0/d1d/d41/d61/d19/d24/d47 39 2024-05-06T14:04:09.539 INFO:tasks.workunit.client.1.smithi174.stdout:7/320: creat d0/d1d/d41/d61/d28/f6e x:0 0 0 2024-05-06T14:04:09.539 INFO:tasks.workunit.client.1.smithi174.stdout:7/321: mkdir d0/d1d/d41/d61/d19/d24/d6f 0 2024-05-06T14:04:09.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/322: rename d0/d3a/d43 to d0/d1d/d41/d61/d19/d24/d47/d70 0 2024-05-06T14:04:09.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/323: stat d0/d1d/d41/d61/d19/d24/d14/f33 0 2024-05-06T14:04:09.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/324: symlink d0/d1d/d41/d61/d19/d39/d46/l71 0 2024-05-06T14:04:09.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/325: write d0/d1d/d41/d61/d19/d24/f10 [4018611,88585] 0 2024-05-06T14:04:09.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/326: dread d0/d1d/d41/d61/d19/d24/d14/d52/f15 [307200,61440] 0 2024-05-06T14:04:09.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/327: symlink d0/d1d/d41/d61/d19/d24/d5d/l72 0 2024-05-06T14:04:09.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/328: write d0/d1d/d41/d61/d19/d24/d47/f5e [1733049,32540] 0 2024-05-06T14:04:09.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/329: mknod d0/d1d/d41/d61/d19/c73 0 2024-05-06T14:04:09.541 INFO:tasks.workunit.client.1.smithi174.stdout:7/330: mknod d0/d1d/d41/d61/d19/d39/d46/c74 0 2024-05-06T14:04:09.541 INFO:tasks.workunit.client.1.smithi174.stdout:7/331: rename d0/d1d/d41/d61/d28/d59/f4c to d0/d1d/f75 0 2024-05-06T14:04:09.545 INFO:tasks.workunit.client.1.smithi174.stdout:4/367: dwrite d1/d2e/f33 [790528,45056] 0 2024-05-06T14:04:09.545 INFO:tasks.workunit.client.1.smithi174.stdout:4/368: truncate d1/d1f/d27/d3e/f70 1274944 0 2024-05-06T14:04:09.545 INFO:tasks.workunit.client.1.smithi174.stdout:4/369: read d1/d9/f2d [562465,81338] 0 2024-05-06T14:04:09.546 INFO:tasks.workunit.client.1.smithi174.stdout:4/370: creat d1/d48/d5a/d5f/f8b x:0 0 0 2024-05-06T14:04:09.546 INFO:tasks.workunit.client.1.smithi174.stdout:5/383: dwrite d1/d6/d7/d3e/d4c/f55 [548864,98304] 0 2024-05-06T14:04:09.546 INFO:tasks.workunit.client.1.smithi174.stdout:5/384: dread - d1/d6/d7/d36/d53/d59/d61/f7e zero size 2024-05-06T14:04:09.546 INFO:tasks.workunit.client.1.smithi174.stdout:5/385: creat d1/d6/df/d35/d3a/de/f89 x:0 0 0 2024-05-06T14:04:09.546 INFO:tasks.workunit.client.1.smithi174.stdout:5/386: dread d1/d6/df/d35/d81/f1d [495616,57344] 0 2024-05-06T14:04:09.546 INFO:tasks.workunit.client.1.smithi174.stdout:5/387: dread - d1/d6/df/f30 zero size 2024-05-06T14:04:09.546 INFO:tasks.workunit.client.1.smithi174.stdout:5/388: dread d1/d6/df/d35/d3a/de/f57 [126976,49152] 0 2024-05-06T14:04:09.547 INFO:tasks.workunit.client.1.smithi174.stdout:5/389: write d1/d6/df/d35/d3a/fd [4268802,65469] 0 2024-05-06T14:04:09.547 INFO:tasks.workunit.client.1.smithi174.stdout:5/390: unlink d1/d6/df/d35/d3a/de/d6b/f6f 0 2024-05-06T14:04:09.547 INFO:tasks.workunit.client.1.smithi174.stdout:5/391: rmdir d1/d6/df/d35/d81 39 2024-05-06T14:04:09.547 INFO:tasks.workunit.client.1.smithi174.stdout:5/392: mknod d1/d6/df/d35/d81/d60/c8a 0 2024-05-06T14:04:09.547 INFO:tasks.workunit.client.1.smithi174.stdout:5/393: mkdir d1/d6/df/d35/d8b 0 2024-05-06T14:04:09.547 INFO:tasks.workunit.client.1.smithi174.stdout:5/394: rename d1/d6/f18 to d1/d6/df/d35/d81/d1e/f8c 0 2024-05-06T14:04:09.547 INFO:tasks.workunit.client.1.smithi174.stdout:5/395: dread - d1/d6/df/d35/d3a/de/f89 zero size 2024-05-06T14:04:09.547 INFO:tasks.workunit.client.1.smithi174.stdout:5/396: stat d1/d6/df/d35/d81/d1e/c4e 0 2024-05-06T14:04:09.548 INFO:tasks.workunit.client.1.smithi174.stdout:5/397: write d1/d6/f34 [823221,91600] 0 2024-05-06T14:04:09.548 INFO:tasks.workunit.client.1.smithi174.stdout:2/359: dwrite d0/d1/d2/d2a/f3a [2097152,16384] 0 2024-05-06T14:04:09.548 INFO:tasks.workunit.client.1.smithi174.stdout:2/360: rmdir d0/d1/d2/d2a 39 2024-05-06T14:04:09.548 INFO:tasks.workunit.client.1.smithi174.stdout:2/361: creat d0/d1/d2/d4/d18/f6d x:0 0 0 2024-05-06T14:04:09.548 INFO:tasks.workunit.client.1.smithi174.stdout:2/362: symlink d0/d1/d2/d4/d6/d3c/d61/l6e 0 2024-05-06T14:04:09.548 INFO:tasks.workunit.client.1.smithi174.stdout:2/363: creat d0/db/d15/f6f x:0 0 0 2024-05-06T14:04:09.548 INFO:tasks.workunit.client.1.smithi174.stdout:2/364: creat d0/d1/d2/d2a/f70 x:0 0 0 2024-05-06T14:04:09.549 INFO:tasks.workunit.client.1.smithi174.stdout:2/365: creat d0/da/d3f/f71 x:0 0 0 2024-05-06T14:04:09.549 INFO:tasks.workunit.client.1.smithi174.stdout:2/366: dread - d0/d1/f5e zero size 2024-05-06T14:04:09.549 INFO:tasks.workunit.client.1.smithi174.stdout:2/367: unlink d0/d1/d2/d4/d18/l1e 0 2024-05-06T14:04:09.549 INFO:tasks.workunit.client.1.smithi174.stdout:2/368: write d0/d1/d2/f1c [92428,49137] 0 2024-05-06T14:04:09.549 INFO:tasks.workunit.client.1.smithi174.stdout:3/379: dwrite f7 [2142208,90112] 0 2024-05-06T14:04:09.549 INFO:tasks.workunit.client.1.smithi174.stdout:2/369: chown d0/d1/d2/d4/f57 121 1 2024-05-06T14:04:09.549 INFO:tasks.workunit.client.1.smithi174.stdout:3/380: dread - df/d2d/d4b/d57/f63 zero size 2024-05-06T14:04:09.549 INFO:tasks.workunit.client.1.smithi174.stdout:2/370: chown d0/d1/d2/d1b/l60 18395 1 2024-05-06T14:04:09.550 INFO:tasks.workunit.client.1.smithi174.stdout:2/371: write d0/d1/f5e [1002877,103529] 0 2024-05-06T14:04:09.550 INFO:tasks.workunit.client.1.smithi174.stdout:2/372: write d0/d1/d2/d4/d43/f66 [1083796,100961] 0 2024-05-06T14:04:09.550 INFO:tasks.workunit.client.1.smithi174.stdout:2/373: chown d0/db/l13 1 1 2024-05-06T14:04:09.606 INFO:tasks.workunit.client.1.smithi174.stdout:9/380: fsync dc/df/f34 0 2024-05-06T14:04:09.606 INFO:tasks.workunit.client.1.smithi174.stdout:9/381: truncate dc/de/f26 512693 0 2024-05-06T14:04:09.607 INFO:tasks.workunit.client.1.smithi174.stdout:9/382: write dc/d27/f77 [2255800,70572] 0 2024-05-06T14:04:09.608 INFO:tasks.workunit.client.1.smithi174.stdout:5/398: dread d1/d6/df/f79 [393216,106496] 0 2024-05-06T14:04:09.608 INFO:tasks.workunit.client.1.smithi174.stdout:5/399: chown d1/d6/d7/d36/d53 106 1 2024-05-06T14:04:09.633 INFO:tasks.workunit.client.1.smithi174.stdout:9/383: fdatasync dc/d27/f39 0 2024-05-06T14:04:09.633 INFO:tasks.workunit.client.1.smithi174.stdout:9/384: dread - dc/d27/d51/f65 zero size 2024-05-06T14:04:09.644 INFO:tasks.workunit.client.1.smithi174.stdout:2/374: dwrite d0/d1/d2/d2a/f68 [610304,122880] 0 2024-05-06T14:04:09.644 INFO:tasks.workunit.client.1.smithi174.stdout:4/371: dwrite d1/d9/fe [1257472,36864] 0 2024-05-06T14:04:09.644 INFO:tasks.workunit.client.1.smithi174.stdout:7/332: dwrite d0/d1d/d41/d61/d28/f62 [716800,98304] 0 2024-05-06T14:04:09.644 INFO:tasks.workunit.client.1.smithi174.stdout:3/381: dwrite df/d2d/f7a [237568,102400] 0 2024-05-06T14:04:09.644 INFO:tasks.workunit.client.1.smithi174.stdout:2/375: truncate d0/d1/d2/d2a/f48 1154365 0 2024-05-06T14:04:09.645 INFO:tasks.workunit.client.1.smithi174.stdout:9/385: write dc/d14/f6c [307277,67697] 0 2024-05-06T14:04:09.645 INFO:tasks.workunit.client.1.smithi174.stdout:2/376: dread d0/d1/d2/f1a [229376,12288] 0 2024-05-06T14:04:09.645 INFO:tasks.workunit.client.1.smithi174.stdout:4/372: mknod d1/d1f/d27/d3e/c8c 0 2024-05-06T14:04:09.645 INFO:tasks.workunit.client.1.smithi174.stdout:2/377: unlink d0/d1/d2/d2a/f68 0 2024-05-06T14:04:09.646 INFO:tasks.workunit.client.1.smithi174.stdout:3/382: symlink df/d10/l7c 0 2024-05-06T14:04:09.646 INFO:tasks.workunit.client.1.smithi174.stdout:2/378: unlink d0/d1/d2/f1c 0 2024-05-06T14:04:09.646 INFO:tasks.workunit.client.1.smithi174.stdout:9/386: mkdir dc/de/d81 0 2024-05-06T14:04:09.646 INFO:tasks.workunit.client.1.smithi174.stdout:3/383: truncate df/d2d/d4b/d57/f5d 794144 0 2024-05-06T14:04:09.646 INFO:tasks.workunit.client.1.smithi174.stdout:2/379: chown d0/db/d15/f6f 9 1 2024-05-06T14:04:09.647 INFO:tasks.workunit.client.1.smithi174.stdout:2/380: stat d0/d1/d2/d4/d6/l36 0 2024-05-06T14:04:09.647 INFO:tasks.workunit.client.1.smithi174.stdout:3/384: readlink df/d10/d1b/l7b 0 2024-05-06T14:04:09.647 INFO:tasks.workunit.client.1.smithi174.stdout:7/333: write d0/d1d/f1e [17683,39004] 0 2024-05-06T14:04:09.647 INFO:tasks.workunit.client.1.smithi174.stdout:9/387: mknod dc/d17/c82 0 2024-05-06T14:04:09.647 INFO:tasks.workunit.client.1.smithi174.stdout:3/385: write df/d10/d1b/f76 [555947,16487] 0 2024-05-06T14:04:09.647 INFO:tasks.workunit.client.1.smithi174.stdout:2/381: mkdir d0/db/d72 0 2024-05-06T14:04:09.648 INFO:tasks.workunit.client.1.smithi174.stdout:7/334: write d0/f34 [320273,78241] 0 2024-05-06T14:04:09.648 INFO:tasks.workunit.client.1.smithi174.stdout:5/400: dwrite d1/d6/df/d35/d3a/de/f63 [81920,36864] 0 2024-05-06T14:04:09.648 INFO:tasks.workunit.client.1.smithi174.stdout:5/401: mkdir d1/d6/df/d35/d81/d8d 0 2024-05-06T14:04:09.648 INFO:tasks.workunit.client.1.smithi174.stdout:5/402: mkdir d1/d6/d7/d8e 0 2024-05-06T14:04:09.648 INFO:tasks.workunit.client.1.smithi174.stdout:5/403: dread - d1/d6/d7/d36/d53/d59/f83 zero size 2024-05-06T14:04:09.649 INFO:tasks.workunit.client.1.smithi174.stdout:5/404: write d1/d6/d7/d36/d53/d59/d61/d69/f7d [1415779,13663] 0 2024-05-06T14:04:09.649 INFO:tasks.workunit.client.1.smithi174.stdout:5/405: creat d1/d6/df/d35/d3a/d41/f8f x:0 0 0 2024-05-06T14:04:09.649 INFO:tasks.workunit.client.1.smithi174.stdout:5/406: truncate d1/d6/df/d35/d3a/f33 923686 0 2024-05-06T14:04:09.649 INFO:tasks.workunit.client.1.smithi174.stdout:5/407: chown d1/d6/df/l73 371736 1 2024-05-06T14:04:09.649 INFO:tasks.workunit.client.1.smithi174.stdout:5/408: chown d1/d6/df/d35/d3a/de/f80 0 1 2024-05-06T14:04:09.649 INFO:tasks.workunit.client.1.smithi174.stdout:5/409: chown d1/d6/d7/d36/d53/d59/l65 6 1 2024-05-06T14:04:09.649 INFO:tasks.workunit.client.1.smithi174.stdout:5/410: rmdir d1/d6/d7/d3e/d4c/d7c 0 2024-05-06T14:04:09.651 INFO:tasks.workunit.client.1.smithi174.stdout:4/373: dwrite d1/d9/f2d [991232,118784] 0 2024-05-06T14:04:09.651 INFO:tasks.workunit.client.1.smithi174.stdout:4/374: write d1/d9/fe [111308,4212] 0 2024-05-06T14:04:09.651 INFO:tasks.workunit.client.1.smithi174.stdout:4/375: write d1/d1a/f66 [278312,14499] 0 2024-05-06T14:04:09.651 INFO:tasks.workunit.client.1.smithi174.stdout:3/386: dwrite df/d10/d1b/f65 [299008,90112] 0 2024-05-06T14:04:09.651 INFO:tasks.workunit.client.1.smithi174.stdout:2/382: dwrite d0/d1/d2/d4/d18/d2d/d32/f53 [958464,98304] 0 2024-05-06T14:04:09.651 INFO:tasks.workunit.client.1.smithi174.stdout:2/383: truncate d0/d1/f5e 1250019 0 2024-05-06T14:04:09.652 INFO:tasks.workunit.client.1.smithi174.stdout:2/384: chown d0/d1/d2/d4/d18/d2d/d32/f53 634 1 2024-05-06T14:04:09.652 INFO:tasks.workunit.client.1.smithi174.stdout:2/385: write d0/f55 [1352444,3449] 0 2024-05-06T14:04:09.652 INFO:tasks.workunit.client.1.smithi174.stdout:2/386: getdents d0/d24 0 2024-05-06T14:04:09.652 INFO:tasks.workunit.client.1.smithi174.stdout:7/335: dwrite d0/d1d/d41/d61/f5c [1019904,81920] 0 2024-05-06T14:04:09.652 INFO:tasks.workunit.client.1.smithi174.stdout:7/336: readlink d0/d1d/d41/d61/d19/d24/d47/d64/l6c 0 2024-05-06T14:04:09.652 INFO:tasks.workunit.client.1.smithi174.stdout:5/411: dread d1/d6/df/d35/d3a/de/f26 [1810432,57344] 0 2024-05-06T14:04:09.652 INFO:tasks.workunit.client.1.smithi174.stdout:5/412: dread - d1/d6/d7/f2e zero size 2024-05-06T14:04:09.741 INFO:tasks.workunit.client.1.smithi174.stdout:7/337: dwrite d0/d1d/d41/f4b [4743168,73728] 0 2024-05-06T14:04:09.742 INFO:tasks.workunit.client.1.smithi174.stdout:7/338: getdents d0/d1d/d41/d61/d28/d59 0 2024-05-06T14:04:09.742 INFO:tasks.workunit.client.1.smithi174.stdout:7/339: creat d0/d1d/d41/d61/d19/d24/d14/d52/f76 x:0 0 0 2024-05-06T14:04:09.742 INFO:tasks.workunit.client.1.smithi174.stdout:7/340: creat d0/d1d/f77 x:0 0 0 2024-05-06T14:04:09.742 INFO:tasks.workunit.client.1.smithi174.stdout:7/341: write d0/d1d/d41/d61/d19/d24/f10 [4211607,47320] 0 2024-05-06T14:04:09.742 INFO:tasks.workunit.client.1.smithi174.stdout:7/342: readlink d0/d1d/d41/d61/l53 0 2024-05-06T14:04:09.742 INFO:tasks.workunit.client.1.smithi174.stdout:7/343: link d0/d1d/d41/d61/d19/d24/f1b d0/d1d/d41/d61/d19/d39/f78 0 2024-05-06T14:04:09.743 INFO:tasks.workunit.client.1.smithi174.stdout:7/344: creat d0/d1d/d41/d61/d19/d24/f79 x:0 0 0 2024-05-06T14:04:09.743 INFO:tasks.workunit.client.1.smithi174.stdout:7/345: creat d0/d1d/d41/d61/d19/d24/d47/f7a x:0 0 0 2024-05-06T14:04:09.743 INFO:tasks.workunit.client.1.smithi174.stdout:7/346: chown d0/d1d/d41/d61/d19 929930 1 2024-05-06T14:04:09.743 INFO:tasks.workunit.client.1.smithi174.stdout:7/347: link d0/d1d/d41/d61/d19/d24/d14/f6d d0/d1d/d41/d61/d19/d24/d6f/f7b 0 2024-05-06T14:04:09.743 INFO:tasks.workunit.client.1.smithi174.stdout:7/348: creat d0/d1d/d41/d61/d19/f7c x:0 0 0 2024-05-06T14:04:09.743 INFO:tasks.workunit.client.1.smithi174.stdout:7/349: dread d0/d1d/d41/d61/f38 [372736,81920] 0 2024-05-06T14:04:09.743 INFO:tasks.workunit.client.1.smithi174.stdout:7/350: rmdir d0/d1d/d41/d61/d19/d24/d6f 39 2024-05-06T14:04:09.744 INFO:tasks.workunit.client.1.smithi174.stdout:4/376: dwrite d1/d1f/d27/f38 [524288,28672] 0 2024-05-06T14:04:09.744 INFO:tasks.workunit.client.1.smithi174.stdout:4/377: read d1/d1a/f66 [1187647,96049] 0 2024-05-06T14:04:09.744 INFO:tasks.workunit.client.1.smithi174.stdout:3/387: dwrite df/f55 [1294336,118784] 0 2024-05-06T14:04:09.744 INFO:tasks.workunit.client.1.smithi174.stdout:3/388: mknod df/d2d/d4d/c7d 0 2024-05-06T14:04:09.744 INFO:tasks.workunit.client.1.smithi174.stdout:3/389: rename df/d2d/d4b to df/d10/d1b/d7e 0 2024-05-06T14:04:09.744 INFO:tasks.workunit.client.1.smithi174.stdout:3/390: unlink f5 0 2024-05-06T14:04:09.744 INFO:tasks.workunit.client.1.smithi174.stdout:3/391: creat df/d10/d1b/f7f x:0 0 0 2024-05-06T14:04:09.745 INFO:tasks.workunit.client.1.smithi174.stdout:3/392: chown df/d10/d1b/d7e/d5a/f73 847279 1 2024-05-06T14:04:09.745 INFO:tasks.workunit.client.1.smithi174.stdout:5/413: dwrite d1/d6/df/d35/d3a/de/f5d [327680,45056] 0 2024-05-06T14:04:09.745 INFO:tasks.workunit.client.1.smithi174.stdout:5/414: dread d1/d6/df/d35/d3a/de/f3f [954368,106496] 0 2024-05-06T14:04:09.795 INFO:tasks.workunit.client.1.smithi174.stdout:9/388: fsync dc/f25 0 2024-05-06T14:04:09.795 INFO:tasks.workunit.client.1.smithi174.stdout:9/389: chown dc/d17/l7c 2277 1 2024-05-06T14:04:09.796 INFO:tasks.workunit.client.1.smithi174.stdout:9/390: stat dc/f36 0 2024-05-06T14:04:09.796 INFO:tasks.workunit.client.1.smithi174.stdout:9/391: link dc/d27/d6d/l6e dc/d17/l83 0 2024-05-06T14:04:09.796 INFO:tasks.workunit.client.1.smithi174.stdout:9/392: truncate dc/d1c/f38 1277857 0 2024-05-06T14:04:09.796 INFO:tasks.workunit.client.1.smithi174.stdout:9/393: mkdir dc/d27/d6d/d84 0 2024-05-06T14:04:09.797 INFO:tasks.workunit.client.1.smithi174.stdout:9/394: rename dc/df/l7b to dc/d1c/l85 0 2024-05-06T14:04:09.797 INFO:tasks.workunit.client.1.smithi174.stdout:2/387: fdatasync d0/d24/f50 0 2024-05-06T14:04:09.797 INFO:tasks.workunit.client.1.smithi174.stdout:9/395: mknod dc/d27/c86 0 2024-05-06T14:04:09.797 INFO:tasks.workunit.client.1.smithi174.stdout:9/396: dread - dc/f3d zero size 2024-05-06T14:04:09.797 INFO:tasks.workunit.client.1.smithi174.stdout:2/388: dread d0/d1/f35 [131072,106496] 0 2024-05-06T14:04:09.816 INFO:tasks.workunit.client.1.smithi174.stdout:7/351: fdatasync d0/d1d/d41/d61/fb 0 2024-05-06T14:04:09.816 INFO:tasks.workunit.client.1.smithi174.stdout:4/378: fdatasync d1/d2e/f40 0 2024-05-06T14:04:09.819 INFO:tasks.workunit.client.1.smithi174.stdout:2/389: mknod d0/db/c73 0 2024-05-06T14:04:09.819 INFO:tasks.workunit.client.1.smithi174.stdout:9/397: mknod dc/d17/d3a/c87 0 2024-05-06T14:04:09.819 INFO:tasks.workunit.client.1.smithi174.stdout:2/390: chown d0/d1/d2/d4/f57 2077819359 1 2024-05-06T14:04:09.819 INFO:tasks.workunit.client.1.smithi174.stdout:2/391: read - d0/da/f56 zero size 2024-05-06T14:04:09.819 INFO:tasks.workunit.client.1.smithi174.stdout:9/398: mknod dc/de/d7f/c88 0 2024-05-06T14:04:09.819 INFO:tasks.workunit.client.1.smithi174.stdout:2/392: rename d0/d1/d2/d4/d43/f66 to d0/da/f74 0 2024-05-06T14:04:09.819 INFO:tasks.workunit.client.1.smithi174.stdout:9/399: mknod dc/d14/d43/c89 0 2024-05-06T14:04:09.820 INFO:tasks.workunit.client.1.smithi174.stdout:2/393: mknod d0/db/c75 0 2024-05-06T14:04:09.820 INFO:tasks.workunit.client.1.smithi174.stdout:2/394: read d0/d1/d2/d2a/f3a [1518977,18049] 0 2024-05-06T14:04:09.820 INFO:tasks.workunit.client.1.smithi174.stdout:2/395: dread - d0/d24/f6a zero size 2024-05-06T14:04:09.820 INFO:tasks.workunit.client.1.smithi174.stdout:2/396: chown d0/da/d3f/d67 347051 1 2024-05-06T14:04:09.820 INFO:tasks.workunit.client.1.smithi174.stdout:2/397: read d0/d1/d2/f17 [1046285,21578] 0 2024-05-06T14:04:09.820 INFO:tasks.workunit.client.1.smithi174.stdout:2/398: truncate d0/db/d15/f30 1462217 0 2024-05-06T14:04:09.841 INFO:tasks.workunit.client.1.smithi174.stdout:4/379: fdatasync d1/d9/f16 0 2024-05-06T14:04:09.841 INFO:tasks.workunit.client.1.smithi174.stdout:9/400: fdatasync dc/de/f4f 0 2024-05-06T14:04:09.842 INFO:tasks.workunit.client.1.smithi174.stdout:9/401: write dc/de/d6b/f71 [1729873,58845] 0 2024-05-06T14:04:09.842 INFO:tasks.workunit.client.1.smithi174.stdout:9/402: rmdir dc/d14/d43 39 2024-05-06T14:04:09.843 INFO:tasks.workunit.client.1.smithi174.stdout:9/403: unlink f3 0 2024-05-06T14:04:09.843 INFO:tasks.workunit.client.1.smithi174.stdout:9/404: dread dc/d1c/f5f [28672,8192] 0 2024-05-06T14:04:09.846 INFO:tasks.workunit.client.1.smithi174.stdout:4/380: mkdir d1/d9/d8d 0 2024-05-06T14:04:09.846 INFO:tasks.workunit.client.1.smithi174.stdout:4/381: write d1/d2e/f39 [1322137,100801] 0 2024-05-06T14:04:09.847 INFO:tasks.workunit.client.1.smithi174.stdout:4/382: getdents d1/d9/d15/d35 0 2024-05-06T14:04:09.847 INFO:tasks.workunit.client.1.smithi174.stdout:4/383: truncate d1/d1f/d27/d3e/f7b 413601 0 2024-05-06T14:04:09.847 INFO:tasks.workunit.client.1.smithi174.stdout:4/384: link d1/d9/f16 d1/d9/f8e 0 2024-05-06T14:04:09.847 INFO:tasks.workunit.client.1.smithi174.stdout:4/385: mkdir d1/d9/d15/d74/d86/d8f 0 2024-05-06T14:04:09.847 INFO:tasks.workunit.client.1.smithi174.stdout:4/386: rename d1/d2e/c36 to d1/d9/d15/c90 0 2024-05-06T14:04:09.848 INFO:tasks.workunit.client.1.smithi174.stdout:4/387: write d1/d1a/d56/f78 [49989,81597] 0 2024-05-06T14:04:09.848 INFO:tasks.workunit.client.1.smithi174.stdout:4/388: mknod d1/d9/d15/d74/c91 0 2024-05-06T14:04:09.848 INFO:tasks.workunit.client.1.smithi174.stdout:4/389: mkdir d1/d9/d15/d92 0 2024-05-06T14:04:09.848 INFO:tasks.workunit.client.1.smithi174.stdout:4/390: creat d1/d9/d15/f93 x:0 0 0 2024-05-06T14:04:09.848 INFO:tasks.workunit.client.1.smithi174.stdout:2/399: dwrite d0/d1/d2/d4/d6/f7 [245760,98304] 0 2024-05-06T14:04:09.849 INFO:tasks.workunit.client.1.smithi174.stdout:2/400: stat d0/d1/d2/d1b 0 2024-05-06T14:04:09.849 INFO:tasks.workunit.client.1.smithi174.stdout:2/401: creat d0/d1/d2/d4/d18/d2d/d32/f76 x:0 0 0 2024-05-06T14:04:09.849 INFO:tasks.workunit.client.1.smithi174.stdout:9/405: dwrite f2 [880640,102400] 0 2024-05-06T14:04:09.849 INFO:tasks.workunit.client.1.smithi174.stdout:9/406: chown dc/d27/d51/f65 59793 1 2024-05-06T14:04:09.918 INFO:tasks.workunit.client.1.smithi174.stdout:3/393: fdatasync df/d10/d1b/f65 0 2024-05-06T14:04:09.918 INFO:tasks.workunit.client.1.smithi174.stdout:5/415: fdatasync d1/d6/df/d35/d3a/f33 0 2024-05-06T14:04:09.918 INFO:tasks.workunit.client.1.smithi174.stdout:5/416: readlink d1/d6/df/d35/d3a/de/d6b/l72 0 2024-05-06T14:04:09.918 INFO:tasks.workunit.client.1.smithi174.stdout:5/417: readlink d1/d6/d7/d36/d53/d59/l65 0 2024-05-06T14:04:09.918 INFO:tasks.workunit.client.1.smithi174.stdout:4/391: dwrite d1/d1a/d56/f78 [647168,86016] 0 2024-05-06T14:04:09.919 INFO:tasks.workunit.client.1.smithi174.stdout:4/392: dread - d1/d1a/f76 zero size 2024-05-06T14:04:09.921 INFO:tasks.workunit.client.1.smithi174.stdout:5/418: mkdir d1/d6/d90 0 2024-05-06T14:04:09.921 INFO:tasks.workunit.client.1.smithi174.stdout:5/419: readlink d1/d6/d7/l78 0 2024-05-06T14:04:09.921 INFO:tasks.workunit.client.1.smithi174.stdout:5/420: creat d1/d6/d7/d36/d53/d59/d61/d69/f91 x:0 0 0 2024-05-06T14:04:09.921 INFO:tasks.workunit.client.1.smithi174.stdout:5/421: read - d1/d6/d7/d36/f7f zero size 2024-05-06T14:04:09.921 INFO:tasks.workunit.client.1.smithi174.stdout:5/422: dread d1/d6/df/d35/d3a/f28 [16384,69632] 0 2024-05-06T14:04:09.921 INFO:tasks.workunit.client.1.smithi174.stdout:5/423: symlink d1/l92 0 2024-05-06T14:04:09.921 INFO:tasks.workunit.client.1.smithi174.stdout:5/424: link d1/d6/df/d35/d81/d1e/c4e d1/c93 0 2024-05-06T14:04:09.921 INFO:tasks.workunit.client.1.smithi174.stdout:4/393: rmdir d1/d1f/d27 39 2024-05-06T14:04:09.922 INFO:tasks.workunit.client.1.smithi174.stdout:3/394: dwrite df/d10/f16 [1089536,98304] 0 2024-05-06T14:04:09.922 INFO:tasks.workunit.client.1.smithi174.stdout:5/425: dwrite d1/d6/d2a/f2d [2879488,53248] 0 2024-05-06T14:04:09.978 INFO:tasks.workunit.client.1.smithi174.stdout:4/394: fdatasync d1/d9/f2b 0 2024-05-06T14:04:09.978 INFO:tasks.workunit.client.1.smithi174.stdout:4/395: mknod d1/d48/d5a/d5f/c94 0 2024-05-06T14:04:09.978 INFO:tasks.workunit.client.1.smithi174.stdout:9/407: fsync dc/de/f2e 0 2024-05-06T14:04:09.979 INFO:tasks.workunit.client.1.smithi174.stdout:9/408: creat dc/d27/d6d/f8a x:0 0 0 2024-05-06T14:04:09.979 INFO:tasks.workunit.client.1.smithi174.stdout:9/409: chown dc/d27/l7a 18076 1 2024-05-06T14:04:09.979 INFO:tasks.workunit.client.1.smithi174.stdout:9/410: truncate dc/d17/d4c/f72 2587174 0 2024-05-06T14:04:09.979 INFO:tasks.workunit.client.1.smithi174.stdout:9/411: creat dc/de/d6b/f8b x:0 0 0 2024-05-06T14:04:09.979 INFO:tasks.workunit.client.1.smithi174.stdout:3/395: read df/d10/d1b/f33 [179703,89199] 0 2024-05-06T14:04:09.980 INFO:tasks.workunit.client.1.smithi174.stdout:9/412: mknod dc/d27/d51/c8c 0 2024-05-06T14:04:09.982 INFO:tasks.workunit.client.1.smithi174.stdout:4/396: mkdir d1/d1f/d27/d3e/d6e/d50/d95 0 2024-05-06T14:04:09.982 INFO:tasks.workunit.client.1.smithi174.stdout:9/413: mkdir dc/d17/d3a/d8d 0 2024-05-06T14:04:09.982 INFO:tasks.workunit.client.1.smithi174.stdout:3/396: creat df/d10/d1b/d7e/d57/f80 x:0 0 0 2024-05-06T14:04:09.982 INFO:tasks.workunit.client.1.smithi174.stdout:9/414: mkdir dc/d14/d43/d8e 0 2024-05-06T14:04:10.016 INFO:tasks.workunit.client.1.smithi174.stdout:4/397: fdatasync d1/d1f/d27/d3e/d6e/d50/f60 0 2024-05-06T14:04:10.016 INFO:tasks.workunit.client.1.smithi174.stdout:4/398: rmdir d1/d1f/d27/d3e/d6e/d50/d79 0 2024-05-06T14:04:10.016 INFO:tasks.workunit.client.1.smithi174.stdout:4/399: creat d1/d1f/d27/d84/f96 x:0 0 0 2024-05-06T14:04:10.016 INFO:tasks.workunit.client.1.smithi174.stdout:4/400: mkdir d1/d48/d5a/d97 0 2024-05-06T14:04:10.017 INFO:tasks.workunit.client.1.smithi174.stdout:5/426: dwrite d1/d6/d7/d3e/f77 [4550656,86016] 0 2024-05-06T14:04:10.017 INFO:tasks.workunit.client.1.smithi174.stdout:5/427: rename d1/d6/d7/d36/d53/d59/d61/d69/f7d to d1/d6/d7/d8e/f94 0 2024-05-06T14:04:10.020 INFO:tasks.workunit.client.1.smithi174.stdout:3/397: dwrite df/d10/d1b/d7e/f75 [106496,53248] 0 2024-05-06T14:04:10.020 INFO:tasks.workunit.client.1.smithi174.stdout:4/401: dwrite d1/d1f/d27/d3e/d6e/d50/f60 [1601536,102400] 0 2024-05-06T14:04:10.020 INFO:tasks.workunit.client.1.smithi174.stdout:4/402: rename d1/d1a to d1/d9/d15/d98 0 2024-05-06T14:04:10.020 INFO:tasks.workunit.client.1.smithi174.stdout:4/403: write d1/d9/f18 [327266,59937] 0 2024-05-06T14:04:10.020 INFO:tasks.workunit.client.1.smithi174.stdout:4/404: chown d1/c4 22970 1 2024-05-06T14:04:10.020 INFO:tasks.workunit.client.1.smithi174.stdout:4/405: symlink d1/d9/d15/d35/l99 0 2024-05-06T14:04:10.066 INFO:tasks.workunit.client.1.smithi174.stdout:5/428: fdatasync d1/d6/df/d35/d81/f1a 0 2024-05-06T14:04:10.066 INFO:tasks.workunit.client.1.smithi174.stdout:5/429: unlink d1/f85 0 2024-05-06T14:04:10.066 INFO:tasks.workunit.client.1.smithi174.stdout:5/430: dread d1/d6/f4a [532480,20480] 0 2024-05-06T14:04:10.067 INFO:tasks.workunit.client.1.smithi174.stdout:5/431: chown d1/f10 3502727 1 2024-05-06T14:04:10.067 INFO:tasks.workunit.client.1.smithi174.stdout:9/415: fdatasync dc/d27/d51/f65 0 2024-05-06T14:04:10.067 INFO:tasks.workunit.client.1.smithi174.stdout:5/432: write d1/d6/f4a [343122,20767] 0 2024-05-06T14:04:10.067 INFO:tasks.workunit.client.1.smithi174.stdout:9/416: stat l8 0 2024-05-06T14:04:10.068 INFO:tasks.workunit.client.1.smithi174.stdout:5/433: chown d1/d6/d7/d36/d53/f74 128116614 1 2024-05-06T14:04:10.068 INFO:tasks.workunit.client.1.smithi174.stdout:9/417: creat dc/d17/d3a/d8d/f8f x:0 0 0 2024-05-06T14:04:10.068 INFO:tasks.workunit.client.1.smithi174.stdout:9/418: symlink dc/d27/d60/l90 0 2024-05-06T14:04:10.068 INFO:tasks.workunit.client.1.smithi174.stdout:9/419: readlink dc/d27/d60/l90 0 2024-05-06T14:04:10.068 INFO:tasks.workunit.client.1.smithi174.stdout:9/420: rename dc/d27/c66 to dc/d27/d51/c91 0 2024-05-06T14:04:10.068 INFO:tasks.workunit.client.1.smithi174.stdout:9/421: write dc/d14/d43/f4d [790883,69150] 0 2024-05-06T14:04:10.068 INFO:tasks.workunit.client.1.smithi174.stdout:9/422: write dc/de/f2e [1245504,105946] 0 2024-05-06T14:04:10.068 INFO:tasks.workunit.client.1.smithi174.stdout:9/423: creat dc/d14/d43/d8e/f92 x:0 0 0 2024-05-06T14:04:10.069 INFO:tasks.workunit.client.1.smithi174.stdout:9/424: truncate dc/d27/d51/f65 121194 0 2024-05-06T14:04:10.069 INFO:tasks.workunit.client.1.smithi174.stdout:9/425: chown dc/d27/l5e 6318521 1 2024-05-06T14:04:10.071 INFO:tasks.workunit.client.1.smithi174.stdout:4/406: dwrite d1/d9/d15/f93 [8192,122880] 0 2024-05-06T14:04:10.071 INFO:tasks.workunit.client.1.smithi174.stdout:4/407: chown d1/d1f/d27/d3e/f7b 14616 1 2024-05-06T14:04:10.071 INFO:tasks.workunit.client.1.smithi174.stdout:4/408: write d1/d1f/d27/d3e/f4f [1790087,14609] 0 2024-05-06T14:04:10.071 INFO:tasks.workunit.client.1.smithi174.stdout:3/398: dwrite df/d2d/f31 [520192,16384] 0 2024-05-06T14:04:10.071 INFO:tasks.workunit.client.1.smithi174.stdout:4/409: mknod d1/d48/d5a/d97/c9a 0 2024-05-06T14:04:10.071 INFO:tasks.workunit.client.1.smithi174.stdout:4/410: mknod d1/d1f/d27/d3e/d6e/d50/c9b 0 2024-05-06T14:04:10.071 INFO:tasks.workunit.client.1.smithi174.stdout:4/411: creat d1/d9/d15/f9c x:0 0 0 2024-05-06T14:04:10.072 INFO:tasks.workunit.client.1.smithi174.stdout:3/399: write df/f28 [1359240,87330] 0 2024-05-06T14:04:10.072 INFO:tasks.workunit.client.1.smithi174.stdout:5/434: dwrite d1/d6/df/d35/d3a/de/f63 [1482752,45056] 0 2024-05-06T14:04:10.072 INFO:tasks.workunit.client.1.smithi174.stdout:3/400: mkdir df/d2d/d4e/d81 0 2024-05-06T14:04:10.072 INFO:tasks.workunit.client.1.smithi174.stdout:3/401: mknod df/d2d/d4d/c82 0 2024-05-06T14:04:10.072 INFO:tasks.workunit.client.1.smithi174.stdout:3/402: read - df/d10/d1b/d7e/f51 zero size 2024-05-06T14:04:10.072 INFO:tasks.workunit.client.1.smithi174.stdout:5/435: write d1/d6/df/d35/d3a/de/f3f [217954,30019] 0 2024-05-06T14:04:10.073 INFO:tasks.workunit.client.1.smithi174.stdout:5/436: truncate d1/d6/d2a/f2d 5544041 0 2024-05-06T14:04:10.073 INFO:tasks.workunit.client.1.smithi174.stdout:5/437: link d1/d6/df/f30 d1/d6/d7/f95 0 2024-05-06T14:04:10.073 INFO:tasks.workunit.client.1.smithi174.stdout:5/438: write d1/d6/df/d35/d81/d1e/f56 [984928,34716] 0 2024-05-06T14:04:10.073 INFO:tasks.workunit.client.1.smithi174.stdout:5/439: read d1/d6/df/d35/d3a/de/f63 [589230,47021] 0 2024-05-06T14:04:10.073 INFO:tasks.workunit.client.1.smithi174.stdout:5/440: mknod d1/d6/df/d35/d3a/d41/c96 0 2024-05-06T14:04:10.073 INFO:tasks.workunit.client.1.smithi174.stdout:5/441: truncate d1/d6/df/d35/d3a/f33 874649 0 2024-05-06T14:04:10.073 INFO:tasks.workunit.client.1.smithi174.stdout:5/442: stat d1/d6/d7/d36/d53/d59/d61/d69 0 2024-05-06T14:04:10.115 INFO:tasks.workunit.client.1.smithi174.stdout:3/403: dwrite df/d10/d1b/d7e/d57/f63 [122880,40960] 0 2024-05-06T14:04:10.115 INFO:tasks.workunit.client.1.smithi174.stdout:9/426: dwrite dc/d14/d43/f59 [978944,126976] 0 2024-05-06T14:04:10.115 INFO:tasks.workunit.client.1.smithi174.stdout:4/412: dwrite d1/d1f/d27/d3e/f4f [860160,45056] 0 2024-05-06T14:04:10.115 INFO:tasks.workunit.client.1.smithi174.stdout:4/413: chown d1/d48/f85 1 1 2024-05-06T14:04:10.116 INFO:tasks.workunit.client.1.smithi174.stdout:0/331: sync 2024-05-06T14:04:10.178 INFO:tasks.workunit.client.1.smithi174.stdout:9/427: fsync dc/d27/d60/f6a 0 2024-05-06T14:04:10.178 INFO:tasks.workunit.client.1.smithi174.stdout:9/428: chown dc/l45 0 1 2024-05-06T14:04:10.179 INFO:tasks.workunit.client.1.smithi174.stdout:9/429: chown dc/df/l33 577 1 2024-05-06T14:04:10.180 INFO:tasks.workunit.client.1.smithi174.stdout:5/443: dwrite d1/d6/f13 [5865472,4096] 0 2024-05-06T14:04:10.180 INFO:tasks.workunit.client.1.smithi174.stdout:4/414: creat d1/d48/f9d x:0 0 0 2024-05-06T14:04:10.180 INFO:tasks.workunit.client.1.smithi174.stdout:0/332: symlink d0/d1a/l6e 0 2024-05-06T14:04:10.180 INFO:tasks.workunit.client.1.smithi174.stdout:4/415: truncate d1/d9/d15/d98/f66 2088663 0 2024-05-06T14:04:10.180 INFO:tasks.workunit.client.1.smithi174.stdout:4/416: truncate d1/d48/f9d 944502 0 2024-05-06T14:04:10.181 INFO:tasks.workunit.client.1.smithi174.stdout:3/404: write df/d10/d1b/f24 [1293157,77111] 0 2024-05-06T14:04:10.181 INFO:tasks.workunit.client.1.smithi174.stdout:5/444: mknod d1/d6/d2a/c97 0 2024-05-06T14:04:10.181 INFO:tasks.workunit.client.1.smithi174.stdout:5/445: chown d1/d6/df/d35/d3a/de/f5d 2454984 1 2024-05-06T14:04:10.181 INFO:tasks.workunit.client.1.smithi174.stdout:4/417: symlink d1/d9/d15/d74/d86/l9e 0 2024-05-06T14:04:10.181 INFO:tasks.workunit.client.1.smithi174.stdout:4/418: dread d1/d2e/f40 [458752,12288] 0 2024-05-06T14:04:10.181 INFO:tasks.workunit.client.1.smithi174.stdout:4/419: unlink d1/c2 0 2024-05-06T14:04:10.183 INFO:tasks.workunit.client.1.smithi174.stdout:9/430: dwrite dc/df/f4a [1003520,90112] 0 2024-05-06T14:04:10.184 INFO:tasks.workunit.client.1.smithi174.stdout:9/431: rmdir dc/d17/d3a/d8d 39 2024-05-06T14:04:10.184 INFO:tasks.workunit.client.1.smithi174.stdout:5/446: dwrite d1/d6/d7/d36/d53/d59/d61/d69/f91 [364544,77824] 0 2024-05-06T14:04:10.188 INFO:tasks.workunit.client.1.smithi174.stdout:3/405: write df/d2d/f31 [666457,85338] 0 2024-05-06T14:04:10.188 INFO:tasks.workunit.client.1.smithi174.stdout:3/406: creat df/d10/d1b/d7e/f83 x:0 0 0 2024-05-06T14:04:10.188 INFO:tasks.workunit.client.1.smithi174.stdout:3/407: chown fe 17688808 1 2024-05-06T14:04:10.188 INFO:tasks.workunit.client.1.smithi174.stdout:3/408: mkdir df/d2d/d84 0 2024-05-06T14:04:10.188 INFO:tasks.workunit.client.1.smithi174.stdout:3/409: readlink df/d10/d1b/d7e/l70 0 2024-05-06T14:04:10.193 INFO:tasks.workunit.client.1.smithi174.stdout:4/420: dread d1/d1f/d27/d3e/d6e/d50/f60 [69632,69632] 0 2024-05-06T14:04:10.193 INFO:tasks.workunit.client.1.smithi174.stdout:4/421: mknod d1/d9/d15/d98/d56/c9f 0 2024-05-06T14:04:10.193 INFO:tasks.workunit.client.1.smithi174.stdout:4/422: mknod d1/d9/d15/d98/d56/ca0 0 2024-05-06T14:04:10.193 INFO:tasks.workunit.client.1.smithi174.stdout:4/423: creat d1/d1f/d27/d2c/d45/fa1 x:0 0 0 2024-05-06T14:04:10.193 INFO:tasks.workunit.client.1.smithi174.stdout:4/424: stat d1/d9/d15/d41/f49 0 2024-05-06T14:04:10.193 INFO:tasks.workunit.client.1.smithi174.stdout:4/425: readlink d1/l11 0 2024-05-06T14:04:10.194 INFO:tasks.workunit.client.1.smithi174.stdout:4/426: truncate d1/d1f/d27/d3e/f7b 349716 0 2024-05-06T14:04:10.194 INFO:tasks.workunit.client.1.smithi174.stdout:4/427: dread d1/d9/d15/d98/d56/f78 [516096,36864] 0 2024-05-06T14:04:10.194 INFO:tasks.workunit.client.1.smithi174.stdout:4/428: read d1/fd [299332,64364] 0 2024-05-06T14:04:10.194 INFO:tasks.workunit.client.1.smithi174.stdout:4/429: chown d1/d1f/d27/f3b 29418 1 2024-05-06T14:04:10.194 INFO:tasks.workunit.client.1.smithi174.stdout:4/430: stat d1/d1f/d27/d3e/f4f 0 2024-05-06T14:04:10.194 INFO:tasks.workunit.client.1.smithi174.stdout:4/431: rmdir d1/d48/d5a/d97 39 2024-05-06T14:04:10.194 INFO:tasks.workunit.client.1.smithi174.stdout:4/432: chown d1/d1f 1811 1 2024-05-06T14:04:10.195 INFO:tasks.workunit.client.1.smithi174.stdout:4/433: symlink d1/d1f/d27/d3e/d6e/la2 0 2024-05-06T14:04:10.195 INFO:tasks.workunit.client.1.smithi174.stdout:4/434: creat d1/d9/d15/d35/fa3 x:0 0 0 2024-05-06T14:04:10.195 INFO:tasks.workunit.client.1.smithi174.stdout:4/435: dread d1/d1f/d27/d3e/d6e/d50/f57 [626688,98304] 0 2024-05-06T14:04:10.195 INFO:tasks.workunit.client.1.smithi174.stdout:4/436: chown d1/d9/d15/l44 1731 1 2024-05-06T14:04:10.195 INFO:tasks.workunit.client.1.smithi174.stdout:4/437: truncate d1/f31 624209 0 2024-05-06T14:04:10.195 INFO:tasks.workunit.client.1.smithi174.stdout:4/438: truncate d1/d1f/f62 158443 0 2024-05-06T14:04:10.195 INFO:tasks.workunit.client.1.smithi174.stdout:4/439: dread d1/d48/d5a/d61/f63 [991232,98304] 0 2024-05-06T14:04:10.196 INFO:tasks.workunit.client.1.smithi174.stdout:4/440: read d1/d9/d15/f47 [657226,29647] 0 2024-05-06T14:04:10.196 INFO:tasks.workunit.client.1.smithi174.stdout:4/441: unlink d1/d48/f9d 0 2024-05-06T14:04:10.196 INFO:tasks.workunit.client.1.smithi174.stdout:4/442: dread d1/d1f/d27/d3e/f70 [1118208,94208] 0 2024-05-06T14:04:10.196 INFO:tasks.workunit.client.1.smithi174.stdout:4/443: mknod d1/d1f/d27/d2c/ca4 0 2024-05-06T14:04:10.270 INFO:tasks.workunit.client.1.smithi174.stdout:3/410: dwrite df/d2d/d5b/f71 [311296,110592] 0 2024-05-06T14:04:10.270 INFO:tasks.workunit.client.1.smithi174.stdout:3/411: symlink df/d10/d1b/l85 0 2024-05-06T14:04:10.270 INFO:tasks.workunit.client.1.smithi174.stdout:3/412: creat df/d2d/f86 x:0 0 0 2024-05-06T14:04:10.270 INFO:tasks.workunit.client.1.smithi174.stdout:3/413: mkdir df/d2d/d87 0 2024-05-06T14:04:10.271 INFO:tasks.workunit.client.1.smithi174.stdout:3/414: truncate df/f1f 161152 0 2024-05-06T14:04:10.271 INFO:tasks.workunit.client.1.smithi174.stdout:3/415: rename df/d2d/f58 to df/d2d/d87/f88 0 2024-05-06T14:04:10.271 INFO:tasks.workunit.client.1.smithi174.stdout:3/416: chown df/d10/d1b/d7e/d5a 1510 1 2024-05-06T14:04:10.271 INFO:tasks.workunit.client.1.smithi174.stdout:3/417: dread - df/d10/d1b/d7e/d5a/f6a zero size 2024-05-06T14:04:10.271 INFO:tasks.workunit.client.1.smithi174.stdout:3/418: write df/d10/d1b/d7e/d57/f63 [518102,111508] 0 2024-05-06T14:04:10.272 INFO:tasks.workunit.client.1.smithi174.stdout:1/294: sync 2024-05-06T14:04:10.273 INFO:tasks.workunit.client.1.smithi174.stdout:1/295: dread - d11/d67/f70 zero size 2024-05-06T14:04:10.273 INFO:tasks.workunit.client.1.smithi174.stdout:1/296: mknod d11/d1f/d55/c73 0 2024-05-06T14:04:10.273 INFO:tasks.workunit.client.1.smithi174.stdout:4/444: dwrite d1/d1f/d27/d84/f96 [16384,114688] 0 2024-05-06T14:04:10.273 INFO:tasks.workunit.client.1.smithi174.stdout:4/445: link d1/d1f/d27/d3e/d6e/f55 d1/d9/d15/d35/fa5 0 2024-05-06T14:04:10.273 INFO:tasks.workunit.client.1.smithi174.stdout:4/446: chown d1/d1f/d27/d3e/d6e/d50/d95 8103 1 2024-05-06T14:04:10.273 INFO:tasks.workunit.client.1.smithi174.stdout:9/432: dwrite dc/d17/d4c/f72 [180224,8192] 0 2024-05-06T14:04:10.273 INFO:tasks.workunit.client.1.smithi174.stdout:5/447: dwrite d1/d6/df/d35/d3a/de/f80 [1007616,12288] 0 2024-05-06T14:04:10.274 INFO:tasks.workunit.client.1.smithi174.stdout:5/448: rename d1/d6/d7/d36/d53/d59/f83 to d1/d6/d7/d36/d53/f98 0 2024-05-06T14:04:10.274 INFO:tasks.workunit.client.1.smithi174.stdout:5/449: dread d1/d6/df/d35/d3a/f33 [253952,32768] 0 2024-05-06T14:04:10.274 INFO:tasks.workunit.client.1.smithi174.stdout:5/450: readlink d1/d6/df/d35/d3a/de/d6b/l72 0 2024-05-06T14:04:10.336 INFO:tasks.workunit.client.1.smithi174.stdout:0/333: fsync d0/f59 0 2024-05-06T14:04:10.336 INFO:tasks.workunit.client.1.smithi174.stdout:3/419: fdatasync df/d10/d1b/d7e/f6d 0 2024-05-06T14:04:10.336 INFO:tasks.workunit.client.1.smithi174.stdout:3/420: creat df/d10/d1b/d59/f89 x:0 0 0 2024-05-06T14:04:10.336 INFO:tasks.workunit.client.1.smithi174.stdout:3/421: chown df/d10/d1b/d59 3 1 2024-05-06T14:04:10.336 INFO:tasks.workunit.client.1.smithi174.stdout:0/334: read d0/d3/f40 [1227127,93929] 0 2024-05-06T14:04:10.337 INFO:tasks.workunit.client.1.smithi174.stdout:3/422: rename df/d10/d1b/d7e/d5a/l64 to df/d2d/d5b/l8a 0 2024-05-06T14:04:10.337 INFO:tasks.workunit.client.1.smithi174.stdout:3/423: truncate df/f18 85908 0 2024-05-06T14:04:10.339 INFO:tasks.workunit.client.1.smithi174.stdout:4/447: dwrite d1/d9/d15/d98/f1c [16384,102400] 0 2024-05-06T14:04:10.341 INFO:tasks.workunit.client.1.smithi174.stdout:0/335: creat d0/d4/d8/d25/f6f x:0 0 0 2024-05-06T14:04:10.342 INFO:tasks.workunit.client.1.smithi174.stdout:4/448: mknod d1/d1f/d27/ca6 0 2024-05-06T14:04:10.342 INFO:tasks.workunit.client.1.smithi174.stdout:3/424: mknod df/c8b 0 2024-05-06T14:04:10.342 INFO:tasks.workunit.client.1.smithi174.stdout:9/433: dread dc/d27/d60/f69 [176128,114688] 0 2024-05-06T14:04:10.342 INFO:tasks.workunit.client.1.smithi174.stdout:5/451: dwrite d1/d6/d2a/f2d [2793472,24576] 0 2024-05-06T14:04:10.342 INFO:tasks.workunit.client.1.smithi174.stdout:9/434: dread - dc/d27/d6d/f6f zero size 2024-05-06T14:04:10.342 INFO:tasks.workunit.client.1.smithi174.stdout:4/449: getdents d1/d2e 0 2024-05-06T14:04:10.342 INFO:tasks.workunit.client.1.smithi174.stdout:0/336: rename d0/d4/d8/d25/d5c/d44/f54 to d0/d4/d8/f70 0 2024-05-06T14:04:10.343 INFO:tasks.workunit.client.1.smithi174.stdout:0/337: chown d0/d16 0 1 2024-05-06T14:04:10.343 INFO:tasks.workunit.client.1.smithi174.stdout:4/450: dread - d1/d48/d5a/d5f/f8b zero size 2024-05-06T14:04:10.343 INFO:tasks.workunit.client.1.smithi174.stdout:0/338: chown d0/f59 3454441 1 2024-05-06T14:04:10.343 INFO:tasks.workunit.client.1.smithi174.stdout:4/451: dread - d1/d9/d15/d98/f76 zero size 2024-05-06T14:04:10.343 INFO:tasks.workunit.client.1.smithi174.stdout:4/452: mknod d1/ca7 0 2024-05-06T14:04:10.343 INFO:tasks.workunit.client.1.smithi174.stdout:0/339: truncate d0/d4/d8/d25/f63 54294 0 2024-05-06T14:04:10.343 INFO:tasks.workunit.client.1.smithi174.stdout:9/435: unlink dc/df/f34 0 2024-05-06T14:04:10.343 INFO:tasks.workunit.client.1.smithi174.stdout:9/436: chown dc/f3d 171 1 2024-05-06T14:04:10.344 INFO:tasks.workunit.client.1.smithi174.stdout:4/453: creat d1/d48/d5a/d61/fa8 x:0 0 0 2024-05-06T14:04:10.344 INFO:tasks.workunit.client.1.smithi174.stdout:0/340: symlink d0/d4/l71 0 2024-05-06T14:04:10.344 INFO:tasks.workunit.client.1.smithi174.stdout:0/341: symlink d0/d3/d5d/d38/l72 0 2024-05-06T14:04:10.344 INFO:tasks.workunit.client.1.smithi174.stdout:4/454: write d1/d9/d15/d98/f28 [1275133,45538] 0 2024-05-06T14:04:10.344 INFO:tasks.workunit.client.1.smithi174.stdout:0/342: rename d0/d1a/c67 to d0/d1a/d17/d2e/c73 0 2024-05-06T14:04:10.344 INFO:tasks.workunit.client.1.smithi174.stdout:0/343: dread - d0/d4/d8/d25/f6f zero size 2024-05-06T14:04:10.344 INFO:tasks.workunit.client.1.smithi174.stdout:4/455: symlink d1/d48/d5a/d61/la9 0 2024-05-06T14:04:10.344 INFO:tasks.workunit.client.1.smithi174.stdout:0/344: write d0/d1a/f6c [165244,61270] 0 2024-05-06T14:04:10.344 INFO:tasks.workunit.client.1.smithi174.stdout:0/345: mknod d0/d1a/d17/c74 0 2024-05-06T14:04:10.345 INFO:tasks.workunit.client.1.smithi174.stdout:4/456: symlink d1/d9/d15/d74/laa 0 2024-05-06T14:04:10.345 INFO:tasks.workunit.client.1.smithi174.stdout:4/457: truncate d1/d9/d15/d98/f1c 499296 0 2024-05-06T14:04:10.345 INFO:tasks.workunit.client.1.smithi174.stdout:0/346: creat d0/d1a/d17/d2e/d58/f75 x:0 0 0 2024-05-06T14:04:10.408 INFO:tasks.workunit.client.1.smithi174.stdout:3/425: dwrite df/d10/f1c [2551808,53248] 0 2024-05-06T14:04:10.408 INFO:tasks.workunit.client.1.smithi174.stdout:3/426: chown df/d10/d1b/d59/c5e 236 1 2024-05-06T14:04:10.408 INFO:tasks.workunit.client.1.smithi174.stdout:3/427: creat df/d10/d1b/d7e/f8c x:0 0 0 2024-05-06T14:04:10.408 INFO:tasks.workunit.client.1.smithi174.stdout:3/428: write df/d2d/d5b/f71 [656926,118860] 0 2024-05-06T14:04:10.408 INFO:tasks.workunit.client.1.smithi174.stdout:3/429: mknod df/d10/d1b/d59/c8d 0 2024-05-06T14:04:10.409 INFO:tasks.workunit.client.1.smithi174.stdout:3/430: read df/d2d/f4a [655925,1507] 0 2024-05-06T14:04:10.409 INFO:tasks.workunit.client.1.smithi174.stdout:3/431: dread df/d10/d1b/f5c [1236992,86016] 0 2024-05-06T14:04:10.409 INFO:tasks.workunit.client.1.smithi174.stdout:3/432: link df/d10/l47 df/d10/d1b/d7e/l8e 0 2024-05-06T14:04:10.409 INFO:tasks.workunit.client.1.smithi174.stdout:3/433: link df/d2d/f86 df/d10/d1b/d7e/d57/f8f 0 2024-05-06T14:04:10.409 INFO:tasks.workunit.client.1.smithi174.stdout:3/434: dread df/f18 [53248,49152] 0 2024-05-06T14:04:10.409 INFO:tasks.workunit.client.1.smithi174.stdout:3/435: creat df/f90 x:0 0 0 2024-05-06T14:04:10.409 INFO:tasks.workunit.client.1.smithi174.stdout:9/437: dwrite dc/d14/d43/f4d [446464,77824] 0 2024-05-06T14:04:10.409 INFO:tasks.workunit.client.1.smithi174.stdout:4/458: dwrite d1/d9/d15/d98/f28 [1347584,90112] 0 2024-05-06T14:04:10.410 INFO:tasks.workunit.client.1.smithi174.stdout:0/347: dwrite d0/d1a/d17/d2e/f53 [2019328,118784] 0 2024-05-06T14:04:10.437 INFO:tasks.workunit.client.1.smithi174.stdout:5/452: fdatasync d1/d6/df/f67 0 2024-05-06T14:04:10.437 INFO:tasks.workunit.client.1.smithi174.stdout:3/436: fdatasync df/d10/d1b/d7e/f51 0 2024-05-06T14:04:10.437 INFO:tasks.workunit.client.1.smithi174.stdout:3/437: chown df/d10/l7c 5269887 1 2024-05-06T14:04:10.437 INFO:tasks.workunit.client.1.smithi174.stdout:3/438: chown df/d10/d1b/d7e/l62 7 1 2024-05-06T14:04:10.438 INFO:tasks.workunit.client.1.smithi174.stdout:3/439: chown df/d10/l15 97831046 1 2024-05-06T14:04:10.439 INFO:tasks.workunit.client.1.smithi174.stdout:0/348: mknod d0/d36/d3f/d5e/c76 0 2024-05-06T14:04:10.442 INFO:tasks.workunit.client.1.smithi174.stdout:4/459: dwrite d1/d1f/d27/f3b [737280,49152] 0 2024-05-06T14:04:10.442 INFO:tasks.workunit.client.1.smithi174.stdout:5/453: truncate d1/d6/df/d35/d3a/de/f63 525383 0 2024-05-06T14:04:10.443 INFO:tasks.workunit.client.1.smithi174.stdout:0/349: mknod d0/d4/d8/d25/c77 0 2024-05-06T14:04:10.443 INFO:tasks.workunit.client.1.smithi174.stdout:5/454: readlink d1/l19 0 2024-05-06T14:04:10.443 INFO:tasks.workunit.client.1.smithi174.stdout:5/455: dread - d1/d6/df/f67 zero size 2024-05-06T14:04:10.443 INFO:tasks.workunit.client.1.smithi174.stdout:0/350: rename d0/d4/d8/d25/d5c/c2f to d0/d3/d5d/c78 0 2024-05-06T14:04:10.443 INFO:tasks.workunit.client.1.smithi174.stdout:3/440: symlink df/d2d/d84/l91 0 2024-05-06T14:04:10.443 INFO:tasks.workunit.client.1.smithi174.stdout:5/456: mkdir d1/d6/df/d35/d81/d60/d99 0 2024-05-06T14:04:10.443 INFO:tasks.workunit.client.1.smithi174.stdout:4/460: symlink d1/d48/d5a/d61/lab 0 2024-05-06T14:04:10.444 INFO:tasks.workunit.client.1.smithi174.stdout:0/351: mkdir d0/d4/d8/d79 0 2024-05-06T14:04:10.444 INFO:tasks.workunit.client.1.smithi174.stdout:0/352: stat d0/d1a/f30 0 2024-05-06T14:04:10.444 INFO:tasks.workunit.client.1.smithi174.stdout:4/461: creat d1/fac x:0 0 0 2024-05-06T14:04:10.444 INFO:tasks.workunit.client.1.smithi174.stdout:4/462: truncate d1/d9/f22 1909206 0 2024-05-06T14:04:10.444 INFO:tasks.workunit.client.1.smithi174.stdout:4/463: truncate d1/d1f/d27/d3e/d6e/d50/f5c 872329 0 2024-05-06T14:04:10.444 INFO:tasks.workunit.client.1.smithi174.stdout:4/464: chown d1/d9/d53/d6b 19572608 1 2024-05-06T14:04:10.444 INFO:tasks.workunit.client.1.smithi174.stdout:0/353: write d0/d1a/f30 [463340,109371] 0 2024-05-06T14:04:10.444 INFO:tasks.workunit.client.1.smithi174.stdout:4/465: creat d1/d9/d15/d92/fad x:0 0 0 2024-05-06T14:04:10.445 INFO:tasks.workunit.client.1.smithi174.stdout:0/354: dread d0/d3/d5d/f43 [8192,69632] 0 2024-05-06T14:04:10.445 INFO:tasks.workunit.client.1.smithi174.stdout:4/466: creat d1/d48/d5a/d97/fae x:0 0 0 2024-05-06T14:04:10.445 INFO:tasks.workunit.client.1.smithi174.stdout:0/355: rename d0/d36/d5a to d0/d36/d3f/d7a 0 2024-05-06T14:04:10.445 INFO:tasks.workunit.client.1.smithi174.stdout:4/467: getdents d1/d9/d15/d74/d86/d8f 0 2024-05-06T14:04:10.445 INFO:tasks.workunit.client.1.smithi174.stdout:4/468: write d1/d48/d5a/d61/d68/f81 [1817914,123107] 0 2024-05-06T14:04:10.445 INFO:tasks.workunit.client.1.smithi174.stdout:4/469: truncate d1/d9/d15/f21 345276 0 2024-05-06T14:04:10.445 INFO:tasks.workunit.client.1.smithi174.stdout:4/470: rename d1/d9/d15/f32 to d1/d48/d5a/faf 0 2024-05-06T14:04:10.445 INFO:tasks.workunit.client.1.smithi174.stdout:4/471: unlink d1/d48/f85 0 2024-05-06T14:04:10.446 INFO:tasks.workunit.client.1.smithi174.stdout:4/472: dread d1/f5 [69632,77824] 0 2024-05-06T14:04:10.446 INFO:tasks.workunit.client.1.smithi174.stdout:4/473: mkdir d1/d1f/d27/d3e/d6e/d50/db0 0 2024-05-06T14:04:10.446 INFO:tasks.workunit.client.1.smithi174.stdout:4/474: readlink d1/d9/d15/l67 0 2024-05-06T14:04:10.446 INFO:tasks.workunit.client.1.smithi174.stdout:3/441: dwrite df/d10/d1b/d7e/f83 [954368,36864] 0 2024-05-06T14:04:10.446 INFO:tasks.workunit.client.1.smithi174.stdout:5/457: dwrite d1/d6/df/d35/d81/f1b [208896,94208] 0 2024-05-06T14:04:10.497 INFO:tasks.workunit.client.1.smithi174.stdout:4/475: fdatasync d1/d2e/f33 0 2024-05-06T14:04:10.498 INFO:tasks.workunit.client.1.smithi174.stdout:4/476: write d1/d1f/d27/d3e/d6e/d50/f60 [2195495,93811] 0 2024-05-06T14:04:10.503 INFO:tasks.workunit.client.1.smithi174.stdout:3/442: link df/d10/d1b/d7e/d57/f61 df/f92 0 2024-05-06T14:04:10.503 INFO:tasks.workunit.client.1.smithi174.stdout:5/458: truncate d1/d6/d7/d36/d53/f74 669258 0 2024-05-06T14:04:10.503 INFO:tasks.workunit.client.1.smithi174.stdout:4/477: mknod d1/d1f/d27/d3e/cb1 0 2024-05-06T14:04:10.503 INFO:tasks.workunit.client.1.smithi174.stdout:5/459: mkdir d1/d6/df/d35/d3a/de/d6b/d9a 0 2024-05-06T14:04:10.504 INFO:tasks.workunit.client.1.smithi174.stdout:5/460: symlink d1/d6/df/d35/d81/d8d/l9b 0 2024-05-06T14:04:10.504 INFO:tasks.workunit.client.1.smithi174.stdout:5/461: symlink d1/d6/df/d35/d81/d60/d99/l9c 0 2024-05-06T14:04:10.504 INFO:tasks.workunit.client.1.smithi174.stdout:5/462: write d1/d6/df/d35/d3a/de/f3f [215534,6913] 0 2024-05-06T14:04:10.504 INFO:tasks.workunit.client.1.smithi174.stdout:5/463: symlink d1/d6/df/d35/d81/d60/l9d 0 2024-05-06T14:04:10.504 INFO:tasks.workunit.client.1.smithi174.stdout:5/464: creat d1/d6/d7/d36/d53/f9e x:0 0 0 2024-05-06T14:04:10.504 INFO:tasks.workunit.client.1.smithi174.stdout:5/465: write d1/d6/df/d35/d81/d1e/f56 [374713,65183] 0 2024-05-06T14:04:10.504 INFO:tasks.workunit.client.1.smithi174.stdout:5/466: rmdir d1/d6/df/d35/d3a/de 39 2024-05-06T14:04:10.504 INFO:tasks.workunit.client.1.smithi174.stdout:5/467: write d1/d6/df/d35/d3a/d41/f8f [611243,7221] 0 2024-05-06T14:04:10.505 INFO:tasks.workunit.client.1.smithi174.stdout:5/468: mkdir d1/d6/df/d35/d8b/d9f 0 2024-05-06T14:04:10.505 INFO:tasks.workunit.client.1.smithi174.stdout:5/469: dread - d1/d6/d7/d36/f47 zero size 2024-05-06T14:04:10.505 INFO:tasks.workunit.client.1.smithi174.stdout:5/470: rename d1/d6 to d1/d6/df/d35/d81/d60/d82/da0 22 2024-05-06T14:04:10.505 INFO:tasks.workunit.client.1.smithi174.stdout:5/471: dread d1/d6/df/d35/d3a/f33 [335872,20480] 0 2024-05-06T14:04:10.505 INFO:tasks.workunit.client.1.smithi174.stdout:5/472: rename d1/d6/df/d35/d3a/de/d6b to d1/d6/d7/da1 0 2024-05-06T14:04:10.505 INFO:tasks.workunit.client.1.smithi174.stdout:5/473: dread - d1/d6/d7/f2e zero size 2024-05-06T14:04:10.505 INFO:tasks.workunit.client.1.smithi174.stdout:5/474: rename d1/d6/df/d35/d81/d1e/f56 to d1/d6/fa2 0 2024-05-06T14:04:10.505 INFO:tasks.workunit.client.1.smithi174.stdout:5/475: mknod d1/d6/d7/d36/d53/d59/d61/d69/ca3 0 2024-05-06T14:04:10.506 INFO:tasks.workunit.client.1.smithi174.stdout:5/476: read - d1/d6/d7/d36/d53/f9e zero size 2024-05-06T14:04:10.506 INFO:tasks.workunit.client.1.smithi174.stdout:5/477: link d1/d6/df/l20 d1/d6/d7/d36/la4 0 2024-05-06T14:04:10.506 INFO:tasks.workunit.client.1.smithi174.stdout:5/478: getdents d1/d6/d7 0 2024-05-06T14:04:10.506 INFO:tasks.workunit.client.1.smithi174.stdout:4/478: dwrite d1/d1f/d27/d3e/f4f [692224,77824] 0 2024-05-06T14:04:10.506 INFO:tasks.workunit.client.1.smithi174.stdout:4/479: chown d1/d9/d15/d98/f28 43006138 1 2024-05-06T14:04:10.556 INFO:tasks.workunit.client.1.smithi174.stdout:2/402: sync 2024-05-06T14:04:10.556 INFO:tasks.workunit.client.1.smithi174.stdout:7/352: sync 2024-05-06T14:04:10.556 INFO:tasks.workunit.client.1.smithi174.stdout:8/509: sync 2024-05-06T14:04:10.557 INFO:tasks.workunit.client.1.smithi174.stdout:6/517: sync 2024-05-06T14:04:10.557 INFO:tasks.workunit.client.1.smithi174.stdout:2/403: rename d0/d1/d2/d4/d6/d3c/d61 to d0/d24/d77 0 2024-05-06T14:04:10.557 INFO:tasks.workunit.client.1.smithi174.stdout:2/404: readlink d0/db/l13 0 2024-05-06T14:04:10.557 INFO:tasks.workunit.client.1.smithi174.stdout:8/510: rename d4/de/c1a to d4/de/d24/ca9 0 2024-05-06T14:04:10.557 INFO:tasks.workunit.client.1.smithi174.stdout:6/518: creat d0/df/d45/d85/fb2 x:0 0 0 2024-05-06T14:04:10.557 INFO:tasks.workunit.client.1.smithi174.stdout:8/511: getdents d4/de/d24/d5e 0 2024-05-06T14:04:10.557 INFO:tasks.workunit.client.1.smithi174.stdout:8/512: chown d4/c10 246375 1 2024-05-06T14:04:10.557 INFO:tasks.workunit.client.1.smithi174.stdout:2/405: creat d0/f78 x:0 0 0 2024-05-06T14:04:10.558 INFO:tasks.workunit.client.1.smithi174.stdout:6/519: dread d0/df/d45/f47 [348160,118784] 0 2024-05-06T14:04:10.558 INFO:tasks.workunit.client.1.smithi174.stdout:6/520: getdents d0/d25/d52/d2c/d5f/daa 0 2024-05-06T14:04:10.558 INFO:tasks.workunit.client.1.smithi174.stdout:2/406: truncate d0/d1/d2/d2a/f3a 1308375 0 2024-05-06T14:04:10.558 INFO:tasks.workunit.client.1.smithi174.stdout:6/521: mkdir d0/df/d45/da9/db3 0 2024-05-06T14:04:10.558 INFO:tasks.workunit.client.1.smithi174.stdout:2/407: rename d0/d1/d2/d1b/l60 to d0/d1/d2/d4/d6/l79 0 2024-05-06T14:04:10.558 INFO:tasks.workunit.client.1.smithi174.stdout:2/408: creat d0/d1/d2/d4/d6/f7a x:0 0 0 2024-05-06T14:04:10.558 INFO:tasks.workunit.client.1.smithi174.stdout:2/409: creat d0/db/f7b x:0 0 0 2024-05-06T14:04:10.558 INFO:tasks.workunit.client.1.smithi174.stdout:4/480: dwrite d1/d9/d15/d35/fa3 [438272,126976] 0 2024-05-06T14:04:10.559 INFO:tasks.workunit.client.1.smithi174.stdout:4/481: dread d1/d9/d15/d98/f28 [344064,40960] 0 2024-05-06T14:04:10.559 INFO:tasks.workunit.client.1.smithi174.stdout:2/410: creat d0/d1/d2/d4/d43/f7c x:0 0 0 2024-05-06T14:04:10.559 INFO:tasks.workunit.client.1.smithi174.stdout:2/411: link d0/d1/f5e d0/db/f7d 0 2024-05-06T14:04:10.559 INFO:tasks.workunit.client.1.smithi174.stdout:4/482: write d1/d9/d15/d98/d56/f88 [93817,47376] 0 2024-05-06T14:04:10.559 INFO:tasks.workunit.client.1.smithi174.stdout:2/412: symlink d0/d1/d2/d4/d51/l7e 0 2024-05-06T14:04:10.559 INFO:tasks.workunit.client.1.smithi174.stdout:4/483: getdents d1/d9/d53 0 2024-05-06T14:04:10.559 INFO:tasks.workunit.client.1.smithi174.stdout:2/413: rename d0/d1/d2/d4/f57 to d0/db/f7f 0 2024-05-06T14:04:10.559 INFO:tasks.workunit.client.1.smithi174.stdout:4/484: rename d1/d48/d5a/d61/lab to d1/d1f/lb2 0 2024-05-06T14:04:10.560 INFO:tasks.workunit.client.1.smithi174.stdout:4/485: write d1/d48/d5a/d5f/f8b [454425,58919] 0 2024-05-06T14:04:10.560 INFO:tasks.workunit.client.1.smithi174.stdout:4/486: rmdir d1/d9/d15 39 2024-05-06T14:04:10.603 INFO:tasks.workunit.client.1.smithi174.stdout:7/353: fdatasync d0/d1d/d41/d61/d19/d24/d47/f7a 0 2024-05-06T14:04:10.603 INFO:tasks.workunit.client.1.smithi174.stdout:7/354: rename d0/d1d/d41/d61/d19/d24/f1a to d0/d1d/d41/d61/d19/f7d 0 2024-05-06T14:04:10.603 INFO:tasks.workunit.client.1.smithi174.stdout:7/355: stat d0/d1d/d41/d61/d19/d24 0 2024-05-06T14:04:10.606 INFO:tasks.workunit.client.1.smithi174.stdout:7/356: unlink d0/d1d/d41/d61/d19/c68 0 2024-05-06T14:04:10.606 INFO:tasks.workunit.client.1.smithi174.stdout:2/414: dread d0/d1/d2/d4/d6/f7 [237568,86016] 0 2024-05-06T14:04:10.606 INFO:tasks.workunit.client.1.smithi174.stdout:2/415: rmdir d0/da 39 2024-05-06T14:04:10.607 INFO:tasks.workunit.client.1.smithi174.stdout:2/416: creat d0/da/d3f/d67/f80 x:0 0 0 2024-05-06T14:04:10.608 INFO:tasks.workunit.client.1.smithi174.stdout:6/522: dwrite d0/d25/d52/d4c/fab [630784,98304] 0 2024-05-06T14:04:10.608 INFO:tasks.workunit.client.1.smithi174.stdout:6/523: readlink d0/d25/d52/d4c/l64 0 2024-05-06T14:04:10.608 INFO:tasks.workunit.client.1.smithi174.stdout:6/524: dread d0/d25/d35/f87 [1060864,86016] 0 2024-05-06T14:04:10.609 INFO:tasks.workunit.client.1.smithi174.stdout:6/525: truncate d0/d25/d35/f87 1479040 0 2024-05-06T14:04:10.609 INFO:tasks.workunit.client.1.smithi174.stdout:4/487: dwrite d1/f19 [1806336,40960] 0 2024-05-06T14:04:10.609 INFO:tasks.workunit.client.1.smithi174.stdout:4/488: chown d1/d9/d53/c64 1922670 1 2024-05-06T14:04:10.609 INFO:tasks.workunit.client.1.smithi174.stdout:4/489: read - d1/d1f/d27/d3e/f75 zero size 2024-05-06T14:04:10.609 INFO:tasks.workunit.client.1.smithi174.stdout:4/490: write d1/d9/d15/d35/fa3 [739904,24495] 0 2024-05-06T14:04:10.609 INFO:tasks.workunit.client.1.smithi174.stdout:7/357: dwrite d0/d1d/d41/d61/d19/d24/d14/d52/f20 [962560,4096] 0 2024-05-06T14:04:10.609 INFO:tasks.workunit.client.1.smithi174.stdout:7/358: creat d0/d1d/d41/d61/d19/d24/f7e x:0 0 0 2024-05-06T14:04:10.609 INFO:tasks.workunit.client.1.smithi174.stdout:7/359: rmdir d0/d1d 39 2024-05-06T14:04:10.610 INFO:tasks.workunit.client.1.smithi174.stdout:7/360: mknod d0/c7f 0 2024-05-06T14:04:10.610 INFO:tasks.workunit.client.1.smithi174.stdout:7/361: chown d0/d1d/d41/d61/d19/d24/d14/d52/f20 3669 1 2024-05-06T14:04:10.616 INFO:tasks.workunit.client.1.smithi174.stdout:1/297: sync 2024-05-06T14:04:10.616 INFO:tasks.workunit.client.1.smithi174.stdout:1/298: dread d11/d1f/d27/d32/f4e [688128,4096] 0 2024-05-06T14:04:10.618 INFO:tasks.workunit.client.1.smithi174.stdout:6/526: dwrite d0/df/d3c/f9f [307200,40960] 0 2024-05-06T14:04:10.618 INFO:tasks.workunit.client.1.smithi174.stdout:7/362: dwrite d0/d1d/d41/d61/d28/d37/f40 [962560,94208] 0 2024-05-06T14:04:10.619 INFO:tasks.workunit.client.1.smithi174.stdout:1/299: creat d11/d57/f74 x:0 0 0 2024-05-06T14:04:10.619 INFO:tasks.workunit.client.1.smithi174.stdout:4/491: dwrite d1/d9/d15/f4e [512000,118784] 0 2024-05-06T14:04:10.619 INFO:tasks.workunit.client.1.smithi174.stdout:6/527: chown d0/d25/d52/d2c/d5f/daa 4 1 2024-05-06T14:04:10.619 INFO:tasks.workunit.client.1.smithi174.stdout:2/417: dwrite d0/d1/d2/d4/f6c [106496,102400] 0 2024-05-06T14:04:10.619 INFO:tasks.workunit.client.1.smithi174.stdout:2/418: stat d0/db/d15/l42 0 2024-05-06T14:04:10.619 INFO:tasks.workunit.client.1.smithi174.stdout:1/300: creat d11/d41/d51/f75 x:0 0 0 2024-05-06T14:04:10.619 INFO:tasks.workunit.client.1.smithi174.stdout:7/363: creat d0/d1d/d41/d61/d19/d24/d47/d70/d67/f80 x:0 0 0 2024-05-06T14:04:10.619 INFO:tasks.workunit.client.1.smithi174.stdout:1/301: stat d11/d41/d51/c6e 0 2024-05-06T14:04:10.620 INFO:tasks.workunit.client.1.smithi174.stdout:7/364: chown d0/d1d/l22 9240275 1 2024-05-06T14:04:10.620 INFO:tasks.workunit.client.1.smithi174.stdout:6/528: symlink d0/d25/d52/d2c/d76/lb4 0 2024-05-06T14:04:10.620 INFO:tasks.workunit.client.1.smithi174.stdout:4/492: write d1/d9/d15/d92/fad [731466,36580] 0 2024-05-06T14:04:10.620 INFO:tasks.workunit.client.1.smithi174.stdout:6/529: symlink d0/df/d45/d85/lb5 0 2024-05-06T14:04:10.620 INFO:tasks.workunit.client.1.smithi174.stdout:4/493: dread - d1/d1f/d27/f7a zero size 2024-05-06T14:04:10.620 INFO:tasks.workunit.client.1.smithi174.stdout:2/419: write d0/db/f7b [700493,65801] 0 2024-05-06T14:04:10.620 INFO:tasks.workunit.client.1.smithi174.stdout:1/302: write d11/d41/f66 [1882665,84227] 0 2024-05-06T14:04:10.620 INFO:tasks.workunit.client.1.smithi174.stdout:2/420: chown d0/d16/c63 3064 1 2024-05-06T14:04:10.620 INFO:tasks.workunit.client.1.smithi174.stdout:6/530: symlink d0/df/d45/d4b/lb6 0 2024-05-06T14:04:10.621 INFO:tasks.workunit.client.1.smithi174.stdout:2/421: chown d0/d24/d77/l6e 840 1 2024-05-06T14:04:10.621 INFO:tasks.workunit.client.1.smithi174.stdout:1/303: stat d11/d41/f66 0 2024-05-06T14:04:10.621 INFO:tasks.workunit.client.1.smithi174.stdout:4/494: creat d1/d9/d15/d98/fb3 x:0 0 0 2024-05-06T14:04:10.621 INFO:tasks.workunit.client.1.smithi174.stdout:6/531: dread d0/d25/f40 [258048,40960] 0 2024-05-06T14:04:10.621 INFO:tasks.workunit.client.1.smithi174.stdout:4/495: stat d1/d1f/d27 0 2024-05-06T14:04:10.621 INFO:tasks.workunit.client.1.smithi174.stdout:4/496: rename d1/d9/d53 to d1/d48/db4 0 2024-05-06T14:04:10.621 INFO:tasks.workunit.client.1.smithi174.stdout:4/497: stat d1/d1f/d27/d2c/f3f 0 2024-05-06T14:04:10.621 INFO:tasks.workunit.client.1.smithi174.stdout:2/422: symlink d0/da/d3f/d67/l81 0 2024-05-06T14:04:10.622 INFO:tasks.workunit.client.1.smithi174.stdout:6/532: symlink d0/d25/d52/d2c/d5f/daa/lb7 0 2024-05-06T14:04:10.622 INFO:tasks.workunit.client.1.smithi174.stdout:4/498: dread - d1/d1f/d27/d3e/f75 zero size 2024-05-06T14:04:10.622 INFO:tasks.workunit.client.1.smithi174.stdout:2/423: mknod d0/d1/d2/d1b/c82 0 2024-05-06T14:04:10.622 INFO:tasks.workunit.client.1.smithi174.stdout:4/499: dread d1/d9/d15/f6d [1183744,49152] 0 2024-05-06T14:04:10.622 INFO:tasks.workunit.client.1.smithi174.stdout:2/424: readlink d0/d1/d2/d4/l39 0 2024-05-06T14:04:10.622 INFO:tasks.workunit.client.1.smithi174.stdout:2/425: mknod d0/d1/d2/d1b/c83 0 2024-05-06T14:04:10.622 INFO:tasks.workunit.client.1.smithi174.stdout:6/533: write d0/d25/f30 [129607,112251] 0 2024-05-06T14:04:10.622 INFO:tasks.workunit.client.1.smithi174.stdout:6/534: chown d0/df/d45/d4b 729200741 1 2024-05-06T14:04:10.622 INFO:tasks.workunit.client.1.smithi174.stdout:6/535: truncate d0/df/d45/f47 1052520 0 2024-05-06T14:04:10.767 INFO:tasks.workunit.client.1.smithi174.stdout:4/500: dwrite d1/d2e/f46 [536576,94208] 0 2024-05-06T14:04:10.767 INFO:tasks.workunit.client.1.smithi174.stdout:4/501: truncate d1/d1f/d27/d3e/f75 1041860 0 2024-05-06T14:04:10.767 INFO:tasks.workunit.client.1.smithi174.stdout:4/502: creat d1/d1f/d27/d3e/d6e/fb5 x:0 0 0 2024-05-06T14:04:10.768 INFO:tasks.workunit.client.1.smithi174.stdout:7/365: dread d0/d1d/d41/d61/d28/f4d [335872,28672] 0 2024-05-06T14:04:10.768 INFO:tasks.workunit.client.1.smithi174.stdout:7/366: readlink d0/d1d/l22 0 2024-05-06T14:04:10.784 INFO:tasks.workunit.client.1.smithi174.stdout:2/426: fsync d0/d1/d2/d4/d51/f5a 0 2024-05-06T14:04:10.784 INFO:tasks.workunit.client.1.smithi174.stdout:1/304: fsync d11/d57/f69 0 2024-05-06T14:04:10.785 INFO:tasks.workunit.client.1.smithi174.stdout:6/536: fsync d0/d25/d52/d2c/d6f/f99 0 2024-05-06T14:04:10.785 INFO:tasks.workunit.client.1.smithi174.stdout:1/305: dread d11/d1f/d27/d32/f59 [282624,4096] 0 2024-05-06T14:04:10.785 INFO:tasks.workunit.client.1.smithi174.stdout:6/537: rename d0/l11 to d0/d25/d35/lb8 0 2024-05-06T14:04:10.785 INFO:tasks.workunit.client.1.smithi174.stdout:1/306: chown d11/d1f/d27/d2d/f31 0 1 2024-05-06T14:04:10.785 INFO:tasks.workunit.client.1.smithi174.stdout:2/427: mkdir d0/d24/d84 0 2024-05-06T14:04:10.785 INFO:tasks.workunit.client.1.smithi174.stdout:1/307: stat d11/d1f/d27/f6a 0 2024-05-06T14:04:10.785 INFO:tasks.workunit.client.1.smithi174.stdout:2/428: chown d0/l31 410 1 2024-05-06T14:04:10.786 INFO:tasks.workunit.client.1.smithi174.stdout:1/308: mknod d11/d57/c76 0 2024-05-06T14:04:10.786 INFO:tasks.workunit.client.1.smithi174.stdout:2/429: creat d0/d16/f85 x:0 0 0 2024-05-06T14:04:10.786 INFO:tasks.workunit.client.1.smithi174.stdout:2/430: stat d0/da/f74 0 2024-05-06T14:04:10.786 INFO:tasks.workunit.client.1.smithi174.stdout:2/431: creat d0/db/f86 x:0 0 0 2024-05-06T14:04:10.786 INFO:tasks.workunit.client.1.smithi174.stdout:4/503: fdatasync d1/d9/d15/f47 0 2024-05-06T14:04:10.787 INFO:tasks.workunit.client.1.smithi174.stdout:6/538: fdatasync d0/f7c 0 2024-05-06T14:04:10.787 INFO:tasks.workunit.client.1.smithi174.stdout:6/539: chown d0/df/d3c/c61 240465 1 2024-05-06T14:04:10.787 INFO:tasks.workunit.client.1.smithi174.stdout:2/432: dwrite d0/db/f7b [1167360,61440] 0 2024-05-06T14:04:10.790 INFO:tasks.workunit.client.1.smithi174.stdout:1/309: mkdir d11/d57/d77 0 2024-05-06T14:04:10.790 INFO:tasks.workunit.client.1.smithi174.stdout:7/367: dwrite d0/d1d/d41/d61/d19/f5b [823296,49152] 0 2024-05-06T14:04:10.790 INFO:tasks.workunit.client.1.smithi174.stdout:4/504: rename d1/d9/d15/d98/d56/f88 to d1/d2e/fb6 0 2024-05-06T14:04:10.790 INFO:tasks.workunit.client.1.smithi174.stdout:1/310: dread d11/d1f/d27/d2d/f40 [356352,102400] 0 2024-05-06T14:04:10.790 INFO:tasks.workunit.client.1.smithi174.stdout:1/311: unlink d11/d1f/d27/d2d/l36 0 2024-05-06T14:04:10.790 INFO:tasks.workunit.client.1.smithi174.stdout:1/312: getdents d11/d1f 0 2024-05-06T14:04:10.790 INFO:tasks.workunit.client.1.smithi174.stdout:7/368: write d0/d1d/d41/d61/d28/f6e [731469,52037] 0 2024-05-06T14:04:10.791 INFO:tasks.workunit.client.1.smithi174.stdout:1/313: mknod d11/d41/d4a/c78 0 2024-05-06T14:04:10.791 INFO:tasks.workunit.client.1.smithi174.stdout:7/369: creat d0/d1d/d41/d61/d19/d39/d46/f81 x:0 0 0 2024-05-06T14:04:10.791 INFO:tasks.workunit.client.1.smithi174.stdout:1/314: truncate d11/d1f/d27/f2b 3003794 0 2024-05-06T14:04:10.791 INFO:tasks.workunit.client.1.smithi174.stdout:1/315: truncate d11/d1f/d27/d2d/f43 1027409 0 2024-05-06T14:04:10.791 INFO:tasks.workunit.client.1.smithi174.stdout:7/370: getdents d0/d1d/d41/d61/d19/d39/d46 0 2024-05-06T14:04:10.791 INFO:tasks.workunit.client.1.smithi174.stdout:1/316: stat d11/d1f/d27/d2d/c49 0 2024-05-06T14:04:10.791 INFO:tasks.workunit.client.1.smithi174.stdout:7/371: dread - d0/d1d/d41/d61/d19/d24/f7e zero size 2024-05-06T14:04:10.791 INFO:tasks.workunit.client.1.smithi174.stdout:1/317: mkdir d11/d79 0 2024-05-06T14:04:10.792 INFO:tasks.workunit.client.1.smithi174.stdout:7/372: mkdir d0/d1d/d41/d61/d28/d59/d82 0 2024-05-06T14:04:10.792 INFO:tasks.workunit.client.1.smithi174.stdout:7/373: truncate d0/d1d/d41/d61/d19/d24/d14/f6d 541438 0 2024-05-06T14:04:10.793 INFO:tasks.workunit.client.1.smithi174.stdout:7/374: mkdir d0/d1d/d41/d61/d19/d24/d47/d70/d83 0 2024-05-06T14:04:10.793 INFO:tasks.workunit.client.1.smithi174.stdout:1/318: read d11/d1f/d27/d32/f4e [561339,128505] 0 2024-05-06T14:04:10.793 INFO:tasks.workunit.client.1.smithi174.stdout:7/375: creat d0/d1d/d41/d61/d19/d24/d47/d70/d83/f84 x:0 0 0 2024-05-06T14:04:10.793 INFO:tasks.workunit.client.1.smithi174.stdout:1/319: rename d11/d57/c76 to d11/d1f/d27/d2d/c7a 0 2024-05-06T14:04:10.793 INFO:tasks.workunit.client.1.smithi174.stdout:1/320: mknod d11/d41/d51/c7b 0 2024-05-06T14:04:10.794 INFO:tasks.workunit.client.1.smithi174.stdout:1/321: dread - d11/d1f/d27/f6a zero size 2024-05-06T14:04:10.794 INFO:tasks.workunit.client.1.smithi174.stdout:1/322: symlink d11/l7c 0 2024-05-06T14:04:10.794 INFO:tasks.workunit.client.1.smithi174.stdout:1/323: write d11/d41/d4a/f56 [560979,122800] 0 2024-05-06T14:04:10.794 INFO:tasks.workunit.client.1.smithi174.stdout:1/324: getdents d11/d41 0 2024-05-06T14:04:10.831 INFO:tasks.workunit.client.1.smithi174.stdout:6/540: fsync d0/d25/d52/d3b/f83 0 2024-05-06T14:04:10.831 INFO:tasks.workunit.client.1.smithi174.stdout:6/541: mknod d0/d25/d52/d2c/d6f/cb9 0 2024-05-06T14:04:10.831 INFO:tasks.workunit.client.1.smithi174.stdout:6/542: mkdir d0/d25/d52/dba 0 2024-05-06T14:04:10.831 INFO:tasks.workunit.client.1.smithi174.stdout:2/433: dwrite d0/d1/f5e [638976,24576] 0 2024-05-06T14:04:10.831 INFO:tasks.workunit.client.1.smithi174.stdout:2/434: dread - d0/db/d15/f6f zero size 2024-05-06T14:04:10.831 INFO:tasks.workunit.client.1.smithi174.stdout:2/435: symlink d0/d1/d2/d4/d18/l87 0 2024-05-06T14:04:10.832 INFO:tasks.workunit.client.1.smithi174.stdout:2/436: chown d0/db/d15 159 1 2024-05-06T14:04:10.832 INFO:tasks.workunit.client.1.smithi174.stdout:2/437: dread d0/db/f7f [323584,4096] 0 2024-05-06T14:04:10.832 INFO:tasks.workunit.client.1.smithi174.stdout:2/438: write d0/d1/d2/d4/d51/f5a [1243899,19270] 0 2024-05-06T14:04:10.832 INFO:tasks.workunit.client.1.smithi174.stdout:2/439: stat d0/d1/d2/d4/d6/f26 0 2024-05-06T14:04:10.832 INFO:tasks.workunit.client.1.smithi174.stdout:2/440: creat d0/d1/d2/d4/d6/f88 x:0 0 0 2024-05-06T14:04:10.832 INFO:tasks.workunit.client.1.smithi174.stdout:2/441: chown d0/db/d15/c28 1420 1 2024-05-06T14:04:10.832 INFO:tasks.workunit.client.1.smithi174.stdout:2/442: dread d0/d1/d2/f54 [32768,24576] 0 2024-05-06T14:04:10.833 INFO:tasks.workunit.client.1.smithi174.stdout:2/443: mkdir d0/d1/d2/d4/d18/d2d/d32/d89 0 2024-05-06T14:04:10.833 INFO:tasks.workunit.client.1.smithi174.stdout:2/444: symlink d0/d1/d2/d4/d18/l8a 0 2024-05-06T14:04:10.833 INFO:tasks.workunit.client.1.smithi174.stdout:2/445: getdents d0/d16 0 2024-05-06T14:04:10.833 INFO:tasks.workunit.client.1.smithi174.stdout:2/446: truncate d0/d1/f5e 2195478 0 2024-05-06T14:04:10.833 INFO:tasks.workunit.client.1.smithi174.stdout:2/447: dread - d0/d1/d2/d4/d18/d2d/d32/f76 zero size 2024-05-06T14:04:10.833 INFO:tasks.workunit.client.1.smithi174.stdout:2/448: readlink d0/d24/d77/l6e 0 2024-05-06T14:04:10.833 INFO:tasks.workunit.client.1.smithi174.stdout:1/325: dwrite d11/d57/f74 [90112,81920] 0 2024-05-06T14:04:10.834 INFO:tasks.workunit.client.1.smithi174.stdout:1/326: creat d11/d57/d77/f7d x:0 0 0 2024-05-06T14:04:10.834 INFO:tasks.workunit.client.1.smithi174.stdout:1/327: write d11/f5a [322584,33346] 0 2024-05-06T14:04:10.834 INFO:tasks.workunit.client.1.smithi174.stdout:6/543: dwrite d0/d25/fa5 [569344,110592] 0 2024-05-06T14:04:10.834 INFO:tasks.workunit.client.1.smithi174.stdout:6/544: dread d0/d25/d52/d3b/f95 [1282048,73728] 0 2024-05-06T14:04:10.834 INFO:tasks.workunit.client.1.smithi174.stdout:6/545: mknod d0/d25/cbb 0 2024-05-06T14:04:10.834 INFO:tasks.workunit.client.1.smithi174.stdout:6/546: creat d0/d25/d52/d2c/d6f/fbc x:0 0 0 2024-05-06T14:04:10.834 INFO:tasks.workunit.client.1.smithi174.stdout:6/547: write d0/df/d3c/f8b [402480,12212] 0 2024-05-06T14:04:10.835 INFO:tasks.workunit.client.1.smithi174.stdout:6/548: dread d0/df/d45/f50 [323584,61440] 0 2024-05-06T14:04:10.835 INFO:tasks.workunit.client.1.smithi174.stdout:7/376: dwrite d0/d1d/d41/d61/d28/d59/f3f [233472,49152] 0 2024-05-06T14:04:10.835 INFO:tasks.workunit.client.1.smithi174.stdout:7/377: mknod d0/d1d/d41/c85 0 2024-05-06T14:04:10.835 INFO:tasks.workunit.client.1.smithi174.stdout:7/378: chown d0/d1d/d41/d61/d19/d39/c44 844 1 2024-05-06T14:04:10.835 INFO:tasks.workunit.client.1.smithi174.stdout:7/379: write d0/d1d/d41/d61/f38 [915887,18858] 0 2024-05-06T14:04:10.835 INFO:tasks.workunit.client.1.smithi174.stdout:4/505: dwrite d1/d48/d5a/d5f/f8a [831488,126976] 0 2024-05-06T14:04:10.865 INFO:tasks.workunit.client.1.smithi174.stdout:2/449: dwrite d0/d24/f6a [589824,122880] 0 2024-05-06T14:04:10.865 INFO:tasks.workunit.client.1.smithi174.stdout:6/549: dwrite d0/d25/d35/f9e [356352,45056] 0 2024-05-06T14:04:10.865 INFO:tasks.workunit.client.1.smithi174.stdout:7/380: dwrite d0/d1d/d41/d61/d19/d24/d14/f6d [921600,65536] 0 2024-05-06T14:04:10.865 INFO:tasks.workunit.client.1.smithi174.stdout:1/328: dwrite fe [1318912,110592] 0 2024-05-06T14:04:10.865 INFO:tasks.workunit.client.1.smithi174.stdout:6/550: dread - d0/d25/d52/d2c/d5f/f88 zero size 2024-05-06T14:04:10.865 INFO:tasks.workunit.client.1.smithi174.stdout:6/551: write d0/d25/d35/f4d [644293,24333] 0 2024-05-06T14:04:10.866 INFO:tasks.workunit.client.1.smithi174.stdout:7/381: write d0/d1d/d41/d61/d19/d39/d46/f58 [1203697,97153] 0 2024-05-06T14:04:10.955 INFO:tasks.workunit.client.1.smithi174.stdout:1/329: fsync d11/d1f/d27/d32/f6b 0 2024-05-06T14:04:10.959 INFO:tasks.workunit.client.1.smithi174.stdout:1/330: symlink d11/d67/d6c/l7e 0 2024-05-06T14:04:10.959 INFO:tasks.workunit.client.1.smithi174.stdout:2/450: creat d0/d1/d2/d4/d18/d2d/d32/f8b x:0 0 0 2024-05-06T14:04:10.959 INFO:tasks.workunit.client.1.smithi174.stdout:2/451: dread - d0/d1/d2/d4/d18/f64 zero size 2024-05-06T14:04:10.959 INFO:tasks.workunit.client.1.smithi174.stdout:6/552: mkdir d0/d25/d52/d4c/dbd 0 2024-05-06T14:04:10.959 INFO:tasks.workunit.client.1.smithi174.stdout:2/452: truncate d0/d24/f50 487182 0 2024-05-06T14:04:10.961 INFO:tasks.workunit.client.1.smithi174.stdout:7/382: dwrite d0/d1d/d41/d61/d19/d24/f7e [565248,102400] 0 2024-05-06T14:04:10.961 INFO:tasks.workunit.client.1.smithi174.stdout:6/553: dwrite d0/f73 [446464,98304] 0 2024-05-06T14:04:10.969 INFO:tasks.workunit.client.1.smithi174.stdout:1/331: dread f1 [991232,98304] 0 2024-05-06T14:04:10.969 INFO:tasks.workunit.client.1.smithi174.stdout:1/332: getdents d11/d67/d6c 0 2024-05-06T14:04:10.969 INFO:tasks.workunit.client.1.smithi174.stdout:1/333: creat d11/d1f/f7f x:0 0 0 2024-05-06T14:04:10.970 INFO:tasks.workunit.client.1.smithi174.stdout:1/334: mknod d11/d57/c80 0 2024-05-06T14:04:10.970 INFO:tasks.workunit.client.1.smithi174.stdout:1/335: creat d11/d41/d4a/f81 x:0 0 0 2024-05-06T14:04:10.970 INFO:tasks.workunit.client.1.smithi174.stdout:1/336: mknod d11/d1f/d27/d2d/c82 0 2024-05-06T14:04:11.021 INFO:tasks.workunit.client.1.smithi174.stdout:7/383: creat d0/d1d/d41/d61/d19/d24/d47/d70/d67/f86 x:0 0 0 2024-05-06T14:04:11.021 INFO:tasks.workunit.client.1.smithi174.stdout:1/337: dwrite d11/d1f/d27/f45 [249856,69632] 0 2024-05-06T14:04:11.022 INFO:tasks.workunit.client.1.smithi174.stdout:1/338: truncate d11/f20 858380 0 2024-05-06T14:04:11.052 INFO:tasks.workunit.client.1.smithi174.stdout:7/384: fsync d0/d1d/d41/d61/d19/d24/d14/d52/f20 0 2024-05-06T14:04:11.052 INFO:tasks.workunit.client.1.smithi174.stdout:7/385: unlink d0/d1d/d41/d61/d19/d24/d14/d52/f15 0 2024-05-06T14:04:11.052 INFO:tasks.workunit.client.1.smithi174.stdout:7/386: stat d0/d1d/d41/d61/d19/d39/d46/c74 0 2024-05-06T14:04:11.067 INFO:tasks.workunit.client.1.smithi174.stdout:6/554: fsync d0/df/d45/f50 0 2024-05-06T14:04:11.067 INFO:tasks.workunit.client.1.smithi174.stdout:6/555: write d0/f7f [210579,64774] 0 2024-05-06T14:04:11.067 INFO:tasks.workunit.client.1.smithi174.stdout:2/453: fsync d0/d1/d2/d4/d6/f88 0 2024-05-06T14:04:11.067 INFO:tasks.workunit.client.1.smithi174.stdout:1/339: fsync d11/d1f/d27/d32/f6b 0 2024-05-06T14:04:11.068 INFO:tasks.workunit.client.1.smithi174.stdout:1/340: truncate d11/d1f/d27/d2d/f52 954772 0 2024-05-06T14:04:11.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/454: unlink d0/d1/d2/d4/d43/c62 0 2024-05-06T14:04:11.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/455: creat d0/db/d72/f8c x:0 0 0 2024-05-06T14:04:11.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/456: link d0/db/c73 d0/db/d72/c8d 0 2024-05-06T14:04:11.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/457: creat d0/d1/f8e x:0 0 0 2024-05-06T14:04:11.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/458: write d0/d1/d2/d4/d6/f26 [272431,49063] 0 2024-05-06T14:04:11.073 INFO:tasks.workunit.client.1.smithi174.stdout:6/556: unlink d0/d25/d52/c23 0 2024-05-06T14:04:11.073 INFO:tasks.workunit.client.1.smithi174.stdout:2/459: rename d0/db/l13 to d0/d1/d2/d4/d18/d2d/d32/d89/l8f 0 2024-05-06T14:04:11.073 INFO:tasks.workunit.client.1.smithi174.stdout:6/557: stat d0/d93/f9c 0 2024-05-06T14:04:11.073 INFO:tasks.workunit.client.1.smithi174.stdout:2/460: read - d0/d1/d2/d4/d18/d2d/d32/f76 zero size 2024-05-06T14:04:11.074 INFO:tasks.workunit.client.1.smithi174.stdout:6/558: truncate d0/f7f 306078 0 2024-05-06T14:04:11.076 INFO:tasks.workunit.client.1.smithi174.stdout:0/356: sync 2024-05-06T14:04:11.076 INFO:tasks.workunit.client.1.smithi174.stdout:5/479: sync 2024-05-06T14:04:11.076 INFO:tasks.workunit.client.1.smithi174.stdout:3/443: sync 2024-05-06T14:04:11.076 INFO:tasks.workunit.client.1.smithi174.stdout:8/513: sync 2024-05-06T14:04:11.076 INFO:tasks.workunit.client.1.smithi174.stdout:9/438: sync 2024-05-06T14:04:11.076 INFO:tasks.workunit.client.1.smithi174.stdout:3/444: dread - df/d10/d1b/d7e/d5a/f77 zero size 2024-05-06T14:04:11.076 INFO:tasks.workunit.client.1.smithi174.stdout:3/445: getdents df/d2d/d84 0 2024-05-06T14:04:11.077 INFO:tasks.workunit.client.1.smithi174.stdout:0/357: creat d0/d4/d8/d25/d5c/d44/f7b x:0 0 0 2024-05-06T14:04:11.077 INFO:tasks.workunit.client.1.smithi174.stdout:2/461: dwrite d0/d1/d2/d4/d6/f44 [708608,24576] 0 2024-05-06T14:04:11.077 INFO:tasks.workunit.client.1.smithi174.stdout:8/514: rename d4/de/c2b to d4/de/d24/d46/caa 0 2024-05-06T14:04:11.077 INFO:tasks.workunit.client.1.smithi174.stdout:3/446: getdents df/d10/d1b/d7e 0 2024-05-06T14:04:11.077 INFO:tasks.workunit.client.1.smithi174.stdout:0/358: chown d0/d1a/f6c 200212 1 2024-05-06T14:04:11.077 INFO:tasks.workunit.client.1.smithi174.stdout:9/439: mkdir dc/de/d7f/d93 0 2024-05-06T14:04:11.077 INFO:tasks.workunit.client.1.smithi174.stdout:9/440: chown dc/df/l61 76 1 2024-05-06T14:04:11.078 INFO:tasks.workunit.client.1.smithi174.stdout:3/447: creat df/d10/d1b/d7e/f93 x:0 0 0 2024-05-06T14:04:11.078 INFO:tasks.workunit.client.1.smithi174.stdout:3/448: readlink df/d10/l47 0 2024-05-06T14:04:11.078 INFO:tasks.workunit.client.1.smithi174.stdout:3/449: stat df/d10/d1b/f76 0 2024-05-06T14:04:11.078 INFO:tasks.workunit.client.1.smithi174.stdout:9/441: dread dc/df/f12 [1314816,40960] 0 2024-05-06T14:04:11.078 INFO:tasks.workunit.client.1.smithi174.stdout:0/359: symlink d0/d36/l7c 0 2024-05-06T14:04:11.078 INFO:tasks.workunit.client.1.smithi174.stdout:2/462: unlink d0/d1/d2/d2a/f3a 0 2024-05-06T14:04:11.078 INFO:tasks.workunit.client.1.smithi174.stdout:2/463: chown d0/d1/d2/d1b/c82 886230 1 2024-05-06T14:04:11.078 INFO:tasks.workunit.client.1.smithi174.stdout:0/360: creat d0/d4/d8/f7d x:0 0 0 2024-05-06T14:04:11.078 INFO:tasks.workunit.client.1.smithi174.stdout:3/450: write df/d10/f3f [1589998,68673] 0 2024-05-06T14:04:11.079 INFO:tasks.workunit.client.1.smithi174.stdout:0/361: stat d0/d4/d8/d25/d5c/d4a/f60 0 2024-05-06T14:04:11.079 INFO:tasks.workunit.client.1.smithi174.stdout:2/464: mkdir d0/d1/d2/d1b/d90 0 2024-05-06T14:04:11.079 INFO:tasks.workunit.client.1.smithi174.stdout:0/362: mkdir d0/d3/d7e 0 2024-05-06T14:04:11.079 INFO:tasks.workunit.client.1.smithi174.stdout:0/363: rename d0/d16/c4f to d0/d4/d8/d25/d5c/d44/c7f 0 2024-05-06T14:04:11.079 INFO:tasks.workunit.client.1.smithi174.stdout:0/364: mkdir d0/d4/d80 0 2024-05-06T14:04:11.079 INFO:tasks.workunit.client.1.smithi174.stdout:1/341: dread d11/d1f/d27/d32/f50 [1019904,122880] 0 2024-05-06T14:04:11.079 INFO:tasks.workunit.client.1.smithi174.stdout:1/342: mkdir d11/d57/d83 0 2024-05-06T14:04:11.138 INFO:tasks.workunit.client.1.smithi174.stdout:3/451: dwrite df/d10/d1b/d59/f89 [114688,114688] 0 2024-05-06T14:04:11.138 INFO:tasks.workunit.client.1.smithi174.stdout:3/452: write df/d2d/f31 [1376843,119019] 0 2024-05-06T14:04:11.139 INFO:tasks.workunit.client.1.smithi174.stdout:3/453: mkdir df/d2d/d4e/d81/d94 0 2024-05-06T14:04:11.139 INFO:tasks.workunit.client.1.smithi174.stdout:3/454: creat df/d10/d1b/d7e/d57/f95 x:0 0 0 2024-05-06T14:04:11.139 INFO:tasks.workunit.client.1.smithi174.stdout:3/455: dread - df/d10/d1b/d7e/f93 zero size 2024-05-06T14:04:11.139 INFO:tasks.workunit.client.1.smithi174.stdout:3/456: write df/d10/d1b/f76 [1429950,74336] 0 2024-05-06T14:04:11.140 INFO:tasks.workunit.client.1.smithi174.stdout:0/365: dwrite d0/d1a/f30 [520192,32768] 0 2024-05-06T14:04:11.141 INFO:tasks.workunit.client.1.smithi174.stdout:1/343: dwrite d11/d1f/d27/d2d/f3a [720896,28672] 0 2024-05-06T14:04:11.141 INFO:tasks.workunit.client.1.smithi174.stdout:1/344: write d11/f22 [1763495,122283] 0 2024-05-06T14:04:11.141 INFO:tasks.workunit.client.1.smithi174.stdout:9/442: dwrite dc/de/f2e [3813376,94208] 0 2024-05-06T14:04:11.141 INFO:tasks.workunit.client.1.smithi174.stdout:5/480: dwrite d1/d6/d7/d3e/f77 [6213632,94208] 0 2024-05-06T14:04:11.141 INFO:tasks.workunit.client.1.smithi174.stdout:3/457: dwrite df/d2d/d4d/f4f [921600,40960] 0 2024-05-06T14:04:11.141 INFO:tasks.workunit.client.1.smithi174.stdout:3/458: write df/d2d/f39 [447128,90289] 0 2024-05-06T14:04:11.141 INFO:tasks.workunit.client.1.smithi174.stdout:5/481: write d1/d6/df/d35/d3a/de/f5d [1281570,119150] 0 2024-05-06T14:04:11.141 INFO:tasks.workunit.client.1.smithi174.stdout:5/482: mkdir d1/d6/d7/da1/d9a/da5 0 2024-05-06T14:04:11.142 INFO:tasks.workunit.client.1.smithi174.stdout:5/483: dread d1/f10 [1286144,102400] 0 2024-05-06T14:04:11.142 INFO:tasks.workunit.client.1.smithi174.stdout:5/484: creat d1/d6/df/d35/d3a/de/fa6 x:0 0 0 2024-05-06T14:04:11.142 INFO:tasks.workunit.client.1.smithi174.stdout:5/485: creat d1/d6/df/d35/d8b/fa7 x:0 0 0 2024-05-06T14:04:11.154 INFO:tasks.workunit.client.1.smithi174.stdout:8/515: write d4/de/d23/d41/d56/f9c [41695,71729] 0 2024-05-06T14:04:11.154 INFO:tasks.workunit.client.1.smithi174.stdout:8/516: rename d4/de/d23/f65 to d4/d15/fab 0 2024-05-06T14:04:11.154 INFO:tasks.workunit.client.1.smithi174.stdout:8/517: creat d4/de/d24/d46/d63/fac x:0 0 0 2024-05-06T14:04:11.154 INFO:tasks.workunit.client.1.smithi174.stdout:8/518: mkdir d4/d15/d20/d3e/d79/d82/da6/dad 0 2024-05-06T14:04:11.155 INFO:tasks.workunit.client.1.smithi174.stdout:8/519: truncate d4/d15/f16 2158361 0 2024-05-06T14:04:11.155 INFO:tasks.workunit.client.1.smithi174.stdout:8/520: write d4/d15/d20/d3e/d79/f7d [485183,59808] 0 2024-05-06T14:04:11.205 INFO:tasks.workunit.client.1.smithi174.stdout:6/559: fdatasync d0/d25/d35/f9b 0 2024-05-06T14:04:11.205 INFO:tasks.workunit.client.1.smithi174.stdout:7/387: fsync d0/d1d/d41/d61/d19/d39/d46/f58 0 2024-05-06T14:04:11.205 INFO:tasks.workunit.client.1.smithi174.stdout:7/388: dread d0/d1d/d41/d61/d19/d24/d14/d52/f3e [327680,40960] 0 2024-05-06T14:04:11.232 INFO:tasks.workunit.client.1.smithi174.stdout:9/443: fdatasync dc/f3d 0 2024-05-06T14:04:11.232 INFO:tasks.workunit.client.1.smithi174.stdout:6/560: fsync d0/d25/d52/d2c/f37 0 2024-05-06T14:04:11.235 INFO:tasks.workunit.client.1.smithi174.stdout:9/444: link dc/d17/f2f dc/de/d7f/f94 0 2024-05-06T14:04:11.235 INFO:tasks.workunit.client.1.smithi174.stdout:1/345: dread d11/f19 [1081344,118784] 0 2024-05-06T14:04:11.235 INFO:tasks.workunit.client.1.smithi174.stdout:3/459: dwrite df/d10/d1b/d7e/f6d [167936,8192] 0 2024-05-06T14:04:11.236 INFO:tasks.workunit.client.1.smithi174.stdout:6/561: unlink d0/d25/d52/d3b/l42 0 2024-05-06T14:04:11.236 INFO:tasks.workunit.client.1.smithi174.stdout:9/445: dread - dc/d27/d6d/f6f zero size 2024-05-06T14:04:11.236 INFO:tasks.workunit.client.1.smithi174.stdout:5/486: dwrite d1/d6/df/d35/d3a/f33 [1585152,94208] 0 2024-05-06T14:04:11.236 INFO:tasks.workunit.client.1.smithi174.stdout:8/521: dwrite d4/de/d23/d41/d56/f9c [135168,40960] 0 2024-05-06T14:04:11.236 INFO:tasks.workunit.client.1.smithi174.stdout:1/346: dread f5 [45056,81920] 0 2024-05-06T14:04:11.236 INFO:tasks.workunit.client.1.smithi174.stdout:8/522: dread - d4/de/d24/d46/f61 zero size 2024-05-06T14:04:11.237 INFO:tasks.workunit.client.1.smithi174.stdout:9/446: mknod dc/de/d7f/c95 0 2024-05-06T14:04:11.237 INFO:tasks.workunit.client.1.smithi174.stdout:3/460: mknod df/d10/d1b/c96 0 2024-05-06T14:04:11.237 INFO:tasks.workunit.client.1.smithi174.stdout:1/347: rmdir d11/d57/d77 39 2024-05-06T14:04:11.237 INFO:tasks.workunit.client.1.smithi174.stdout:0/366: dwrite d0/d3/d5d/f43 [1253376,106496] 0 2024-05-06T14:04:11.237 INFO:tasks.workunit.client.1.smithi174.stdout:8/523: rename d4/fb to d4/de/d24/d5e/d85/d91/fae 0 2024-05-06T14:04:11.237 INFO:tasks.workunit.client.1.smithi174.stdout:0/367: dread - d0/d4/d8/d25/d5c/d4a/f60 zero size 2024-05-06T14:04:11.237 INFO:tasks.workunit.client.1.smithi174.stdout:6/562: write d0/d25/d35/fa4 [846421,43958] 0 2024-05-06T14:04:11.238 INFO:tasks.workunit.client.1.smithi174.stdout:3/461: symlink df/l97 0 2024-05-06T14:04:11.238 INFO:tasks.workunit.client.1.smithi174.stdout:1/348: mkdir d11/d1f/d27/d32/d84 0 2024-05-06T14:04:11.238 INFO:tasks.workunit.client.1.smithi174.stdout:3/462: dread df/d10/f19 [372736,45056] 0 2024-05-06T14:04:11.238 INFO:tasks.workunit.client.1.smithi174.stdout:1/349: creat d11/d41/f85 x:0 0 0 2024-05-06T14:04:11.238 INFO:tasks.workunit.client.1.smithi174.stdout:1/350: rmdir d11 39 2024-05-06T14:04:11.238 INFO:tasks.workunit.client.1.smithi174.stdout:1/351: mknod d11/d41/d4a/d5e/c86 0 2024-05-06T14:04:11.238 INFO:tasks.workunit.client.1.smithi174.stdout:1/352: chown d11/d41/d4a/d5e 27 1 2024-05-06T14:04:11.239 INFO:tasks.workunit.client.1.smithi174.stdout:1/353: creat d11/d79/f87 x:0 0 0 2024-05-06T14:04:11.239 INFO:tasks.workunit.client.1.smithi174.stdout:1/354: mknod d11/d1f/d27/d2d/c88 0 2024-05-06T14:04:11.277 INFO:tasks.workunit.client.1.smithi174.stdout:5/487: fsync d1/d6/df/d35/d3a/de/f3f 0 2024-05-06T14:04:11.277 INFO:tasks.workunit.client.1.smithi174.stdout:5/488: symlink d1/d6/d7/d8e/la8 0 2024-05-06T14:04:11.277 INFO:tasks.workunit.client.1.smithi174.stdout:5/489: creat d1/d6/df/d35/d8b/d9f/fa9 x:0 0 0 2024-05-06T14:04:11.277 INFO:tasks.workunit.client.1.smithi174.stdout:0/368: fdatasync d0/d4/d8/f70 0 2024-05-06T14:04:11.278 INFO:tasks.workunit.client.1.smithi174.stdout:0/369: unlink d0/d4/d8/f7d 0 2024-05-06T14:04:11.278 INFO:tasks.workunit.client.1.smithi174.stdout:0/370: mknod d0/d1a/d17/d2e/c81 0 2024-05-06T14:04:11.278 INFO:tasks.workunit.client.1.smithi174.stdout:0/371: creat d0/d4/f82 x:0 0 0 2024-05-06T14:04:11.278 INFO:tasks.workunit.client.1.smithi174.stdout:0/372: getdents d0/d4/d8 0 2024-05-06T14:04:11.278 INFO:tasks.workunit.client.1.smithi174.stdout:0/373: chown d0/d4/d8/d25/l27 38970 1 2024-05-06T14:04:11.278 INFO:tasks.workunit.client.1.smithi174.stdout:0/374: getdents d0/d4 0 2024-05-06T14:04:11.278 INFO:tasks.workunit.client.1.smithi174.stdout:0/375: dread d0/d1a/d17/d2e/f3e [622592,57344] 0 2024-05-06T14:04:11.281 INFO:tasks.workunit.client.1.smithi174.stdout:0/376: dwrite d0/f59 [917504,49152] 0 2024-05-06T14:04:11.281 INFO:tasks.workunit.client.1.smithi174.stdout:0/377: read d0/d4/f3d [1103431,114245] 0 2024-05-06T14:04:11.282 INFO:tasks.workunit.client.1.smithi174.stdout:5/490: dwrite d1/d6/df/d35/d81/f1b [716800,57344] 0 2024-05-06T14:04:11.282 INFO:tasks.workunit.client.1.smithi174.stdout:5/491: chown d1/d6/d2a/f2d 309375 1 2024-05-06T14:04:11.282 INFO:tasks.workunit.client.1.smithi174.stdout:5/492: dread d1/d6/d7/d36/f2c [241664,32768] 0 2024-05-06T14:04:11.282 INFO:tasks.workunit.client.1.smithi174.stdout:1/355: dwrite d11/d1f/f7f [57344,8192] 0 2024-05-06T14:04:11.283 INFO:tasks.workunit.client.1.smithi174.stdout:9/447: dread dc/f54 [53248,65536] 0 2024-05-06T14:04:11.284 INFO:tasks.workunit.client.1.smithi174.stdout:9/448: rename dc/de/l70 to dc/d17/d3a/d8d/l96 0 2024-05-06T14:04:11.284 INFO:tasks.workunit.client.1.smithi174.stdout:9/449: rmdir dc/d27/d6d/d84 0 2024-05-06T14:04:11.284 INFO:tasks.workunit.client.1.smithi174.stdout:9/450: creat dc/d14/f97 x:0 0 0 2024-05-06T14:04:11.284 INFO:tasks.workunit.client.1.smithi174.stdout:9/451: symlink dc/d27/d60/l98 0 2024-05-06T14:04:11.284 INFO:tasks.workunit.client.1.smithi174.stdout:9/452: truncate dc/d1c/f55 170251 0 2024-05-06T14:04:11.284 INFO:tasks.workunit.client.1.smithi174.stdout:9/453: unlink dc/d1c/f24 0 2024-05-06T14:04:11.286 INFO:tasks.workunit.client.1.smithi174.stdout:8/524: dwrite d4/de/d23/f78 [385024,61440] 0 2024-05-06T14:04:11.287 INFO:tasks.workunit.client.1.smithi174.stdout:8/525: getdents d4/de/d24/d5e/d85 0 2024-05-06T14:04:11.287 INFO:tasks.workunit.client.1.smithi174.stdout:8/526: unlink d4/de/d23/d41/d56/c6a 0 2024-05-06T14:04:11.292 INFO:tasks.workunit.client.1.smithi174.stdout:6/563: dread d0/d25/d52/d2c/d6f/f72 [1114112,69632] 0 2024-05-06T14:04:11.293 INFO:tasks.workunit.client.1.smithi174.stdout:6/564: creat d0/d25/d52/d80/fbe x:0 0 0 2024-05-06T14:04:11.293 INFO:tasks.workunit.client.1.smithi174.stdout:6/565: write d0/df/f24 [1021086,8064] 0 2024-05-06T14:04:11.293 INFO:tasks.workunit.client.1.smithi174.stdout:6/566: write d0/d93/f9c [152373,93200] 0 2024-05-06T14:04:11.397 INFO:tasks.workunit.client.1.smithi174.stdout:1/356: fdatasync d11/d1f/d27/d2d/f31 0 2024-05-06T14:04:11.398 INFO:tasks.workunit.client.1.smithi174.stdout:0/378: fdatasync d0/d4/f3d 0 2024-05-06T14:04:11.403 INFO:tasks.workunit.client.1.smithi174.stdout:0/379: rename d0/d3/d7e to d0/d3/d5d/d83 0 2024-05-06T14:04:11.404 INFO:tasks.workunit.client.1.smithi174.stdout:6/567: dwrite d0/df/d3c/f9f [2490368,69632] 0 2024-05-06T14:04:11.404 INFO:tasks.workunit.client.1.smithi174.stdout:8/527: dwrite d4/de/f17 [372736,24576] 0 2024-05-06T14:04:11.404 INFO:tasks.workunit.client.1.smithi174.stdout:0/380: chown d0/l6b 279 1 2024-05-06T14:04:11.404 INFO:tasks.workunit.client.1.smithi174.stdout:1/357: rename d11/f19 to d11/d1f/f89 0 2024-05-06T14:04:11.404 INFO:tasks.workunit.client.1.smithi174.stdout:0/381: getdents d0/d36/d3f 0 2024-05-06T14:04:11.404 INFO:tasks.workunit.client.1.smithi174.stdout:6/568: dread d0/d93/f9c [122880,28672] 0 2024-05-06T14:04:11.404 INFO:tasks.workunit.client.1.smithi174.stdout:1/358: link d11/d1f/c3f d11/d1f/d27/d32/c8a 0 2024-05-06T14:04:11.404 INFO:tasks.workunit.client.1.smithi174.stdout:0/382: dread - d0/d4/f82 zero size 2024-05-06T14:04:11.405 INFO:tasks.workunit.client.1.smithi174.stdout:0/383: stat d0/d4/d8/d25/c77 0 2024-05-06T14:04:11.405 INFO:tasks.workunit.client.1.smithi174.stdout:1/359: unlink d11/d1f/d27/d2d/f40 0 2024-05-06T14:04:11.405 INFO:tasks.workunit.client.1.smithi174.stdout:8/528: symlink d4/de/d23/d3c/laf 0 2024-05-06T14:04:11.405 INFO:tasks.workunit.client.1.smithi174.stdout:1/360: readlink d11/d1f/l46 0 2024-05-06T14:04:11.405 INFO:tasks.workunit.client.1.smithi174.stdout:8/529: mkdir d4/d15/d20/d3e/d79/d82/db0 0 2024-05-06T14:04:11.405 INFO:tasks.workunit.client.1.smithi174.stdout:9/454: dread f7 [270336,32768] 0 2024-05-06T14:04:11.405 INFO:tasks.workunit.client.1.smithi174.stdout:9/455: rmdir dc/de 39 2024-05-06T14:04:11.458 INFO:tasks.workunit.client.1.smithi174.stdout:1/361: dwrite d11/d1f/d27/f2b [1351680,45056] 0 2024-05-06T14:04:11.458 INFO:tasks.workunit.client.1.smithi174.stdout:1/362: creat d11/d1f/d27/d2d/f8b x:0 0 0 2024-05-06T14:04:11.459 INFO:tasks.workunit.client.1.smithi174.stdout:1/363: mkdir d11/d1f/d27/d32/d84/d8c 0 2024-05-06T14:04:11.459 INFO:tasks.workunit.client.1.smithi174.stdout:1/364: write d11/d1f/d27/d32/f4e [1242264,11896] 0 2024-05-06T14:04:11.459 INFO:tasks.workunit.client.1.smithi174.stdout:1/365: chown f1 8063014 1 2024-05-06T14:04:11.459 INFO:tasks.workunit.client.1.smithi174.stdout:1/366: mknod d11/d1f/d27/d2d/c8d 0 2024-05-06T14:04:11.459 INFO:tasks.workunit.client.1.smithi174.stdout:9/456: dwrite dc/d27/f77 [434176,28672] 0 2024-05-06T14:04:11.480 INFO:tasks.workunit.client.1.smithi174.stdout:8/530: fsync d4/d15/f4d 0 2024-05-06T14:04:11.480 INFO:tasks.workunit.client.1.smithi174.stdout:6/569: fdatasync d0/df/d45/d85/fb2 0 2024-05-06T14:04:11.480 INFO:tasks.workunit.client.1.smithi174.stdout:0/384: fdatasync d0/d1a/f1e 0 2024-05-06T14:04:11.480 INFO:tasks.workunit.client.1.smithi174.stdout:6/570: chown d0/d25/d52/d2c/d6f/la2 840 1 2024-05-06T14:04:11.480 INFO:tasks.workunit.client.1.smithi174.stdout:8/531: creat d4/d15/d20/d3e/d79/fb1 x:0 0 0 2024-05-06T14:04:11.480 INFO:tasks.workunit.client.1.smithi174.stdout:6/571: getdents d0/d25/d52/dba 0 2024-05-06T14:04:11.481 INFO:tasks.workunit.client.1.smithi174.stdout:8/532: truncate d4/d15/d64/f7c 484899 0 2024-05-06T14:04:11.481 INFO:tasks.workunit.client.1.smithi174.stdout:8/533: getdents d4/de/d24 0 2024-05-06T14:04:11.481 INFO:tasks.workunit.client.1.smithi174.stdout:8/534: truncate d4/d15/d64/f74 633408 0 2024-05-06T14:04:11.487 INFO:tasks.workunit.client.1.smithi174.stdout:9/457: dread dc/d14/d43/f4d [851968,4096] 0 2024-05-06T14:04:11.487 INFO:tasks.workunit.client.1.smithi174.stdout:9/458: chown dc/de/d6b 106230 1 2024-05-06T14:04:11.488 INFO:tasks.workunit.client.1.smithi174.stdout:1/367: dwrite d11/d1f/d27/f5d [3440640,12288] 0 2024-05-06T14:04:11.488 INFO:tasks.workunit.client.1.smithi174.stdout:6/572: dwrite d0/df/f14 [831488,81920] 0 2024-05-06T14:04:11.488 INFO:tasks.workunit.client.1.smithi174.stdout:0/385: dwrite d0/d1a/f22 [2498560,73728] 0 2024-05-06T14:04:11.488 INFO:tasks.workunit.client.1.smithi174.stdout:1/368: stat d11/d1f/d27/d2d/f43 0 2024-05-06T14:04:11.488 INFO:tasks.workunit.client.1.smithi174.stdout:6/573: unlink d0/df/d3c/d7a/l94 0 2024-05-06T14:04:11.488 INFO:tasks.workunit.client.1.smithi174.stdout:1/369: dread - d11/d41/d4a/d5e/f6f zero size 2024-05-06T14:04:11.488 INFO:tasks.workunit.client.1.smithi174.stdout:6/574: symlink d0/df/d45/da9/lbf 0 2024-05-06T14:04:11.489 INFO:tasks.workunit.client.1.smithi174.stdout:8/535: write d4/de/d23/d41/d56/f9c [503454,114364] 0 2024-05-06T14:04:11.489 INFO:tasks.workunit.client.1.smithi174.stdout:8/536: rename d4/d15/d20/d3e/d79/d82 to d4/de/d23/d3c/db2 0 2024-05-06T14:04:11.489 INFO:tasks.workunit.client.1.smithi174.stdout:1/370: write d11/d41/f85 [150015,127248] 0 2024-05-06T14:04:11.489 INFO:tasks.workunit.client.1.smithi174.stdout:1/371: link d11/d1f/c28 d11/d1f/d27/d32/c8e 0 2024-05-06T14:04:11.489 INFO:tasks.workunit.client.1.smithi174.stdout:1/372: symlink d11/d57/d83/l8f 0 2024-05-06T14:04:11.489 INFO:tasks.workunit.client.1.smithi174.stdout:1/373: rename d11/l37 to d11/d1f/d27/d2d/l90 0 2024-05-06T14:04:11.489 INFO:tasks.workunit.client.1.smithi174.stdout:6/575: creat d0/d25/d52/fc0 x:0 0 0 2024-05-06T14:04:11.489 INFO:tasks.workunit.client.1.smithi174.stdout:6/576: write d0/df/f20 [1536209,25122] 0 2024-05-06T14:04:11.490 INFO:tasks.workunit.client.1.smithi174.stdout:6/577: chown d0/df/d45/ca0 563 1 2024-05-06T14:04:11.490 INFO:tasks.workunit.client.1.smithi174.stdout:9/459: unlink dc/de/d7f/f94 0 2024-05-06T14:04:11.490 INFO:tasks.workunit.client.1.smithi174.stdout:9/460: getdents dc/d17 0 2024-05-06T14:04:11.490 INFO:tasks.workunit.client.1.smithi174.stdout:1/374: truncate d11/d1f/d27/d2d/f43 1515253 0 2024-05-06T14:04:11.490 INFO:tasks.workunit.client.1.smithi174.stdout:1/375: mkdir d11/d1f/d27/d32/d84/d91 0 2024-05-06T14:04:11.490 INFO:tasks.workunit.client.1.smithi174.stdout:1/376: rmdir d11/d57/d77 39 2024-05-06T14:04:11.491 INFO:tasks.workunit.client.1.smithi174.stdout:1/377: rename d11/d1f/d27/d32/d84/d91 to d11/d1f/d27/d32/d92 0 2024-05-06T14:04:11.491 INFO:tasks.workunit.client.1.smithi174.stdout:1/378: mknod d11/d41/d51/c93 0 2024-05-06T14:04:11.491 INFO:tasks.workunit.client.1.smithi174.stdout:1/379: chown d11/l63 743052 1 2024-05-06T14:04:11.491 INFO:tasks.workunit.client.1.smithi174.stdout:1/380: mkdir d11/d1f/d27/d32/d84/d8c/d94 0 2024-05-06T14:04:11.491 INFO:tasks.workunit.client.1.smithi174.stdout:1/381: getdents d11/d41/d4a/d5e 0 2024-05-06T14:04:11.491 INFO:tasks.workunit.client.1.smithi174.stdout:6/578: write d0/df/d3c/f91 [2019219,9317] 0 2024-05-06T14:04:11.491 INFO:tasks.workunit.client.1.smithi174.stdout:6/579: link d0/d25/d35/ca7 d0/d25/d52/da6/cc1 0 2024-05-06T14:04:11.492 INFO:tasks.workunit.client.1.smithi174.stdout:6/580: rename d0/df/d45/d4b/c5d to d0/df/d3c/d7a/cc2 0 2024-05-06T14:04:11.492 INFO:tasks.workunit.client.1.smithi174.stdout:6/581: write d0/d25/d35/f9e [519814,41883] 0 2024-05-06T14:04:11.492 INFO:tasks.workunit.client.1.smithi174.stdout:6/582: chown d0/df 6 1 2024-05-06T14:04:11.492 INFO:tasks.workunit.client.1.smithi174.stdout:6/583: write d0/df/d45/d85/fb2 [142671,103660] 0 2024-05-06T14:04:11.492 INFO:tasks.workunit.client.1.smithi174.stdout:6/584: mkdir d0/d25/d52/d2c/d6f/dc3 0 2024-05-06T14:04:11.492 INFO:tasks.workunit.client.1.smithi174.stdout:8/537: symlink d4/lb3 0 2024-05-06T14:04:11.492 INFO:tasks.workunit.client.1.smithi174.stdout:8/538: symlink d4/d15/d64/lb4 0 2024-05-06T14:04:11.493 INFO:tasks.workunit.client.1.smithi174.stdout:8/539: rmdir d4/de/d23/d41/d4e 39 2024-05-06T14:04:11.493 INFO:tasks.workunit.client.1.smithi174.stdout:8/540: rmdir d4/de/d23 39 2024-05-06T14:04:11.493 INFO:tasks.workunit.client.1.smithi174.stdout:8/541: dread d4/d15/fab [1622016,69632] 0 2024-05-06T14:04:11.493 INFO:tasks.workunit.client.1.smithi174.stdout:8/542: write d4/d48/f5c [786727,84172] 0 2024-05-06T14:04:11.493 INFO:tasks.workunit.client.1.smithi174.stdout:0/386: dwrite d0/f24 [4096,8192] 0 2024-05-06T14:04:11.493 INFO:tasks.workunit.client.1.smithi174.stdout:0/387: creat d0/d36/d3f/f84 x:0 0 0 2024-05-06T14:04:11.493 INFO:tasks.workunit.client.1.smithi174.stdout:6/585: dwrite d0/d93/f9c [1253376,24576] 0 2024-05-06T14:04:11.494 INFO:tasks.workunit.client.1.smithi174.stdout:6/586: read d0/df/d3c/f75 [1014481,69608] 0 2024-05-06T14:04:11.494 INFO:tasks.workunit.client.1.smithi174.stdout:6/587: chown d0/d25/d52/da6 1006 1 2024-05-06T14:04:11.555 INFO:tasks.workunit.client.1.smithi174.stdout:9/461: fsync dc/d1c/f7d 0 2024-05-06T14:04:11.556 INFO:tasks.workunit.client.1.smithi174.stdout:8/543: fsync d4/d15/d20/d3e/f93 0 2024-05-06T14:04:11.560 INFO:tasks.workunit.client.1.smithi174.stdout:9/462: dwrite dc/f36 [253952,106496] 0 2024-05-06T14:04:11.561 INFO:tasks.workunit.client.1.smithi174.stdout:9/463: chown dc/de/d7f/c95 419 1 2024-05-06T14:04:11.561 INFO:tasks.workunit.client.1.smithi174.stdout:9/464: write dc/de/f2e [2275628,18504] 0 2024-05-06T14:04:11.561 INFO:tasks.workunit.client.1.smithi174.stdout:9/465: symlink dc/d27/d63/l99 0 2024-05-06T14:04:11.561 INFO:tasks.workunit.client.1.smithi174.stdout:9/466: chown dc/de/f2e 27053221 1 2024-05-06T14:04:11.561 INFO:tasks.workunit.client.1.smithi174.stdout:9/467: creat dc/d27/d63/f9a x:0 0 0 2024-05-06T14:04:11.561 INFO:tasks.workunit.client.1.smithi174.stdout:8/544: dwrite d4/de/f13 [2805760,69632] 0 2024-05-06T14:04:11.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/545: read d4/d53/f76 [200197,47330] 0 2024-05-06T14:04:11.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/546: unlink d4/de/f99 0 2024-05-06T14:04:11.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/547: readlink d4/d15/l7a 0 2024-05-06T14:04:11.632 INFO:tasks.workunit.client.1.smithi174.stdout:0/388: fdatasync d0/d3/d5d/f35 0 2024-05-06T14:04:11.632 INFO:tasks.workunit.client.1.smithi174.stdout:0/389: mknod d0/d4/d80/c85 0 2024-05-06T14:04:11.632 INFO:tasks.workunit.client.1.smithi174.stdout:0/390: mknod d0/d3/d5d/d83/c86 0 2024-05-06T14:04:11.633 INFO:tasks.workunit.client.1.smithi174.stdout:0/391: truncate d0/d1a/f6c 567636 0 2024-05-06T14:04:11.633 INFO:tasks.workunit.client.1.smithi174.stdout:0/392: stat d0/d4/d8/d25/d5c/d44/l50 0 2024-05-06T14:04:11.633 INFO:tasks.workunit.client.1.smithi174.stdout:0/393: chown d0/d4/d8/d25/d5c/d44 49216 1 2024-05-06T14:04:11.633 INFO:tasks.workunit.client.1.smithi174.stdout:0/394: chown d0/f51 35 1 2024-05-06T14:04:11.633 INFO:tasks.workunit.client.1.smithi174.stdout:0/395: rename d0/d1a/f1e to d0/d4/d8/d25/d5c/f87 0 2024-05-06T14:04:11.633 INFO:tasks.workunit.client.1.smithi174.stdout:0/396: dwrite d0/d3/d5d/f43 [577536,49152] 0 2024-05-06T14:04:11.633 INFO:tasks.workunit.client.1.smithi174.stdout:0/397: read d0/f24 [193197,25192] 0 2024-05-06T14:04:11.634 INFO:tasks.workunit.client.1.smithi174.stdout:0/398: chown d0/d4/d8/d25/d5c/d44/l50 12 1 2024-05-06T14:04:11.634 INFO:tasks.workunit.client.1.smithi174.stdout:0/399: symlink d0/d4/d8/d25/d5c/d4a/l88 0 2024-05-06T14:04:11.634 INFO:tasks.workunit.client.1.smithi174.stdout:0/400: chown d0/d1a/f1b 1955756761 1 2024-05-06T14:04:11.634 INFO:tasks.workunit.client.1.smithi174.stdout:0/401: chown d0/d1a/f30 0 1 2024-05-06T14:04:11.634 INFO:tasks.workunit.client.1.smithi174.stdout:0/402: getdents d0/d36/d3f/d7a 0 2024-05-06T14:04:11.634 INFO:tasks.workunit.client.1.smithi174.stdout:0/403: creat d0/d36/d45/f89 x:0 0 0 2024-05-06T14:04:11.634 INFO:tasks.workunit.client.1.smithi174.stdout:0/404: chown d0/f59 159 1 2024-05-06T14:04:11.634 INFO:tasks.workunit.client.1.smithi174.stdout:0/405: read d0/d4/d8/d25/f63 [48459,77346] 0 2024-05-06T14:04:11.635 INFO:tasks.workunit.client.1.smithi174.stdout:0/406: write d0/d1a/d17/fe [2112464,37556] 0 2024-05-06T14:04:11.635 INFO:tasks.workunit.client.1.smithi174.stdout:0/407: write d0/d1a/d17/d2e/f5f [887041,74599] 0 2024-05-06T14:04:11.635 INFO:tasks.workunit.client.1.smithi174.stdout:0/408: truncate d0/d3/f40 635487 0 2024-05-06T14:04:11.636 INFO:tasks.workunit.client.1.smithi174.stdout:0/409: truncate d0/f59 162735 0 2024-05-06T14:04:11.636 INFO:tasks.workunit.client.1.smithi174.stdout:9/468: write dc/d17/f2f [552334,100944] 0 2024-05-06T14:04:11.636 INFO:tasks.workunit.client.1.smithi174.stdout:9/469: mkdir dc/d9b 0 2024-05-06T14:04:11.636 INFO:tasks.workunit.client.1.smithi174.stdout:9/470: rename dc/d27/d51/l75 to dc/d17/l9c 0 2024-05-06T14:04:11.676 INFO:tasks.workunit.client.1.smithi174.stdout:8/548: fsync d4/de/d23/d41/d56/f7e 0 2024-05-06T14:04:11.676 INFO:tasks.workunit.client.1.smithi174.stdout:8/549: rename d4/de/c4a to d4/de/d23/d3c/db2/cb5 0 2024-05-06T14:04:11.677 INFO:tasks.workunit.client.1.smithi174.stdout:8/550: truncate d4/de/d23/f92 106449 0 2024-05-06T14:04:11.677 INFO:tasks.workunit.client.1.smithi174.stdout:8/551: truncate d4/f49 3252918 0 2024-05-06T14:04:11.677 INFO:tasks.workunit.client.1.smithi174.stdout:8/552: truncate d4/d15/d64/f84 758507 0 2024-05-06T14:04:11.677 INFO:tasks.workunit.client.1.smithi174.stdout:8/553: write d4/d15/d20/d3e/f62 [1016659,46109] 0 2024-05-06T14:04:11.677 INFO:tasks.workunit.client.1.smithi174.stdout:8/554: link d4/d53/l77 d4/d48/lb6 0 2024-05-06T14:04:11.677 INFO:tasks.workunit.client.1.smithi174.stdout:8/555: mkdir d4/de/d24/d46/d63/db7 0 2024-05-06T14:04:11.678 INFO:tasks.workunit.client.1.smithi174.stdout:8/556: write d4/de/d23/d3c/f55 [1313095,25914] 0 2024-05-06T14:04:11.678 INFO:tasks.workunit.client.1.smithi174.stdout:8/557: symlink d4/d48/lb8 0 2024-05-06T14:04:11.679 INFO:tasks.workunit.client.1.smithi174.stdout:0/410: dwrite d0/d1a/d17/d2e/f39 [1564672,110592] 0 2024-05-06T14:04:11.679 INFO:tasks.workunit.client.1.smithi174.stdout:0/411: dread - d0/f51 zero size 2024-05-06T14:04:11.679 INFO:tasks.workunit.client.1.smithi174.stdout:0/412: write d0/d3/d5d/d38/f28 [720237,30861] 0 2024-05-06T14:04:11.681 INFO:tasks.workunit.client.1.smithi174.stdout:5/493: sync 2024-05-06T14:04:11.682 INFO:tasks.workunit.client.1.smithi174.stdout:2/465: sync 2024-05-06T14:04:11.682 INFO:tasks.workunit.client.1.smithi174.stdout:4/506: sync 2024-05-06T14:04:11.682 INFO:tasks.workunit.client.1.smithi174.stdout:3/463: sync 2024-05-06T14:04:11.682 INFO:tasks.workunit.client.1.smithi174.stdout:7/389: sync 2024-05-06T14:04:11.786 INFO:tasks.workunit.client.1.smithi174.stdout:9/471: fdatasync dc/f3b 0 2024-05-06T14:04:11.788 INFO:tasks.workunit.client.1.smithi174.stdout:0/413: dread d0/d3/f29 [98304,53248] 0 2024-05-06T14:04:11.788 INFO:tasks.workunit.client.1.smithi174.stdout:3/464: getdents df/d10 0 2024-05-06T14:04:11.788 INFO:tasks.workunit.client.1.smithi174.stdout:9/472: link dc/d17/l48 dc/d14/l9d 0 2024-05-06T14:04:11.788 INFO:tasks.workunit.client.1.smithi174.stdout:7/390: creat d0/d1d/d41/d61/d19/d24/f87 x:0 0 0 2024-05-06T14:04:11.788 INFO:tasks.workunit.client.1.smithi174.stdout:3/465: rmdir df/d2d/d4e 39 2024-05-06T14:04:11.789 INFO:tasks.workunit.client.1.smithi174.stdout:0/414: rmdir d0/d4/d8/d79 0 2024-05-06T14:04:11.789 INFO:tasks.workunit.client.1.smithi174.stdout:7/391: write d0/d1d/d41/d61/d19/f5b [1663967,6518] 0 2024-05-06T14:04:11.789 INFO:tasks.workunit.client.1.smithi174.stdout:3/466: dread df/d2d/f53 [331776,106496] 0 2024-05-06T14:04:11.789 INFO:tasks.workunit.client.1.smithi174.stdout:4/507: truncate d1/d48/d5a/d5f/f8a 1790603 0 2024-05-06T14:04:11.789 INFO:tasks.workunit.client.1.smithi174.stdout:8/558: dwrite d4/d15/d20/d3e/d79/fb1 [626688,24576] 0 2024-05-06T14:04:11.789 INFO:tasks.workunit.client.1.smithi174.stdout:3/467: rmdir df/d2d/d4e/d81 39 2024-05-06T14:04:11.789 INFO:tasks.workunit.client.1.smithi174.stdout:3/468: rmdir df/d10 39 2024-05-06T14:04:11.789 INFO:tasks.workunit.client.1.smithi174.stdout:0/415: mknod d0/d1a/c8a 0 2024-05-06T14:04:11.790 INFO:tasks.workunit.client.1.smithi174.stdout:7/392: rename d0/d1d/d41/d61/d19/d24/d5d to d0/d1d/d41/d61/d19/d24/d6f/d88 0 2024-05-06T14:04:11.790 INFO:tasks.workunit.client.1.smithi174.stdout:4/508: creat d1/d9/d15/d74/fb7 x:0 0 0 2024-05-06T14:04:11.790 INFO:tasks.workunit.client.1.smithi174.stdout:8/559: creat d4/de/d23/fb9 x:0 0 0 2024-05-06T14:04:11.790 INFO:tasks.workunit.client.1.smithi174.stdout:4/509: unlink d1/c4 0 2024-05-06T14:04:11.790 INFO:tasks.workunit.client.1.smithi174.stdout:8/560: mknod d4/d48/cba 0 2024-05-06T14:04:11.791 INFO:tasks.workunit.client.1.smithi174.stdout:7/393: mkdir d0/d1d/d41/d61/d19/d24/d89 0 2024-05-06T14:04:11.791 INFO:tasks.workunit.client.1.smithi174.stdout:4/510: symlink d1/d48/d5a/d97/lb8 0 2024-05-06T14:04:11.791 INFO:tasks.workunit.client.1.smithi174.stdout:7/394: mknod d0/d1d/d41/d61/d19/d24/d89/c8a 0 2024-05-06T14:04:11.791 INFO:tasks.workunit.client.1.smithi174.stdout:4/511: truncate d1/fc 1565688 0 2024-05-06T14:04:11.791 INFO:tasks.workunit.client.1.smithi174.stdout:4/512: chown d1/d2e/f3d 982 1 2024-05-06T14:04:11.791 INFO:tasks.workunit.client.1.smithi174.stdout:4/513: mknod d1/d1f/d27/d84/cb9 0 2024-05-06T14:04:11.792 INFO:tasks.workunit.client.1.smithi174.stdout:4/514: creat d1/d1f/d27/d2c/d45/fba x:0 0 0 2024-05-06T14:04:11.792 INFO:tasks.workunit.client.1.smithi174.stdout:4/515: truncate d1/d2e/f6a 1416902 0 2024-05-06T14:04:11.792 INFO:tasks.workunit.client.1.smithi174.stdout:4/516: mknod d1/d9/d15/d41/cbb 0 2024-05-06T14:04:11.792 INFO:tasks.workunit.client.1.smithi174.stdout:5/494: dwrite d1/d6/d7/d36/d53/f98 [294912,73728] 0 2024-05-06T14:04:11.792 INFO:tasks.workunit.client.1.smithi174.stdout:5/495: unlink d1/d6/df/d35/d81/d60/c70 0 2024-05-06T14:04:11.792 INFO:tasks.workunit.client.1.smithi174.stdout:5/496: symlink d1/d6/df/d35/d8b/laa 0 2024-05-06T14:04:11.808 INFO:tasks.workunit.client.1.smithi174.stdout:7/395: dwrite d0/d1d/d41/d61/d19/d24/f10 [4161536,24576] 0 2024-05-06T14:04:11.808 INFO:tasks.workunit.client.1.smithi174.stdout:7/396: dread d0/d1d/f1e [1474560,24576] 0 2024-05-06T14:04:11.808 INFO:tasks.workunit.client.1.smithi174.stdout:7/397: creat d0/d1d/d41/d61/d19/d39/f8b x:0 0 0 2024-05-06T14:04:11.809 INFO:tasks.workunit.client.1.smithi174.stdout:7/398: creat d0/d1d/d41/d61/d19/d24/d14/d52/f8c x:0 0 0 2024-05-06T14:04:11.809 INFO:tasks.workunit.client.1.smithi174.stdout:7/399: stat d0/d1d/d41/d61/d19/d24/d14/d52/f3e 0 2024-05-06T14:04:11.809 INFO:tasks.workunit.client.1.smithi174.stdout:4/517: dwrite d1/d1f/d27/d3e/d6e/d50/f60 [1908736,77824] 0 2024-05-06T14:04:11.809 INFO:tasks.workunit.client.1.smithi174.stdout:4/518: unlink d1/d9/f20 0 2024-05-06T14:04:11.809 INFO:tasks.workunit.client.1.smithi174.stdout:4/519: readlink d1/d48/d5a/d97/lb8 0 2024-05-06T14:04:11.809 INFO:tasks.workunit.client.1.smithi174.stdout:4/520: symlink d1/d9/lbc 0 2024-05-06T14:04:11.809 INFO:tasks.workunit.client.1.smithi174.stdout:4/521: mknod d1/d48/d5a/d5f/cbd 0 2024-05-06T14:04:11.809 INFO:tasks.workunit.client.1.smithi174.stdout:4/522: symlink d1/d1f/d27/d3e/d6e/d50/db0/lbe 0 2024-05-06T14:04:11.810 INFO:tasks.workunit.client.1.smithi174.stdout:4/523: mknod d1/d1f/d27/d3e/d6e/d50/db0/cbf 0 2024-05-06T14:04:11.810 INFO:tasks.workunit.client.1.smithi174.stdout:4/524: unlink d1/d2e/f3d 0 2024-05-06T14:04:11.810 INFO:tasks.workunit.client.1.smithi174.stdout:4/525: rename d1/d1f/d27/d2c/d45/fa1 to d1/d1f/d27/d84/fc0 0 2024-05-06T14:04:11.810 INFO:tasks.workunit.client.1.smithi174.stdout:4/526: readlink d1/d2e/l4b 0 2024-05-06T14:04:11.810 INFO:tasks.workunit.client.1.smithi174.stdout:4/527: rename d1/d48/d5a/d97 to d1/d1f/d27/d2c/d45/dc1 0 2024-05-06T14:04:11.810 INFO:tasks.workunit.client.1.smithi174.stdout:3/469: dwrite df/f28 [1495040,106496] 0 2024-05-06T14:04:11.810 INFO:tasks.workunit.client.1.smithi174.stdout:4/528: dread d1/fc [1056768,110592] 0 2024-05-06T14:04:11.811 INFO:tasks.workunit.client.1.smithi174.stdout:4/529: dread - d1/d1f/d27/f7a zero size 2024-05-06T14:04:11.811 INFO:tasks.workunit.client.1.smithi174.stdout:3/470: rename df/l97 to df/l98 0 2024-05-06T14:04:11.811 INFO:tasks.workunit.client.1.smithi174.stdout:4/530: chown d1/d9/d15/d35/fa3 8360782 1 2024-05-06T14:04:11.811 INFO:tasks.workunit.client.1.smithi174.stdout:3/471: dread df/d2d/f39 [106496,110592] 0 2024-05-06T14:04:11.811 INFO:tasks.workunit.client.1.smithi174.stdout:4/531: unlink d1/d48/d5a/d61/d68/f81 0 2024-05-06T14:04:11.811 INFO:tasks.workunit.client.1.smithi174.stdout:4/532: mkdir d1/d9/d15/d74/d86/dc2 0 2024-05-06T14:04:11.811 INFO:tasks.workunit.client.1.smithi174.stdout:4/533: mkdir d1/d1f/d27/d2c/d45/dc3 0 2024-05-06T14:04:11.811 INFO:tasks.workunit.client.1.smithi174.stdout:3/472: write df/d10/d1b/d7e/f51 [523882,81276] 0 2024-05-06T14:04:11.811 INFO:tasks.workunit.client.1.smithi174.stdout:4/534: rename d1/d2e/fb6 to d1/d9/d15/d74/d86/fc4 0 2024-05-06T14:04:11.812 INFO:tasks.workunit.client.1.smithi174.stdout:4/535: symlink d1/d48/d5a/lc5 0 2024-05-06T14:04:11.812 INFO:tasks.workunit.client.1.smithi174.stdout:4/536: creat d1/d1f/d27/d2c/fc6 x:0 0 0 2024-05-06T14:04:11.812 INFO:tasks.workunit.client.1.smithi174.stdout:4/537: chown d1/d48/d5a/d5f 26 1 2024-05-06T14:04:11.812 INFO:tasks.workunit.client.1.smithi174.stdout:4/538: mkdir d1/d9/d15/dc7 0 2024-05-06T14:04:11.812 INFO:tasks.workunit.client.1.smithi174.stdout:4/539: write d1/d48/d5a/d61/d68/f7d [2768950,79098] 0 2024-05-06T14:04:11.812 INFO:tasks.workunit.client.1.smithi174.stdout:4/540: link d1/d48/d5a/d5f/cbd d1/d9/d15/d74/d86/dc2/cc8 0 2024-05-06T14:04:11.812 INFO:tasks.workunit.client.1.smithi174.stdout:9/473: dwrite dc/d27/d63/f74 [700416,12288] 0 2024-05-06T14:04:11.812 INFO:tasks.workunit.client.1.smithi174.stdout:0/416: dwrite d0/d36/d3f/f84 [663552,122880] 0 2024-05-06T14:04:11.813 INFO:tasks.workunit.client.1.smithi174.stdout:5/497: dwrite d1/d6/df/f30 [753664,36864] 0 2024-05-06T14:04:11.848 INFO:tasks.workunit.client.1.smithi174.stdout:0/417: fdatasync d0/d4/d8/d25/d5c/d44/f69 0 2024-05-06T14:04:11.848 INFO:tasks.workunit.client.1.smithi174.stdout:0/418: write d0/fa [215969,115666] 0 2024-05-06T14:04:11.851 INFO:tasks.workunit.client.1.smithi174.stdout:5/498: dwrite d1/d6/f54 [266240,106496] 0 2024-05-06T14:04:11.851 INFO:tasks.workunit.client.1.smithi174.stdout:7/400: dwrite d0/d1d/d41/d61/d19/d39/d46/f58 [372736,49152] 0 2024-05-06T14:04:11.851 INFO:tasks.workunit.client.1.smithi174.stdout:0/419: mknod d0/d4/d8/d25/d5c/c8b 0 2024-05-06T14:04:11.851 INFO:tasks.workunit.client.1.smithi174.stdout:7/401: write d0/d1d/d41/d61/d19/d24/f10 [860677,73819] 0 2024-05-06T14:04:11.851 INFO:tasks.workunit.client.1.smithi174.stdout:0/420: write d0/d36/d3f/d5e/f62 [79508,56800] 0 2024-05-06T14:04:11.852 INFO:tasks.workunit.client.1.smithi174.stdout:5/499: dwrite d1/d6/df/f30 [913408,28672] 0 2024-05-06T14:04:11.853 INFO:tasks.workunit.client.1.smithi174.stdout:0/421: dwrite d0/d4/d8/d25/f6f [552960,4096] 0 2024-05-06T14:04:11.853 INFO:tasks.workunit.client.1.smithi174.stdout:0/422: write d0/f68 [940173,25418] 0 2024-05-06T14:04:11.853 INFO:tasks.workunit.client.1.smithi174.stdout:0/423: creat d0/d3/f8c x:0 0 0 2024-05-06T14:04:11.853 INFO:tasks.workunit.client.1.smithi174.stdout:0/424: creat d0/d3/f8d x:0 0 0 2024-05-06T14:04:11.853 INFO:tasks.workunit.client.1.smithi174.stdout:0/425: getdents d0/d3/d5d 0 2024-05-06T14:04:11.853 INFO:tasks.workunit.client.1.smithi174.stdout:0/426: dread - d0/d36/d45/f4d zero size 2024-05-06T14:04:11.853 INFO:tasks.workunit.client.1.smithi174.stdout:0/427: mknod d0/d36/d3f/d7a/c8e 0 2024-05-06T14:04:11.853 INFO:tasks.workunit.client.1.smithi174.stdout:0/428: getdents d0/d3/d5d/d38 0 2024-05-06T14:04:11.864 INFO:tasks.workunit.client.1.smithi174.stdout:9/474: dread dc/d1c/f56 [65536,126976] 0 2024-05-06T14:04:11.865 INFO:tasks.workunit.client.1.smithi174.stdout:9/475: write dc/d14/f1e [2523107,61464] 0 2024-05-06T14:04:11.865 INFO:tasks.workunit.client.1.smithi174.stdout:9/476: stat dc/d17/d3a/d8d/l96 0 2024-05-06T14:04:11.865 INFO:tasks.workunit.client.1.smithi174.stdout:9/477: write dc/d27/d51/f65 [797195,64971] 0 2024-05-06T14:04:11.865 INFO:tasks.workunit.client.1.smithi174.stdout:9/478: write dc/de/f68 [174167,96685] 0 2024-05-06T14:04:11.865 INFO:tasks.workunit.client.1.smithi174.stdout:9/479: link dc/d27/d51/f65 dc/d27/d63/f9e 0 2024-05-06T14:04:11.865 INFO:tasks.workunit.client.1.smithi174.stdout:9/480: stat dc/d27/c80 0 2024-05-06T14:04:11.867 INFO:tasks.workunit.client.1.smithi174.stdout:4/541: read d1/d1f/d27/d2c/f3f [331460,91302] 0 2024-05-06T14:04:11.867 INFO:tasks.workunit.client.1.smithi174.stdout:4/542: stat d1/l4a 0 2024-05-06T14:04:11.870 INFO:tasks.workunit.client.1.smithi174.stdout:3/473: read df/d10/d1b/f65 [304330,99634] 0 2024-05-06T14:04:11.871 INFO:tasks.workunit.client.1.smithi174.stdout:3/474: creat df/d10/d1b/d7e/d5a/f99 x:0 0 0 2024-05-06T14:04:11.871 INFO:tasks.workunit.client.1.smithi174.stdout:3/475: readlink df/d10/d1b/d7e/l8e 0 2024-05-06T14:04:11.871 INFO:tasks.workunit.client.1.smithi174.stdout:3/476: chown df/d10/d1b/d59/c5f 297791713 1 2024-05-06T14:04:11.871 INFO:tasks.workunit.client.1.smithi174.stdout:3/477: mknod df/d10/d1b/d7e/c9a 0 2024-05-06T14:04:11.871 INFO:tasks.workunit.client.1.smithi174.stdout:3/478: symlink df/l9b 0 2024-05-06T14:04:11.871 INFO:tasks.workunit.client.1.smithi174.stdout:3/479: link df/d10/d1b/f7f df/f9c 0 2024-05-06T14:04:11.942 INFO:tasks.workunit.client.1.smithi174.stdout:5/500: dwrite d1/d6/df/d35/d3a/de/f63 [1396736,45056] 0 2024-05-06T14:04:11.943 INFO:tasks.workunit.client.1.smithi174.stdout:5/501: rmdir d1/d6/d7/da1 39 2024-05-06T14:04:11.943 INFO:tasks.workunit.client.1.smithi174.stdout:5/502: chown d1/d6/d7/d36/d53/d59/d61 7923574 1 2024-05-06T14:04:11.943 INFO:tasks.workunit.client.1.smithi174.stdout:5/503: write d1/d6/d7/f95 [1975937,105739] 0 2024-05-06T14:04:11.943 INFO:tasks.workunit.client.1.smithi174.stdout:5/504: rename d1/d6/df/d35/d8b/fa7 to d1/d6/df/d35/d3a/d41/fab 0 2024-05-06T14:04:11.943 INFO:tasks.workunit.client.1.smithi174.stdout:5/505: creat d1/d6/df/d35/d3a/fac x:0 0 0 2024-05-06T14:04:11.943 INFO:tasks.workunit.client.1.smithi174.stdout:5/506: rename d1/d6/df/d35/d3a/f5c to d1/d6/d7/da1/fad 0 2024-05-06T14:04:11.944 INFO:tasks.workunit.client.1.smithi174.stdout:5/507: symlink d1/d6/d7/d36/lae 0 2024-05-06T14:04:11.944 INFO:tasks.workunit.client.1.smithi174.stdout:5/508: unlink d1/d6/df/d35/d3a/de/f5d 0 2024-05-06T14:04:11.944 INFO:tasks.workunit.client.1.smithi174.stdout:5/509: read - d1/d6/d7/d36/d53/f9e zero size 2024-05-06T14:04:11.944 INFO:tasks.workunit.client.1.smithi174.stdout:5/510: unlink d1/d6/df/d35/d81/d60/d99/l9c 0 2024-05-06T14:04:11.944 INFO:tasks.workunit.client.1.smithi174.stdout:7/402: dwrite d0/d1d/d41/d61/d19/d24/d14/d52/f8c [208896,106496] 0 2024-05-06T14:04:11.944 INFO:tasks.workunit.client.1.smithi174.stdout:0/429: dwrite d0/d36/d3f/f84 [40960,40960] 0 2024-05-06T14:04:11.944 INFO:tasks.workunit.client.1.smithi174.stdout:0/430: dread d0/f59 [122880,81920] 0 2024-05-06T14:04:11.944 INFO:tasks.workunit.client.1.smithi174.stdout:0/431: getdents d0/d36/d45 0 2024-05-06T14:04:11.945 INFO:tasks.workunit.client.1.smithi174.stdout:0/432: write d0/f24 [967295,62673] 0 2024-05-06T14:04:11.945 INFO:tasks.workunit.client.1.smithi174.stdout:0/433: stat d0/d1a/f30 0 2024-05-06T14:04:11.945 INFO:tasks.workunit.client.1.smithi174.stdout:0/434: chown d0/d1a/d17/d2e/d58/c61 12 1 2024-05-06T14:04:11.945 INFO:tasks.workunit.client.1.smithi174.stdout:3/480: dwrite df/f55 [286720,114688] 0 2024-05-06T14:04:11.945 INFO:tasks.workunit.client.1.smithi174.stdout:3/481: symlink df/d2d/d5b/l9d 0 2024-05-06T14:04:11.945 INFO:tasks.workunit.client.1.smithi174.stdout:3/482: write df/d10/d1b/f7f [948712,125372] 0 2024-05-06T14:04:11.945 INFO:tasks.workunit.client.1.smithi174.stdout:3/483: chown df/d2d/d4d/c7d 1963363 1 2024-05-06T14:04:11.945 INFO:tasks.workunit.client.1.smithi174.stdout:3/484: chown df/d10/d1b/d7e 6247 1 2024-05-06T14:04:11.946 INFO:tasks.workunit.client.1.smithi174.stdout:3/485: write df/d10/d1b/d7e/f51 [1101952,79376] 0 2024-05-06T14:04:11.946 INFO:tasks.workunit.client.1.smithi174.stdout:3/486: rename df/d2d/f4a to df/f9e 0 2024-05-06T14:04:11.946 INFO:tasks.workunit.client.1.smithi174.stdout:3/487: rmdir df/d2d/d4e/d81/d94 0 2024-05-06T14:04:11.946 INFO:tasks.workunit.client.1.smithi174.stdout:3/488: dread df/d10/d1b/f24 [110592,106496] 0 2024-05-06T14:04:11.946 INFO:tasks.workunit.client.1.smithi174.stdout:3/489: creat df/d10/d1b/f9f x:0 0 0 2024-05-06T14:04:11.967 INFO:tasks.workunit.client.1.smithi174.stdout:4/543: fdatasync d1/d9/d15/d98/f76 0 2024-05-06T14:04:11.967 INFO:tasks.workunit.client.1.smithi174.stdout:7/403: fdatasync d0/d1d/d41/d61/d19/d24/d47/d70/d83/f84 0 2024-05-06T14:04:11.967 INFO:tasks.workunit.client.1.smithi174.stdout:7/404: stat d0/d1d/f1e 0 2024-05-06T14:04:11.968 INFO:tasks.workunit.client.1.smithi174.stdout:9/481: fdatasync dc/d17/f2f 0 2024-05-06T14:04:11.968 INFO:tasks.workunit.client.1.smithi174.stdout:9/482: dread - dc/d27/d60/f6a zero size 2024-05-06T14:04:11.975 INFO:tasks.workunit.client.1.smithi174.stdout:0/435: dread d0/d3/d5d/f43 [1245184,118784] 0 2024-05-06T14:04:11.978 INFO:tasks.workunit.client.1.smithi174.stdout:0/436: chown d0/d3/d5d/c6d 263473496 1 2024-05-06T14:04:11.978 INFO:tasks.workunit.client.1.smithi174.stdout:4/544: dwrite d1/d9/d15/f4c [245760,49152] 0 2024-05-06T14:04:11.978 INFO:tasks.workunit.client.1.smithi174.stdout:5/511: dwrite d1/d6/df/d35/d3a/d41/f8f [1007616,122880] 0 2024-05-06T14:04:11.978 INFO:tasks.workunit.client.1.smithi174.stdout:3/490: dwrite df/f44 [274432,28672] 0 2024-05-06T14:04:11.979 INFO:tasks.workunit.client.1.smithi174.stdout:9/483: creat dc/de/d81/f9f x:0 0 0 2024-05-06T14:04:11.979 INFO:tasks.workunit.client.1.smithi174.stdout:4/545: dread d1/fc [1019904,45056] 0 2024-05-06T14:04:11.979 INFO:tasks.workunit.client.1.smithi174.stdout:5/512: mkdir d1/d6/df/d35/d81/daf 0 2024-05-06T14:04:11.979 INFO:tasks.workunit.client.1.smithi174.stdout:4/546: creat d1/d9/d15/dc7/fc9 x:0 0 0 2024-05-06T14:04:11.979 INFO:tasks.workunit.client.1.smithi174.stdout:4/547: stat d1/d1f/d27/d3e/d6e/d50/db0 0 2024-05-06T14:04:11.979 INFO:tasks.workunit.client.1.smithi174.stdout:0/437: write d0/f24 [1847120,101776] 0 2024-05-06T14:04:11.979 INFO:tasks.workunit.client.1.smithi174.stdout:3/491: write df/d10/d1b/f5c [2302812,99558] 0 2024-05-06T14:04:11.979 INFO:tasks.workunit.client.1.smithi174.stdout:0/438: write d0/d1a/f30 [996455,63345] 0 2024-05-06T14:04:11.980 INFO:tasks.workunit.client.1.smithi174.stdout:0/439: dread d0/d1a/d17/d2e/f39 [225280,4096] 0 2024-05-06T14:04:11.980 INFO:tasks.workunit.client.1.smithi174.stdout:3/492: mknod df/d10/d1b/d59/ca0 0 2024-05-06T14:04:11.980 INFO:tasks.workunit.client.1.smithi174.stdout:0/440: write d0/d36/d45/f4d [327399,49729] 0 2024-05-06T14:04:11.980 INFO:tasks.workunit.client.1.smithi174.stdout:0/441: chown d0/d36/d3f/d5e/c76 503179 1 2024-05-06T14:04:11.980 INFO:tasks.workunit.client.1.smithi174.stdout:0/442: chown d0/d1a/d17/d2e/f39 39 1 2024-05-06T14:04:11.980 INFO:tasks.workunit.client.1.smithi174.stdout:0/443: rmdir d0/d4/d8 39 2024-05-06T14:04:11.980 INFO:tasks.workunit.client.1.smithi174.stdout:0/444: truncate d0/d4/d8/f47 548872 0 2024-05-06T14:04:11.980 INFO:tasks.workunit.client.1.smithi174.stdout:0/445: chown d0/d3/d5d/c78 1 1 2024-05-06T14:04:11.980 INFO:tasks.workunit.client.1.smithi174.stdout:0/446: creat d0/d16/f8f x:0 0 0 2024-05-06T14:04:11.981 INFO:tasks.workunit.client.1.smithi174.stdout:0/447: mknod d0/d3/d5d/c90 0 2024-05-06T14:04:11.981 INFO:tasks.workunit.client.1.smithi174.stdout:0/448: creat d0/d4/d8/d25/d5c/d44/f91 x:0 0 0 2024-05-06T14:04:11.981 INFO:tasks.workunit.client.1.smithi174.stdout:0/449: write d0/d4/d8/d25/d5c/d4a/f60 [157657,10428] 0 2024-05-06T14:04:11.981 INFO:tasks.workunit.client.1.smithi174.stdout:5/513: rename d1/d6/df/d35/d3a to d1/d6/df/d35/d81/d60/db0 0 2024-05-06T14:04:11.981 INFO:tasks.workunit.client.1.smithi174.stdout:5/514: chown d1/d6/d2a/f2d 3 1 2024-05-06T14:04:11.981 INFO:tasks.workunit.client.1.smithi174.stdout:4/548: rename d1/d1f/d27/d3e/f70 to d1/d9/d15/d92/fca 0 2024-05-06T14:04:11.981 INFO:tasks.workunit.client.1.smithi174.stdout:5/515: truncate d1/d6/d7/d36/d53/f74 2610774 0 2024-05-06T14:04:11.981 INFO:tasks.workunit.client.1.smithi174.stdout:5/516: dread - d1/d6/d7/da1/fad zero size 2024-05-06T14:04:11.982 INFO:tasks.workunit.client.1.smithi174.stdout:0/450: rename d0/d1a/d17/d2e/f3e to d0/f92 0 2024-05-06T14:04:11.982 INFO:tasks.workunit.client.1.smithi174.stdout:4/549: creat d1/d1f/d27/fcb x:0 0 0 2024-05-06T14:04:11.982 INFO:tasks.workunit.client.1.smithi174.stdout:4/550: link d1/d48/db4/c87 d1/d48/d5a/d5f/ccc 0 2024-05-06T14:04:11.982 INFO:tasks.workunit.client.1.smithi174.stdout:0/451: mkdir d0/d4/d80/d93 0 2024-05-06T14:04:11.982 INFO:tasks.workunit.client.1.smithi174.stdout:0/452: dread d0/f24 [790528,110592] 0 2024-05-06T14:04:11.982 INFO:tasks.workunit.client.1.smithi174.stdout:0/453: readlink d0/l11 0 2024-05-06T14:04:11.982 INFO:tasks.workunit.client.1.smithi174.stdout:0/454: unlink d0/fa 0 2024-05-06T14:04:11.982 INFO:tasks.workunit.client.1.smithi174.stdout:0/455: unlink d0/d1a/d17/d2e/d58/f75 0 2024-05-06T14:04:11.982 INFO:tasks.workunit.client.1.smithi174.stdout:0/456: chown d0/d4/d8/f47 0 1 2024-05-06T14:04:11.983 INFO:tasks.workunit.client.1.smithi174.stdout:7/405: dwrite d0/d1d/d41/d61/d19/d24/d14/d52/f76 [733184,4096] 0 2024-05-06T14:04:11.983 INFO:tasks.workunit.client.1.smithi174.stdout:7/406: chown d0/d1d/d41/d61/d28/d59/f3f 1 1 2024-05-06T14:04:11.983 INFO:tasks.workunit.client.1.smithi174.stdout:5/517: dwrite d1/d6/df/f79 [393216,45056] 0 2024-05-06T14:04:11.983 INFO:tasks.workunit.client.1.smithi174.stdout:0/457: dwrite d0/d4/d8/f70 [610304,73728] 0 2024-05-06T14:04:11.983 INFO:tasks.workunit.client.1.smithi174.stdout:0/458: dread d0/d4/d8/d25/f63 [40960,94208] 0 2024-05-06T14:04:11.983 INFO:tasks.workunit.client.1.smithi174.stdout:0/459: mknod d0/c94 0 2024-05-06T14:04:11.983 INFO:tasks.workunit.client.1.smithi174.stdout:9/484: dwrite dc/d14/f97 [290816,32768] 0 2024-05-06T14:04:12.101 INFO:tasks.workunit.client.1.smithi174.stdout:5/518: write d1/d6/df/d35/d81/d60/db0/fd [6221872,79199] 0 2024-05-06T14:04:12.107 INFO:tasks.workunit.client.1.smithi174.stdout:7/407: rename d0/d1d/d41/d61/d19/d24/d47/f5e to d0/d1d/d41/d61/d19/d24/d6f/d88/f8d 0 2024-05-06T14:04:12.107 INFO:tasks.workunit.client.1.smithi174.stdout:9/485: link dc/d27/d63/f74 dc/de/d6b/fa0 0 2024-05-06T14:04:12.107 INFO:tasks.workunit.client.1.smithi174.stdout:7/408: rmdir d0/d3a 39 2024-05-06T14:04:12.107 INFO:tasks.workunit.client.1.smithi174.stdout:7/409: dread d0/d1d/d41/d61/f38 [237568,94208] 0 2024-05-06T14:04:12.107 INFO:tasks.workunit.client.1.smithi174.stdout:5/519: write d1/d6/df/d35/d81/d60/db0/de/f3f [1982068,55229] 0 2024-05-06T14:04:12.107 INFO:tasks.workunit.client.1.smithi174.stdout:7/410: creat d0/f8e x:0 0 0 2024-05-06T14:04:12.108 INFO:tasks.workunit.client.1.smithi174.stdout:7/411: creat d0/d1d/d41/d61/d19/d24/d89/f8f x:0 0 0 2024-05-06T14:04:12.108 INFO:tasks.workunit.client.1.smithi174.stdout:5/520: symlink d1/d6/d7/d36/d53/d59/d61/lb1 0 2024-05-06T14:04:12.108 INFO:tasks.workunit.client.1.smithi174.stdout:5/521: creat d1/d6/df/d35/d81/d60/d82/fb2 x:0 0 0 2024-05-06T14:04:12.108 INFO:tasks.workunit.client.1.smithi174.stdout:9/486: write dc/d14/f97 [26985,96297] 0 2024-05-06T14:04:12.108 INFO:tasks.workunit.client.1.smithi174.stdout:7/412: write d0/d1d/d41/d61/d28/d37/f40 [589694,115895] 0 2024-05-06T14:04:12.108 INFO:tasks.workunit.client.1.smithi174.stdout:9/487: mknod dc/d27/ca1 0 2024-05-06T14:04:12.108 INFO:tasks.workunit.client.1.smithi174.stdout:7/413: truncate d0/d1d/d41/d61/d28/d37/f60 616380 0 2024-05-06T14:04:12.109 INFO:tasks.workunit.client.1.smithi174.stdout:7/414: dread - d0/d1d/d41/d61/d19/d24/d47/f7a zero size 2024-05-06T14:04:12.109 INFO:tasks.workunit.client.1.smithi174.stdout:7/415: chown d0/d1d/d41/d61/d19/d24/d47/d70/c51 1397445325 1 2024-05-06T14:04:12.109 INFO:tasks.workunit.client.1.smithi174.stdout:7/416: dread - d0/d1d/d41/d61/d19/d24/d47/d70/d67/f86 zero size 2024-05-06T14:04:12.109 INFO:tasks.workunit.client.1.smithi174.stdout:7/417: mkdir d0/d1d/d41/d61/d19/d39/d90 0 2024-05-06T14:04:12.109 INFO:tasks.workunit.client.1.smithi174.stdout:0/460: rename d0/d36/d3f/f84 to d0/d4/d8/d25/d5c/d4a/f95 0 2024-05-06T14:04:12.109 INFO:tasks.workunit.client.1.smithi174.stdout:9/488: rename dc/d27/d51/f65 to dc/de/d7f/d93/fa2 0 2024-05-06T14:04:12.109 INFO:tasks.workunit.client.1.smithi174.stdout:0/461: creat d0/d36/d3f/d7a/f96 x:0 0 0 2024-05-06T14:04:12.110 INFO:tasks.workunit.client.1.smithi174.stdout:9/489: creat dc/d27/d63/fa3 x:0 0 0 2024-05-06T14:04:12.110 INFO:tasks.workunit.client.1.smithi174.stdout:0/462: chown d0/f59 2 1 2024-05-06T14:04:12.110 INFO:tasks.workunit.client.1.smithi174.stdout:9/490: truncate dc/d27/d63/f74 1718415 0 2024-05-06T14:04:12.110 INFO:tasks.workunit.client.1.smithi174.stdout:9/491: dread - dc/f3d zero size 2024-05-06T14:04:12.110 INFO:tasks.workunit.client.1.smithi174.stdout:9/492: mkdir dc/de/d7f/da4 0 2024-05-06T14:04:12.110 INFO:tasks.workunit.client.1.smithi174.stdout:9/493: dread dc/df/f12 [831488,110592] 0 2024-05-06T14:04:12.110 INFO:tasks.workunit.client.1.smithi174.stdout:9/494: mkdir dc/d27/d51/da5 0 2024-05-06T14:04:12.110 INFO:tasks.workunit.client.1.smithi174.stdout:9/495: rmdir dc/d14 39 2024-05-06T14:04:12.110 INFO:tasks.workunit.client.1.smithi174.stdout:7/418: rmdir d0/d1d/d41/d61/d19/d24/d6f/d88 39 2024-05-06T14:04:12.111 INFO:tasks.workunit.client.1.smithi174.stdout:7/419: mknod d0/c91 0 2024-05-06T14:04:12.111 INFO:tasks.workunit.client.1.smithi174.stdout:7/420: readlink d0/d1d/d41/d61/d19/d39/d46/l5a 0 2024-05-06T14:04:12.111 INFO:tasks.workunit.client.1.smithi174.stdout:7/421: truncate d0/d1d/d41/d61/d28/f6e 401350 0 2024-05-06T14:04:12.111 INFO:tasks.workunit.client.1.smithi174.stdout:7/422: dread - d0/f8e zero size 2024-05-06T14:04:12.111 INFO:tasks.workunit.client.1.smithi174.stdout:7/423: chown d0/d1d/d41/d61/d19/d24/d14/d52/f76 14123346 1 2024-05-06T14:04:12.111 INFO:tasks.workunit.client.1.smithi174.stdout:7/424: creat d0/d1d/d41/d61/d19/d24/d14/d52/f92 x:0 0 0 2024-05-06T14:04:12.111 INFO:tasks.workunit.client.1.smithi174.stdout:7/425: mkdir d0/d1d/d41/d61/d19/d24/d89/d93 0 2024-05-06T14:04:12.112 INFO:tasks.workunit.client.1.smithi174.stdout:7/426: dwrite d0/d1d/d41/d61/d19/d24/d14/d52/f3e [1769472,16384] 0 2024-05-06T14:04:12.113 INFO:tasks.workunit.client.1.smithi174.stdout:7/427: creat d0/d1d/d41/d61/d19/d24/d89/f94 x:0 0 0 2024-05-06T14:04:12.113 INFO:tasks.workunit.client.1.smithi174.stdout:7/428: creat d0/d1d/d41/d61/d19/d24/d6f/d88/f95 x:0 0 0 2024-05-06T14:04:12.113 INFO:tasks.workunit.client.1.smithi174.stdout:7/429: link d0/d1d/c2b d0/d1d/d41/d61/d19/d24/c96 0 2024-05-06T14:04:12.119 INFO:tasks.workunit.client.1.smithi174.stdout:9/496: dread dc/d27/d60/f69 [188416,16384] 0 2024-05-06T14:04:12.119 INFO:tasks.workunit.client.1.smithi174.stdout:9/497: chown dc/d27/l5e 231312 1 2024-05-06T14:04:12.119 INFO:tasks.workunit.client.1.smithi174.stdout:9/498: dread dc/d27/f39 [1335296,122880] 0 2024-05-06T14:04:12.119 INFO:tasks.workunit.client.1.smithi174.stdout:9/499: chown dc/de/d81/f9f 22246 1 2024-05-06T14:04:12.119 INFO:tasks.workunit.client.1.smithi174.stdout:9/500: mkdir dc/de/d81/da6 0 2024-05-06T14:04:12.119 INFO:tasks.workunit.client.1.smithi174.stdout:9/501: creat dc/d27/d6d/fa7 x:0 0 0 2024-05-06T14:04:12.119 INFO:tasks.workunit.client.1.smithi174.stdout:9/502: truncate dc/d14/f6c 337633 0 2024-05-06T14:04:12.219 INFO:tasks.workunit.client.1.smithi174.stdout:8/561: sync 2024-05-06T14:04:12.220 INFO:tasks.workunit.client.1.smithi174.stdout:2/466: sync 2024-05-06T14:04:12.220 INFO:tasks.workunit.client.1.smithi174.stdout:6/588: sync 2024-05-06T14:04:12.220 INFO:tasks.workunit.client.1.smithi174.stdout:1/382: sync 2024-05-06T14:04:12.220 INFO:tasks.workunit.client.1.smithi174.stdout:8/562: truncate d4/de/d24/d46/d63/f6f 771603 0 2024-05-06T14:04:12.220 INFO:tasks.workunit.client.1.smithi174.stdout:8/563: chown d4/l1d 88623 1 2024-05-06T14:04:12.220 INFO:tasks.workunit.client.1.smithi174.stdout:1/383: dread - d11/d41/f5c zero size 2024-05-06T14:04:12.220 INFO:tasks.workunit.client.1.smithi174.stdout:8/564: chown d4/d15 23309487 1 2024-05-06T14:04:12.221 INFO:tasks.workunit.client.1.smithi174.stdout:6/589: dread d0/df/d3c/f91 [815104,20480] 0 2024-05-06T14:04:12.221 INFO:tasks.workunit.client.1.smithi174.stdout:6/590: stat d0/df/d45/d4b 0 2024-05-06T14:04:12.221 INFO:tasks.workunit.client.1.smithi174.stdout:1/384: rename d11/d1f/d27/d2d/c88 to d11/d1f/d27/d32/d84/d8c/c95 0 2024-05-06T14:04:12.221 INFO:tasks.workunit.client.1.smithi174.stdout:8/565: creat d4/de/d23/d3c/fbb x:0 0 0 2024-05-06T14:04:12.221 INFO:tasks.workunit.client.1.smithi174.stdout:6/591: creat d0/fc4 x:0 0 0 2024-05-06T14:04:12.221 INFO:tasks.workunit.client.1.smithi174.stdout:1/385: chown d11/d57/d83/l8f 17 1 2024-05-06T14:04:12.251 INFO:tasks.workunit.client.1.smithi174.stdout:7/430: fsync d0/d1d/d41/d61/d19/d24/f87 0 2024-05-06T14:04:12.251 INFO:tasks.workunit.client.1.smithi174.stdout:8/566: fsync d4/de/d24/f33 0 2024-05-06T14:04:12.251 INFO:tasks.workunit.client.1.smithi174.stdout:9/503: fsync dc/d1c/f41 0 2024-05-06T14:04:12.259 INFO:tasks.workunit.client.1.smithi174.stdout:6/592: creat d0/df/d45/d4b/fc5 x:0 0 0 2024-05-06T14:04:12.259 INFO:tasks.workunit.client.1.smithi174.stdout:1/386: creat d11/d57/f96 x:0 0 0 2024-05-06T14:04:12.260 INFO:tasks.workunit.client.1.smithi174.stdout:1/387: stat d11/d1f/d27/d2d/f33 0 2024-05-06T14:04:12.260 INFO:tasks.workunit.client.1.smithi174.stdout:1/388: rmdir d11/d41 39 2024-05-06T14:04:12.260 INFO:tasks.workunit.client.1.smithi174.stdout:1/389: stat d11/d1f/d27/d32/d84/d8c/d94 0 2024-05-06T14:04:12.260 INFO:tasks.workunit.client.1.smithi174.stdout:1/390: stat fe 0 2024-05-06T14:04:12.260 INFO:tasks.workunit.client.1.smithi174.stdout:7/431: dread d0/d1d/d41/f4b [4411392,102400] 0 2024-05-06T14:04:12.260 INFO:tasks.workunit.client.1.smithi174.stdout:9/504: truncate dc/df/f11 3079581 0 2024-05-06T14:04:12.260 INFO:tasks.workunit.client.1.smithi174.stdout:1/391: rename d11/d41/f60 to d11/d57/d83/f97 0 2024-05-06T14:04:12.261 INFO:tasks.workunit.client.1.smithi174.stdout:7/432: truncate d0/d1d/d41/d61/d28/f62 1432043 0 2024-05-06T14:04:12.261 INFO:tasks.workunit.client.1.smithi174.stdout:8/567: truncate d4/d15/d64/f7c 1285490 0 2024-05-06T14:04:12.261 INFO:tasks.workunit.client.1.smithi174.stdout:1/392: dread - d11/d41/d4a/d5e/f6f zero size 2024-05-06T14:04:12.261 INFO:tasks.workunit.client.1.smithi174.stdout:9/505: dread dc/d27/f39 [1515520,20480] 0 2024-05-06T14:04:12.261 INFO:tasks.workunit.client.1.smithi174.stdout:1/393: rmdir d11/d57/d83 39 2024-05-06T14:04:12.261 INFO:tasks.workunit.client.1.smithi174.stdout:8/568: dread - d4/de/d24/d46/d63/fac zero size 2024-05-06T14:04:12.261 INFO:tasks.workunit.client.1.smithi174.stdout:8/569: chown d4/d15/d20/d3e/f93 3049148 1 2024-05-06T14:04:12.261 INFO:tasks.workunit.client.1.smithi174.stdout:7/433: read d0/d1d/f2c [179026,82934] 0 2024-05-06T14:04:12.307 INFO:tasks.workunit.client.1.smithi174.stdout:7/434: fsync d0/f2e 0 2024-05-06T14:04:12.308 INFO:tasks.workunit.client.1.smithi174.stdout:7/435: write d0/d1d/d41/d61/d28/f62 [1962269,29235] 0 2024-05-06T14:04:12.309 INFO:tasks.workunit.client.1.smithi174.stdout:7/436: truncate d0/d1d/d41/d61/f38 1899316 0 2024-05-06T14:04:12.309 INFO:tasks.workunit.client.1.smithi174.stdout:8/570: creat d4/de/d23/d3c/fbc x:0 0 0 2024-05-06T14:04:12.310 INFO:tasks.workunit.client.1.smithi174.stdout:9/506: mkdir dc/d14/da8 0 2024-05-06T14:04:12.310 INFO:tasks.workunit.client.1.smithi174.stdout:6/593: rmdir d0/d93/db0 0 2024-05-06T14:04:12.310 INFO:tasks.workunit.client.1.smithi174.stdout:6/594: getdents d0/d25/d52/d2c 0 2024-05-06T14:04:12.310 INFO:tasks.workunit.client.1.smithi174.stdout:8/571: symlink d4/de/d24/d5e/d85/lbd 0 2024-05-06T14:04:12.310 INFO:tasks.workunit.client.1.smithi174.stdout:1/394: write d11/d67/d6c/f72 [927560,60770] 0 2024-05-06T14:04:12.310 INFO:tasks.workunit.client.1.smithi174.stdout:8/572: read - d4/de/f72 zero size 2024-05-06T14:04:12.310 INFO:tasks.workunit.client.1.smithi174.stdout:9/507: symlink dc/d17/d3a/d8d/la9 0 2024-05-06T14:04:12.310 INFO:tasks.workunit.client.1.smithi174.stdout:6/595: dread d0/d25/d35/fa4 [598016,110592] 0 2024-05-06T14:04:12.311 INFO:tasks.workunit.client.1.smithi174.stdout:8/573: write d4/de/d23/f92 [128681,8292] 0 2024-05-06T14:04:12.311 INFO:tasks.workunit.client.1.smithi174.stdout:9/508: write dc/de/d81/f9f [1019012,80371] 0 2024-05-06T14:04:12.311 INFO:tasks.workunit.client.1.smithi174.stdout:8/574: creat d4/de/d24/d5e/d85/d91/fbe x:0 0 0 2024-05-06T14:04:12.311 INFO:tasks.workunit.client.1.smithi174.stdout:8/575: stat d4/d15/d20/d3e/f93 0 2024-05-06T14:04:12.346 INFO:tasks.workunit.client.1.smithi174.stdout:7/437: fdatasync d0/d1d/d41/d61/d19/d24/d14/d52/f20 0 2024-05-06T14:04:12.346 INFO:tasks.workunit.client.1.smithi174.stdout:7/438: creat d0/d1d/d41/f97 x:0 0 0 2024-05-06T14:04:12.350 INFO:tasks.workunit.client.1.smithi174.stdout:8/576: dwrite d4/de/f17 [159744,40960] 0 2024-05-06T14:04:12.350 INFO:tasks.workunit.client.1.smithi174.stdout:8/577: truncate d4/de/d23/d3c/f55 2340070 0 2024-05-06T14:04:12.350 INFO:tasks.workunit.client.1.smithi174.stdout:7/439: dwrite d0/d1d/d41/d61/d19/d24/d14/d52/f76 [561152,40960] 0 2024-05-06T14:04:12.350 INFO:tasks.workunit.client.1.smithi174.stdout:8/578: mkdir d4/d15/d20/d3e/d79/dbf 0 2024-05-06T14:04:12.351 INFO:tasks.workunit.client.1.smithi174.stdout:7/440: getdents d0/d1d/d41/d61/d19/d24/d14/d52 0 2024-05-06T14:04:12.351 INFO:tasks.workunit.client.1.smithi174.stdout:8/579: readlink d4/de/l7b 0 2024-05-06T14:04:12.351 INFO:tasks.workunit.client.1.smithi174.stdout:6/596: dwrite d0/d25/d52/d3b/f83 [1044480,86016] 0 2024-05-06T14:04:12.351 INFO:tasks.workunit.client.1.smithi174.stdout:6/597: read d0/df/f1f [8703,82805] 0 2024-05-06T14:04:12.353 INFO:tasks.workunit.client.1.smithi174.stdout:1/395: dread d11/d1f/f89 [520192,28672] 0 2024-05-06T14:04:12.353 INFO:tasks.workunit.client.1.smithi174.stdout:1/396: mkdir d11/d57/d98 0 2024-05-06T14:04:12.353 INFO:tasks.workunit.client.1.smithi174.stdout:1/397: symlink d11/d41/d4a/l99 0 2024-05-06T14:04:12.353 INFO:tasks.workunit.client.1.smithi174.stdout:1/398: write d11/d1f/d27/d32/f4b [702399,111633] 0 2024-05-06T14:04:12.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/399: dread d11/d1f/d27/d2d/f33 [266240,4096] 0 2024-05-06T14:04:12.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/400: creat d11/d1f/d27/d32/d84/f9a x:0 0 0 2024-05-06T14:04:12.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/401: mkdir d11/d79/d9b 0 2024-05-06T14:04:12.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/402: dread d11/d67/d6c/f72 [749568,4096] 0 2024-05-06T14:04:12.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/403: mkdir d11/d1f/d27/d2d/d9c 0 2024-05-06T14:04:12.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/404: write f1 [1880305,130321] 0 2024-05-06T14:04:12.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/405: truncate d11/f5a 1239858 0 2024-05-06T14:04:12.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/406: creat d11/d1f/d27/d32/d84/d8c/f9d x:0 0 0 2024-05-06T14:04:12.355 INFO:tasks.workunit.client.1.smithi174.stdout:1/407: creat d11/d57/f9e x:0 0 0 2024-05-06T14:04:12.355 INFO:tasks.workunit.client.1.smithi174.stdout:1/408: chown d11/d57/c80 7657 1 2024-05-06T14:04:12.395 INFO:tasks.workunit.client.1.smithi174.stdout:0/463: fdatasync d0/d36/d45/f4d 0 2024-05-06T14:04:12.395 INFO:tasks.workunit.client.1.smithi174.stdout:6/598: fsync d0/df/f20 0 2024-05-06T14:04:12.395 INFO:tasks.workunit.client.1.smithi174.stdout:1/409: fdatasync d11/f20 0 2024-05-06T14:04:12.395 INFO:tasks.workunit.client.1.smithi174.stdout:9/509: fsync dc/f76 0 2024-05-06T14:04:12.395 INFO:tasks.workunit.client.1.smithi174.stdout:0/464: rename d0/d4/d8/f70 to d0/d4/d80/d93/f97 0 2024-05-06T14:04:12.403 INFO:tasks.workunit.client.1.smithi174.stdout:6/599: write d0/f7f [1024108,1982] 0 2024-05-06T14:04:12.403 INFO:tasks.workunit.client.1.smithi174.stdout:0/465: rename d0/d4/d8/d25/l48 to d0/d4/d8/d25/d5c/d44/l98 0 2024-05-06T14:04:12.404 INFO:tasks.workunit.client.1.smithi174.stdout:0/466: chown d0/d1a/d17/f2a 2466 1 2024-05-06T14:04:12.404 INFO:tasks.workunit.client.1.smithi174.stdout:8/580: dwrite d4/de/fa3 [1794048,126976] 0 2024-05-06T14:04:12.404 INFO:tasks.workunit.client.1.smithi174.stdout:9/510: symlink dc/de/laa 0 2024-05-06T14:04:12.404 INFO:tasks.workunit.client.1.smithi174.stdout:8/581: chown d4/d15/d20/d3e/d79/l9d 138862 1 2024-05-06T14:04:12.404 INFO:tasks.workunit.client.1.smithi174.stdout:8/582: stat d4/d48/f90 0 2024-05-06T14:04:12.404 INFO:tasks.workunit.client.1.smithi174.stdout:8/583: chown d4/d15/d20/l39 17892613 1 2024-05-06T14:04:12.404 INFO:tasks.workunit.client.1.smithi174.stdout:6/600: write d0/d25/d52/d3b/f83 [820720,117530] 0 2024-05-06T14:04:12.404 INFO:tasks.workunit.client.1.smithi174.stdout:8/584: mkdir d4/de/d23/d41/d56/dc0 0 2024-05-06T14:04:12.405 INFO:tasks.workunit.client.1.smithi174.stdout:1/410: write d11/d1f/d27/d32/d84/d8c/f9d [133649,99596] 0 2024-05-06T14:04:12.405 INFO:tasks.workunit.client.1.smithi174.stdout:1/411: stat d11/c21 0 2024-05-06T14:04:12.405 INFO:tasks.workunit.client.1.smithi174.stdout:8/585: mkdir d4/de/d24/dc1 0 2024-05-06T14:04:12.405 INFO:tasks.workunit.client.1.smithi174.stdout:1/412: mkdir d11/d41/d51/d9f 0 2024-05-06T14:04:12.405 INFO:tasks.workunit.client.1.smithi174.stdout:8/586: dread d4/d15/d20/f42 [1425408,90112] 0 2024-05-06T14:04:12.405 INFO:tasks.workunit.client.1.smithi174.stdout:8/587: dread d4/f49 [573440,81920] 0 2024-05-06T14:04:12.405 INFO:tasks.workunit.client.1.smithi174.stdout:1/413: creat d11/d79/d9b/fa0 x:0 0 0 2024-05-06T14:04:12.405 INFO:tasks.workunit.client.1.smithi174.stdout:8/588: symlink d4/de/d24/d5e/d85/lc2 0 2024-05-06T14:04:12.406 INFO:tasks.workunit.client.1.smithi174.stdout:8/589: write d4/de/d23/d3c/f55 [114383,102030] 0 2024-05-06T14:04:12.406 INFO:tasks.workunit.client.1.smithi174.stdout:8/590: write d4/d15/d20/d3e/f62 [235937,80850] 0 2024-05-06T14:04:12.406 INFO:tasks.workunit.client.1.smithi174.stdout:8/591: mknod d4/de/d23/d3c/cc3 0 2024-05-06T14:04:12.406 INFO:tasks.workunit.client.1.smithi174.stdout:8/592: creat d4/de/d24/d5e/fc4 x:0 0 0 2024-05-06T14:04:12.406 INFO:tasks.workunit.client.1.smithi174.stdout:8/593: symlink d4/de/d24/d5e/d85/d91/lc5 0 2024-05-06T14:04:12.406 INFO:tasks.workunit.client.1.smithi174.stdout:7/441: dread d0/d1d/f75 [49152,49152] 0 2024-05-06T14:04:12.480 INFO:tasks.workunit.client.1.smithi174.stdout:7/442: link d0/d1d/d41/d61/d19/d24/d89/c8a d0/d1d/d41/d61/d19/d24/d89/c98 0 2024-05-06T14:04:12.480 INFO:tasks.workunit.client.1.smithi174.stdout:7/443: chown d0/d1d/d41/d61/d19/d39/d46 341674 1 2024-05-06T14:04:12.481 INFO:tasks.workunit.client.1.smithi174.stdout:7/444: rmdir d0/d1d/d41/d61/d19/d24/d89/d93 0 2024-05-06T14:04:12.483 INFO:tasks.workunit.client.1.smithi174.stdout:8/594: dwrite d4/d15/d20/f44 [1970176,20480] 0 2024-05-06T14:04:12.483 INFO:tasks.workunit.client.1.smithi174.stdout:1/414: dwrite d11/d1f/d27/d32/f71 [651264,4096] 0 2024-05-06T14:04:12.484 INFO:tasks.workunit.client.1.smithi174.stdout:8/595: getdents d4/d15/da1 0 2024-05-06T14:04:12.484 INFO:tasks.workunit.client.1.smithi174.stdout:8/596: dread d4/de/d23/f92 [32768,36864] 0 2024-05-06T14:04:12.484 INFO:tasks.workunit.client.1.smithi174.stdout:0/467: write d0/d1a/f22 [2504454,127608] 0 2024-05-06T14:04:12.484 INFO:tasks.workunit.client.1.smithi174.stdout:1/415: rename d11/d1f/d27/d2d/f33 to d11/d79/fa1 0 2024-05-06T14:04:12.484 INFO:tasks.workunit.client.1.smithi174.stdout:8/597: creat d4/de/d23/d41/d56/dc0/fc6 x:0 0 0 2024-05-06T14:04:12.485 INFO:tasks.workunit.client.1.smithi174.stdout:0/468: creat d0/d4/d80/f99 x:0 0 0 2024-05-06T14:04:12.485 INFO:tasks.workunit.client.1.smithi174.stdout:0/469: chown d0/f24 0 1 2024-05-06T14:04:12.485 INFO:tasks.workunit.client.1.smithi174.stdout:1/416: dread d11/d1f/d27/d2d/f52 [348160,61440] 0 2024-05-06T14:04:12.485 INFO:tasks.workunit.client.1.smithi174.stdout:0/470: dread d0/d4/d8/f47 [487424,106496] 0 2024-05-06T14:04:12.485 INFO:tasks.workunit.client.1.smithi174.stdout:8/598: symlink d4/de/d24/d5e/d85/d91/lc7 0 2024-05-06T14:04:12.485 INFO:tasks.workunit.client.1.smithi174.stdout:1/417: write d11/f20 [956377,30695] 0 2024-05-06T14:04:12.485 INFO:tasks.workunit.client.1.smithi174.stdout:1/418: creat d11/d41/d4a/fa2 x:0 0 0 2024-05-06T14:04:12.486 INFO:tasks.workunit.client.1.smithi174.stdout:1/419: chown d11/d79/fa1 220603219 1 2024-05-06T14:04:12.486 INFO:tasks.workunit.client.1.smithi174.stdout:1/420: rmdir d11/d67 39 2024-05-06T14:04:12.486 INFO:tasks.workunit.client.1.smithi174.stdout:1/421: stat d11/d67/d6c/f72 0 2024-05-06T14:04:12.486 INFO:tasks.workunit.client.1.smithi174.stdout:1/422: mknod d11/d41/d51/d9f/ca3 0 2024-05-06T14:04:12.487 INFO:tasks.workunit.client.1.smithi174.stdout:1/423: rename d11/f3c to d11/d1f/d27/d32/d84/d8c/fa4 0 2024-05-06T14:04:12.541 INFO:tasks.workunit.client.1.smithi174.stdout:9/511: fsync dc/f25 0 2024-05-06T14:04:12.548 INFO:tasks.workunit.client.1.smithi174.stdout:7/445: dwrite d0/d1d/d41/f4b [651264,69632] 0 2024-05-06T14:04:12.548 INFO:tasks.workunit.client.1.smithi174.stdout:1/424: dwrite f1 [2854912,69632] 0 2024-05-06T14:04:12.548 INFO:tasks.workunit.client.1.smithi174.stdout:8/599: dwrite d4/d48/fa7 [217088,65536] 0 2024-05-06T14:04:12.548 INFO:tasks.workunit.client.1.smithi174.stdout:0/471: dwrite d0/d3/d5d/f43 [421888,110592] 0 2024-05-06T14:04:12.549 INFO:tasks.workunit.client.1.smithi174.stdout:1/425: stat d11/d67/d6c/l7e 0 2024-05-06T14:04:12.549 INFO:tasks.workunit.client.1.smithi174.stdout:0/472: chown d0/d4/d8/d25/f6f 737 1 2024-05-06T14:04:12.549 INFO:tasks.workunit.client.1.smithi174.stdout:9/512: truncate dc/df/f12 235722 0 2024-05-06T14:04:12.549 INFO:tasks.workunit.client.1.smithi174.stdout:0/473: readlink d0/d3/d5d/l42 0 2024-05-06T14:04:12.549 INFO:tasks.workunit.client.1.smithi174.stdout:0/474: stat d0/d1a/f1b 0 2024-05-06T14:04:12.549 INFO:tasks.workunit.client.1.smithi174.stdout:8/600: symlink d4/d15/d20/d3e/d79/d94/lc8 0 2024-05-06T14:04:12.549 INFO:tasks.workunit.client.1.smithi174.stdout:1/426: truncate d11/d41/f66 2722879 0 2024-05-06T14:04:12.549 INFO:tasks.workunit.client.1.smithi174.stdout:0/475: creat d0/d36/d3f/d5e/f9a x:0 0 0 2024-05-06T14:04:12.550 INFO:tasks.workunit.client.1.smithi174.stdout:0/476: creat d0/d36/f9b x:0 0 0 2024-05-06T14:04:12.550 INFO:tasks.workunit.client.1.smithi174.stdout:8/601: symlink d4/de/d24/d5e/lc9 0 2024-05-06T14:04:12.550 INFO:tasks.workunit.client.1.smithi174.stdout:0/477: link d0/d4/f57 d0/d36/d3f/d7a/f9c 0 2024-05-06T14:04:12.550 INFO:tasks.workunit.client.1.smithi174.stdout:0/478: dread d0/d1a/d17/d2e/f3c [655360,102400] 0 2024-05-06T14:04:12.550 INFO:tasks.workunit.client.1.smithi174.stdout:8/602: mknod d4/de/d23/cca 0 2024-05-06T14:04:12.550 INFO:tasks.workunit.client.1.smithi174.stdout:8/603: symlink d4/de/d23/lcb 0 2024-05-06T14:04:12.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.587+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:04:12.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.587+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:04:12.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.587+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:04:12.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.587+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190008640 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:04:12.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.587+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 0x7f7190006620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:04:12.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.587+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:04:12.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.587+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0036f00 con 0x7f7190006240 2024-05-06T14:04:12.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.587+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0037040 con 0x7f71b0101dc0 2024-05-06T14:04:12.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.587+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 msgr2=0x7f7190006620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:12.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.587+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 0x7f7190006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:04:12.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.587+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:12.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.587+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:04:12.627 INFO:tasks.workunit.client.1.smithi174.stdout:7/446: rename d0/d1d/d41/d61/d19/d39/d46/l71 to d0/d1d/d41/d61/d19/d39/d46/l99 0 2024-05-06T14:04:12.628 INFO:tasks.workunit.client.1.smithi174.stdout:7/447: mknod d0/d1d/d41/d61/d19/d24/c9a 0 2024-05-06T14:04:12.628 INFO:tasks.workunit.client.1.smithi174.stdout:7/448: link d0/d1d/f2c d0/d1d/d41/d61/d19/f9b 0 2024-05-06T14:04:12.628 INFO:tasks.workunit.client.1.smithi174.stdout:7/449: mkdir d0/d1d/d9c 0 2024-05-06T14:04:12.628 INFO:tasks.workunit.client.1.smithi174.stdout:7/450: symlink d0/d1d/d41/d61/d19/d24/d47/d70/d67/l9d 0 2024-05-06T14:04:12.628 INFO:tasks.workunit.client.1.smithi174.stdout:7/451: mkdir d0/d1d/d41/d61/d19/d39/d9e 0 2024-05-06T14:04:12.628 INFO:tasks.workunit.client.1.smithi174.stdout:9/513: dwrite dc/df/f5a [262144,20480] 0 2024-05-06T14:04:12.628 INFO:tasks.workunit.client.1.smithi174.stdout:1/427: dwrite d11/d1f/d27/d32/f59 [1187840,36864] 0 2024-05-06T14:04:12.628 INFO:tasks.workunit.client.1.smithi174.stdout:1/428: readlink d11/d1f/l4f 0 2024-05-06T14:04:12.629 INFO:tasks.workunit.client.1.smithi174.stdout:1/429: unlink d11/d1f/d27/d32/c8e 0 2024-05-06T14:04:12.629 INFO:tasks.workunit.client.1.smithi174.stdout:1/430: dread d11/f22 [1216512,4096] 0 2024-05-06T14:04:12.660 INFO:tasks.workunit.client.1.smithi174.stdout:0/479: fsync d0/d36/f3b 0 2024-05-06T14:04:12.660 INFO:tasks.workunit.client.1.smithi174.stdout:8/604: fdatasync d4/de/d23/f78 0 2024-05-06T14:04:12.660 INFO:tasks.workunit.client.1.smithi174.stdout:0/480: chown d0/c94 105 1 2024-05-06T14:04:12.660 INFO:tasks.workunit.client.1.smithi174.stdout:0/481: stat d0/d3 0 2024-05-06T14:04:12.660 INFO:tasks.workunit.client.1.smithi174.stdout:7/452: dwrite d0/d1d/d41/d61/d19/d24/d14/d52/f92 [532480,69632] 0 2024-05-06T14:04:12.661 INFO:tasks.workunit.client.1.smithi174.stdout:7/453: write d0/d1d/d41/d61/d19/d24/d47/d70/d67/f86 [337621,69298] 0 2024-05-06T14:04:12.661 INFO:tasks.workunit.client.1.smithi174.stdout:7/454: chown d0/d1d/d41/d61/d19/d24/d47/d70/d67 47 1 2024-05-06T14:04:12.662 INFO:tasks.workunit.client.1.smithi174.stdout:1/431: dread d11/d41/f85 [196608,40960] 0 2024-05-06T14:04:12.663 INFO:tasks.workunit.client.1.smithi174.stdout:1/432: mknod d11/d1f/d27/d2d/d9c/ca5 0 2024-05-06T14:04:12.663 INFO:tasks.workunit.client.1.smithi174.stdout:0/482: dwrite d0/d36/d45/f89 [495616,126976] 0 2024-05-06T14:04:12.666 INFO:tasks.workunit.client.1.smithi174.stdout:1/433: creat d11/d1f/d27/d2d/fa6 x:0 0 0 2024-05-06T14:04:12.668 INFO:tasks.workunit.client.1.smithi174.stdout:1/434: dwrite fe [471040,90112] 0 2024-05-06T14:04:12.670 INFO:tasks.workunit.client.1.smithi174.stdout:8/605: dread d4/d53/f69 [507904,90112] 0 2024-05-06T14:04:12.675 INFO:tasks.workunit.client.1.smithi174.stdout:7/455: dread d0/d1d/d41/d61/d19/d24/f10 [2232320,36864] 0 2024-05-06T14:04:12.780 INFO:tasks.workunit.client.1.smithi174.stdout:7/456: rename d0/d1d/d41/d61/d19/d24/d14/d52/l12 to d0/d1d/d41/d61/d28/d59/l9f 0 2024-05-06T14:04:12.780 INFO:tasks.workunit.client.1.smithi174.stdout:7/457: creat d0/d1d/d41/d61/d19/d24/d6f/fa0 x:0 0 0 2024-05-06T14:04:12.780 INFO:tasks.workunit.client.1.smithi174.stdout:8/606: mkdir d4/d15/d20/d3e/d79/dcc 0 2024-05-06T14:04:12.780 INFO:tasks.workunit.client.1.smithi174.stdout:8/607: rename d4/de/c14 to d4/d15/d66/ccd 0 2024-05-06T14:04:12.780 INFO:tasks.workunit.client.1.smithi174.stdout:1/435: dwrite d11/f22 [131072,69632] 0 2024-05-06T14:04:12.781 INFO:tasks.workunit.client.1.smithi174.stdout:1/436: readlink d11/d1f/d55/l6d 0 2024-05-06T14:04:12.781 INFO:tasks.workunit.client.1.smithi174.stdout:1/437: creat d11/d1f/fa7 x:0 0 0 2024-05-06T14:04:12.781 INFO:tasks.workunit.client.1.smithi174.stdout:1/438: mknod d11/d1f/d27/d2d/d9c/ca8 0 2024-05-06T14:04:12.781 INFO:tasks.workunit.client.1.smithi174.stdout:1/439: read d11/d1f/d27/d32/f59 [223670,48664] 0 2024-05-06T14:04:12.781 INFO:tasks.workunit.client.1.smithi174.stdout:1/440: dread - d11/d1f/d27/d32/d84/f9a zero size 2024-05-06T14:04:12.781 INFO:tasks.workunit.client.1.smithi174.stdout:1/441: truncate d11/d67/f70 469798 0 2024-05-06T14:04:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.788+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 msgr2=0x7f7190006620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.788+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 0x7f7190006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:04:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.788+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:12.788+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:04:12.822 INFO:tasks.workunit.client.1.smithi174.stdout:8/608: fsync d4/d48/f5c 0 2024-05-06T14:04:12.822 INFO:tasks.workunit.client.1.smithi174.stdout:8/609: dread d4/de/d24/d5e/d85/d91/fae [712704,86016] 0 2024-05-06T14:04:12.822 INFO:tasks.workunit.client.1.smithi174.stdout:8/610: getdents d4/d15/d20/d3e/d79/dbf 0 2024-05-06T14:04:12.822 INFO:tasks.workunit.client.1.smithi174.stdout:7/458: dwrite d0/d1d/d41/d61/d19/d24/d47/d70/d83/f84 [483328,73728] 0 2024-05-06T14:04:12.825 INFO:tasks.workunit.client.1.smithi174.stdout:1/442: dwrite d11/d1f/d27/f2b [3026944,4096] 0 2024-05-06T14:04:12.825 INFO:tasks.workunit.client.1.smithi174.stdout:1/443: readlink d11/d1f/l48 0 2024-05-06T14:04:12.830 INFO:tasks.workunit.client.1.smithi174.stdout:1/444: mknod d11/d79/ca9 0 2024-05-06T14:04:12.830 INFO:tasks.workunit.client.1.smithi174.stdout:1/445: truncate d11/d67/d6c/f72 728428 0 2024-05-06T14:04:12.830 INFO:tasks.workunit.client.1.smithi174.stdout:1/446: dread - d11/d41/d4a/d5e/f6f zero size 2024-05-06T14:04:12.831 INFO:tasks.workunit.client.1.smithi174.stdout:8/611: dwrite d4/d48/f5c [2138112,16384] 0 2024-05-06T14:04:12.832 INFO:tasks.workunit.client.1.smithi174.stdout:7/459: dwrite d0/d1d/f77 [253952,114688] 0 2024-05-06T14:04:12.836 INFO:tasks.workunit.client.1.smithi174.stdout:1/447: dread d11/d1f/d27/f2b [3002368,126976] 0 2024-05-06T14:04:12.836 INFO:tasks.workunit.client.1.smithi174.stdout:1/448: stat d11/d1f/d27/d2d/f3a 0 2024-05-06T14:04:12.836 INFO:tasks.workunit.client.1.smithi174.stdout:1/449: stat d11/d1f/fa7 0 2024-05-06T14:04:12.836 INFO:tasks.workunit.client.1.smithi174.stdout:1/450: creat d11/d1f/d55/faa x:0 0 0 2024-05-06T14:04:12.838 INFO:tasks.workunit.client.1.smithi174.stdout:1/451: dwrite d11/d1f/d27/d2d/f52 [1794048,90112] 0 2024-05-06T14:04:12.844 INFO:tasks.workunit.client.1.smithi174.stdout:4/551: sync 2024-05-06T14:04:12.844 INFO:tasks.workunit.client.1.smithi174.stdout:6/601: sync 2024-05-06T14:04:12.844 INFO:tasks.workunit.client.1.smithi174.stdout:5/522: sync 2024-05-06T14:04:12.844 INFO:tasks.workunit.client.1.smithi174.stdout:2/467: sync 2024-05-06T14:04:12.845 INFO:tasks.workunit.client.1.smithi174.stdout:3/493: sync 2024-05-06T14:04:12.845 INFO:tasks.workunit.client.1.smithi174.stdout:6/602: rename d0/df/d3c/f75 to d0/d25/d52/d2c/d5f/daa/fc6 0 2024-05-06T14:04:12.845 INFO:tasks.workunit.client.1.smithi174.stdout:2/468: creat d0/d1/d2/d4/d18/f91 x:0 0 0 2024-05-06T14:04:12.845 INFO:tasks.workunit.client.1.smithi174.stdout:2/469: dread d0/d1/d2/d2a/f48 [593920,12288] 0 2024-05-06T14:04:12.845 INFO:tasks.workunit.client.1.smithi174.stdout:3/494: creat df/d10/d1b/d7e/fa1 x:0 0 0 2024-05-06T14:04:12.845 INFO:tasks.workunit.client.1.smithi174.stdout:3/495: chown df/d10/d1b 7 1 2024-05-06T14:04:12.845 INFO:tasks.workunit.client.1.smithi174.stdout:2/470: dread - d0/d1/d2/d4/d18/d2d/f6b zero size 2024-05-06T14:04:12.845 INFO:tasks.workunit.client.1.smithi174.stdout:3/496: chown df/d10/c2a 3 1 2024-05-06T14:04:12.845 INFO:tasks.workunit.client.1.smithi174.stdout:8/612: dread d4/de/d23/d41/d56/f9c [65536,77824] 0 2024-05-06T14:04:12.846 INFO:tasks.workunit.client.1.smithi174.stdout:1/452: symlink d11/d1f/lab 0 2024-05-06T14:04:12.846 INFO:tasks.workunit.client.1.smithi174.stdout:2/471: mkdir d0/d92 0 2024-05-06T14:04:12.846 INFO:tasks.workunit.client.1.smithi174.stdout:3/497: mkdir df/d10/da2 0 2024-05-06T14:04:12.846 INFO:tasks.workunit.client.1.smithi174.stdout:8/613: dread d4/d53/f69 [933888,57344] 0 2024-05-06T14:04:12.846 INFO:tasks.workunit.client.1.smithi174.stdout:1/453: chown d11/l1d 0 1 2024-05-06T14:04:12.846 INFO:tasks.workunit.client.1.smithi174.stdout:8/614: readlink d4/de/d23/l96 0 2024-05-06T14:04:12.846 INFO:tasks.workunit.client.1.smithi174.stdout:1/454: creat d11/d1f/d27/d32/d92/fac x:0 0 0 2024-05-06T14:04:12.847 INFO:tasks.workunit.client.1.smithi174.stdout:5/523: dwrite d1/d6/df/f79 [712704,106496] 0 2024-05-06T14:04:12.847 INFO:tasks.workunit.client.1.smithi174.stdout:5/524: creat d1/d6/df/d35/d81/d8d/fb3 x:0 0 0 2024-05-06T14:04:12.847 INFO:tasks.workunit.client.1.smithi174.stdout:5/525: rmdir d1/d6/df/d35/d81/d60/d99 0 2024-05-06T14:04:12.847 INFO:tasks.workunit.client.1.smithi174.stdout:4/552: dwrite d1/d9/d15/d98/f28 [2166784,40960] 0 2024-05-06T14:04:12.972 INFO:tasks.workunit.client.1.smithi174.stdout:8/615: dwrite d4/de/d23/f25 [2600960,53248] 0 2024-05-06T14:04:12.975 INFO:tasks.workunit.client.1.smithi174.stdout:5/526: dwrite d1/d6/df/d35/d81/d60/db0/fd [1667072,8192] 0 2024-05-06T14:04:12.975 INFO:tasks.workunit.client.1.smithi174.stdout:5/527: mknod d1/d6/df/d35/d8b/cb4 0 2024-05-06T14:04:12.975 INFO:tasks.workunit.client.1.smithi174.stdout:5/528: unlink d1/d6/df/d35/d81/d60/db0/de/f57 0 2024-05-06T14:04:12.975 INFO:tasks.workunit.client.1.smithi174.stdout:5/529: chown d1/d6/d7/l78 7262 1 2024-05-06T14:04:12.976 INFO:tasks.workunit.client.1.smithi174.stdout:5/530: chown d1/l19 844923 1 2024-05-06T14:04:12.976 INFO:tasks.workunit.client.1.smithi174.stdout:5/531: creat d1/d6/df/d35/d8b/d9f/fb5 x:0 0 0 2024-05-06T14:04:12.976 INFO:tasks.workunit.client.1.smithi174.stdout:5/532: mknod d1/d6/df/d35/d81/d60/d82/cb6 0 2024-05-06T14:04:12.976 INFO:tasks.workunit.client.1.smithi174.stdout:4/553: dwrite d1/d9/f22 [413696,90112] 0 2024-05-06T14:04:12.976 INFO:tasks.workunit.client.1.smithi174.stdout:2/472: dwrite d0/d1/f5 [253952,32768] 0 2024-05-06T14:04:12.976 INFO:tasks.workunit.client.1.smithi174.stdout:2/473: mkdir d0/d24/d77/d93 0 2024-05-06T14:04:12.976 INFO:tasks.workunit.client.1.smithi174.stdout:2/474: creat d0/d1/f94 x:0 0 0 2024-05-06T14:04:12.976 INFO:tasks.workunit.client.1.smithi174.stdout:2/475: rename d0/d1/d2/d4/d6/f26 to d0/d24/d77/d93/f95 0 2024-05-06T14:04:12.977 INFO:tasks.workunit.client.1.smithi174.stdout:2/476: write d0/d24/f65 [2015013,68899] 0 2024-05-06T14:04:12.977 INFO:tasks.workunit.client.1.smithi174.stdout:2/477: write d0/d1/d2/d4/d6/f88 [89742,43586] 0 2024-05-06T14:04:12.977 INFO:tasks.workunit.client.1.smithi174.stdout:2/478: dread - d0/da/d3f/d67/f80 zero size 2024-05-06T14:04:12.977 INFO:tasks.workunit.client.1.smithi174.stdout:2/479: creat d0/d16/f96 x:0 0 0 2024-05-06T14:04:12.977 INFO:tasks.workunit.client.1.smithi174.stdout:2/480: read - d0/d1/d2/d2a/f70 zero size 2024-05-06T14:04:12.977 INFO:tasks.workunit.client.1.smithi174.stdout:2/481: read d0/d1/d2/d4/d18/d2d/d32/f53 [429911,8233] 0 2024-05-06T14:04:12.978 INFO:tasks.workunit.client.1.smithi174.stdout:3/498: dread df/f44 [299008,77824] 0 2024-05-06T14:04:12.978 INFO:tasks.workunit.client.1.smithi174.stdout:3/499: rename df/f92 to df/d2d/d84/fa3 0 2024-05-06T14:04:13.023 INFO:tasks.workunit.client.1.smithi174.stdout:8/616: fsync d4/d15/d64/f74 0 2024-05-06T14:04:13.023 INFO:tasks.workunit.client.1.smithi174.stdout:8/617: dread - d4/de/d23/d41/d4e/f86 zero size 2024-05-06T14:04:13.023 INFO:tasks.workunit.client.1.smithi174.stdout:8/618: mkdir d4/de/d23/d41/dce 0 2024-05-06T14:04:13.023 INFO:tasks.workunit.client.1.smithi174.stdout:8/619: write d4/de/d23/d41/d56/f71 [823542,3048] 0 2024-05-06T14:04:13.024 INFO:tasks.workunit.client.1.smithi174.stdout:5/533: fdatasync d1/d6/f54 0 2024-05-06T14:04:13.024 INFO:tasks.workunit.client.1.smithi174.stdout:4/554: fsync d1/d1f/d27/d3e/f75 0 2024-05-06T14:04:13.100 INFO:tasks.workunit.client.1.smithi174.stdout:1/455: fsync fe 0 2024-05-06T14:04:13.100 INFO:tasks.workunit.client.1.smithi174.stdout:1/456: chown d11/d1f/d27/d2d/c8d 2 1 2024-05-06T14:04:13.100 INFO:tasks.workunit.client.1.smithi174.stdout:1/457: readlink d11/d1f/d27/d32/l54 0 2024-05-06T14:04:13.100 INFO:tasks.workunit.client.1.smithi174.stdout:5/534: dwrite d1/d6/df/d35/d81/d60/db0/fac [311296,40960] 0 2024-05-06T14:04:13.102 INFO:tasks.workunit.client.1.smithi174.stdout:3/500: dwrite df/d10/f1c [1581056,24576] 0 2024-05-06T14:04:13.102 INFO:tasks.workunit.client.1.smithi174.stdout:8/620: rename d4/f49 to d4/d15/d20/d3e/d79/fcf 0 2024-05-06T14:04:13.102 INFO:tasks.workunit.client.1.smithi174.stdout:2/482: dwrite d0/d1/d2/d4/f6c [659456,81920] 0 2024-05-06T14:04:13.102 INFO:tasks.workunit.client.1.smithi174.stdout:8/621: truncate d4/de/d24/f45 943794 0 2024-05-06T14:04:13.103 INFO:tasks.workunit.client.1.smithi174.stdout:2/483: getdents d0/d1/d2/d1b/d90 0 2024-05-06T14:04:13.103 INFO:tasks.workunit.client.1.smithi174.stdout:3/501: write df/d10/d1b/d7e/f75 [358424,19262] 0 2024-05-06T14:04:13.103 INFO:tasks.workunit.client.1.smithi174.stdout:8/622: rename d4/de/d23/d41/d56/f7e to d4/de/d24/d5e/d85/fd0 0 2024-05-06T14:04:13.103 INFO:tasks.workunit.client.1.smithi174.stdout:8/623: creat d4/de/d24/d5e/d85/fd1 x:0 0 0 2024-05-06T14:04:13.103 INFO:tasks.workunit.client.1.smithi174.stdout:1/458: dwrite d11/d79/f87 [368640,49152] 0 2024-05-06T14:04:13.103 INFO:tasks.workunit.client.1.smithi174.stdout:1/459: dread - d11/d1f/d27/f6a zero size 2024-05-06T14:04:13.103 INFO:tasks.workunit.client.1.smithi174.stdout:1/460: dread d11/d1f/d27/f45 [200704,12288] 0 2024-05-06T14:04:13.103 INFO:tasks.workunit.client.1.smithi174.stdout:1/461: read - d11/d1f/d27/d32/d84/f9a zero size 2024-05-06T14:04:13.103 INFO:tasks.workunit.client.1.smithi174.stdout:1/462: chown d11/d1f/l48 8 1 2024-05-06T14:04:13.104 INFO:tasks.workunit.client.1.smithi174.stdout:1/463: rmdir d11/d57/d77 39 2024-05-06T14:04:13.104 INFO:tasks.workunit.client.1.smithi174.stdout:1/464: readlink d11/l1d 0 2024-05-06T14:04:13.104 INFO:tasks.workunit.client.1.smithi174.stdout:1/465: chown d11/d1f/d27/f5d 1 1 2024-05-06T14:04:13.104 INFO:tasks.workunit.client.1.smithi174.stdout:1/466: creat d11/d67/fad x:0 0 0 2024-05-06T14:04:13.104 INFO:tasks.workunit.client.1.smithi174.stdout:1/467: chown d11/d1f/d27/f5d 259806 1 2024-05-06T14:04:13.104 INFO:tasks.workunit.client.1.smithi174.stdout:1/468: read - d11/f24 zero size 2024-05-06T14:04:13.104 INFO:tasks.workunit.client.1.smithi174.stdout:1/469: write d11/d1f/d27/d2d/f3a [781391,15424] 0 2024-05-06T14:04:13.122 INFO:tasks.workunit.client.1.smithi174.stdout:4/555: fsync d1/d9/d15/d92/fad 0 2024-05-06T14:04:13.122 INFO:tasks.workunit.client.1.smithi174.stdout:4/556: creat d1/d1f/d89/fcd x:0 0 0 2024-05-06T14:04:13.125 INFO:tasks.workunit.client.1.smithi174.stdout:9/514: sync 2024-05-06T14:04:13.126 INFO:tasks.workunit.client.1.smithi174.stdout:2/484: unlink d0/f3e 0 2024-05-06T14:04:13.126 INFO:tasks.workunit.client.1.smithi174.stdout:2/485: mkdir d0/d1/d2/d4/d18/d97 0 2024-05-06T14:04:13.126 INFO:tasks.workunit.client.1.smithi174.stdout:2/486: rename d0/db/d15/f4a to d0/d24/f98 0 2024-05-06T14:04:13.126 INFO:tasks.workunit.client.1.smithi174.stdout:2/487: readlink d0/d1/d2/d4/l39 0 2024-05-06T14:04:13.126 INFO:tasks.workunit.client.1.smithi174.stdout:2/488: chown d0/d1/d2/d4/d6 3351 1 2024-05-06T14:04:13.126 INFO:tasks.workunit.client.1.smithi174.stdout:4/557: dwrite d1/d9/d15/d92/fad [921600,53248] 0 2024-05-06T14:04:13.126 INFO:tasks.workunit.client.1.smithi174.stdout:4/558: unlink d1/d1f/d27/f3b 0 2024-05-06T14:04:13.126 INFO:tasks.workunit.client.1.smithi174.stdout:2/489: write d0/d1/d2/d4/f6c [1126045,56432] 0 2024-05-06T14:04:13.127 INFO:tasks.workunit.client.1.smithi174.stdout:2/490: rmdir d0/d24 39 2024-05-06T14:04:13.127 INFO:tasks.workunit.client.1.smithi174.stdout:4/559: symlink d1/d1f/d89/lce 0 2024-05-06T14:04:13.127 INFO:tasks.workunit.client.1.smithi174.stdout:5/535: dwrite d1/d6/df/d35/d81/d60/db0/f3c [864256,102400] 0 2024-05-06T14:04:13.127 INFO:tasks.workunit.client.1.smithi174.stdout:5/536: dread - d1/d6/d7/f2e zero size 2024-05-06T14:04:13.127 INFO:tasks.workunit.client.1.smithi174.stdout:1/470: dwrite d11/d1f/d27/d32/f6b [983040,114688] 0 2024-05-06T14:04:13.176 INFO:tasks.workunit.client.1.smithi174.stdout:8/624: fsync d4/d53/f76 0 2024-05-06T14:04:13.176 INFO:tasks.workunit.client.1.smithi174.stdout:8/625: chown d4/de/d23/d3c/fbb 65185 1 2024-05-06T14:04:13.177 INFO:tasks.workunit.client.1.smithi174.stdout:9/515: dread dc/de/f68 [110592,86016] 0 2024-05-06T14:04:13.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:13.189+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 msgr2=0x7f7190006620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:13.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:13.189+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 0x7f7190006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:04:13.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:13.189+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:13.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:13.189+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:04:13.196 INFO:tasks.workunit.client.1.smithi174.stdout:1/471: dread d11/d57/f74 [159744,8192] 0 2024-05-06T14:04:13.241 INFO:tasks.workunit.client.1.smithi174.stdout:5/537: fdatasync d1/d6/d7/d36/d53/d59/d61/f7e 0 2024-05-06T14:04:13.242 INFO:tasks.workunit.client.1.smithi174.stdout:5/538: dread d1/d6/d7/f95 [1146880,98304] 0 2024-05-06T14:04:13.242 INFO:tasks.workunit.client.1.smithi174.stdout:8/626: fdatasync d4/d15/d20/f5f 0 2024-05-06T14:04:13.245 INFO:tasks.workunit.client.1.smithi174.stdout:5/539: write d1/d6/df/d35/d81/d60/db0/fd [63702,121072] 0 2024-05-06T14:04:13.245 INFO:tasks.workunit.client.1.smithi174.stdout:4/560: write d1/d9/d15/f47 [175760,86569] 0 2024-05-06T14:04:13.246 INFO:tasks.workunit.client.1.smithi174.stdout:4/561: chown d1/l8 96693 1 2024-05-06T14:04:13.246 INFO:tasks.workunit.client.1.smithi174.stdout:4/562: readlink d1/l8 0 2024-05-06T14:04:13.248 INFO:tasks.workunit.client.1.smithi174.stdout:4/563: read d1/f31 [217157,109680] 0 2024-05-06T14:04:13.248 INFO:tasks.workunit.client.1.smithi174.stdout:2/491: dwrite d0/d1/f35 [139264,57344] 0 2024-05-06T14:04:13.249 INFO:tasks.workunit.client.1.smithi174.stdout:8/627: creat d4/d15/fd2 x:0 0 0 2024-05-06T14:04:13.249 INFO:tasks.workunit.client.1.smithi174.stdout:5/540: truncate d1/d6/d7/d36/d53/f74 385547 0 2024-05-06T14:04:13.249 INFO:tasks.workunit.client.1.smithi174.stdout:8/628: write d4/de/d24/d5e/d85/d91/fae [2247069,816] 0 2024-05-06T14:04:13.249 INFO:tasks.workunit.client.1.smithi174.stdout:2/492: read d0/da/f1d [787736,91476] 0 2024-05-06T14:04:13.249 INFO:tasks.workunit.client.1.smithi174.stdout:5/541: write d1/d6/d7/f2e [355456,16152] 0 2024-05-06T14:04:13.249 INFO:tasks.workunit.client.1.smithi174.stdout:8/629: mknod d4/d15/d20/d3e/d79/dcc/cd3 0 2024-05-06T14:04:13.249 INFO:tasks.workunit.client.1.smithi174.stdout:2/493: dread d0/d24/f65 [221184,102400] 0 2024-05-06T14:04:13.250 INFO:tasks.workunit.client.1.smithi174.stdout:5/542: creat d1/d6/df/d35/d81/d8d/fb7 x:0 0 0 2024-05-06T14:04:13.250 INFO:tasks.workunit.client.1.smithi174.stdout:8/630: write d4/de/f13 [2996334,59140] 0 2024-05-06T14:04:13.250 INFO:tasks.workunit.client.1.smithi174.stdout:2/494: write d0/d1/f35 [820750,45866] 0 2024-05-06T14:04:13.250 INFO:tasks.workunit.client.1.smithi174.stdout:8/631: dread d4/d15/d64/f84 [147456,61440] 0 2024-05-06T14:04:13.250 INFO:tasks.workunit.client.1.smithi174.stdout:2/495: creat d0/d92/f99 x:0 0 0 2024-05-06T14:04:13.250 INFO:tasks.workunit.client.1.smithi174.stdout:1/472: dwrite d11/d1f/d27/d2d/f3a [1044480,90112] 0 2024-05-06T14:04:13.251 INFO:tasks.workunit.client.1.smithi174.stdout:1/473: stat d11/d41/d4a/d5e/f6f 0 2024-05-06T14:04:13.251 INFO:tasks.workunit.client.1.smithi174.stdout:1/474: read - d11/d41/d51/f75 zero size 2024-05-06T14:04:13.251 INFO:tasks.workunit.client.1.smithi174.stdout:1/475: symlink d11/d1f/d27/lae 0 2024-05-06T14:04:13.251 INFO:tasks.workunit.client.1.smithi174.stdout:9/516: dwrite dc/d1c/f41 [540672,49152] 0 2024-05-06T14:04:13.251 INFO:tasks.workunit.client.1.smithi174.stdout:1/476: dread d11/d67/f70 [339968,61440] 0 2024-05-06T14:04:13.251 INFO:tasks.workunit.client.1.smithi174.stdout:1/477: rename d11/d79 to d11/d57/d98/daf 0 2024-05-06T14:04:13.251 INFO:tasks.workunit.client.1.smithi174.stdout:9/517: dread dc/d14/f97 [126976,65536] 0 2024-05-06T14:04:13.252 INFO:tasks.workunit.client.1.smithi174.stdout:1/478: rename d11/d41/d51 to d11/d1f/d27/d32/d84/d8c/d94/db0 0 2024-05-06T14:04:13.252 INFO:tasks.workunit.client.1.smithi174.stdout:1/479: read d11/d1f/d27/d32/f71 [346536,69809] 0 2024-05-06T14:04:13.252 INFO:tasks.workunit.client.1.smithi174.stdout:1/480: stat d11/d41/d4a/d5e/c86 0 2024-05-06T14:04:13.252 INFO:tasks.workunit.client.1.smithi174.stdout:1/481: symlink d11/d67/lb1 0 2024-05-06T14:04:13.324 INFO:tasks.workunit.client.1.smithi174.stdout:4/564: fsync d1/d9/d15/d98/d56/f78 0 2024-05-06T14:04:13.325 INFO:tasks.workunit.client.1.smithi174.stdout:4/565: symlink d1/d9/d15/d74/d86/dc2/lcf 0 2024-05-06T14:04:13.325 INFO:tasks.workunit.client.1.smithi174.stdout:4/566: symlink d1/d1f/d89/ld0 0 2024-05-06T14:04:13.325 INFO:tasks.workunit.client.1.smithi174.stdout:5/543: fsync d1/d6/df/d35/d81/d60/db0/de/fa6 0 2024-05-06T14:04:13.325 INFO:tasks.workunit.client.1.smithi174.stdout:5/544: chown d1/d6/df/d35/d81/d8d/l9b 831 1 2024-05-06T14:04:13.325 INFO:tasks.workunit.client.1.smithi174.stdout:5/545: dread - d1/d6/df/d35/d81/d8d/fb3 zero size 2024-05-06T14:04:13.325 INFO:tasks.workunit.client.1.smithi174.stdout:5/546: dread d1/d6/df/d35/d81/d60/db0/f3c [77824,126976] 0 2024-05-06T14:04:13.325 INFO:tasks.workunit.client.1.smithi174.stdout:5/547: rename d1/d6/df/d35/d81/d60/db0/d41/fab to d1/d6/d7/da1/fb8 0 2024-05-06T14:04:13.325 INFO:tasks.workunit.client.1.smithi174.stdout:5/548: dread - d1/d6/d7/da1/fad zero size 2024-05-06T14:04:13.326 INFO:tasks.workunit.client.1.smithi174.stdout:5/549: symlink d1/d6/df/d35/d81/d60/lb9 0 2024-05-06T14:04:13.326 INFO:tasks.workunit.client.1.smithi174.stdout:5/550: chown d1/d6/df/f79 233799 1 2024-05-06T14:04:13.326 INFO:tasks.workunit.client.1.smithi174.stdout:5/551: symlink d1/d6/d7/d3e/d4c/lba 0 2024-05-06T14:04:13.326 INFO:tasks.workunit.client.1.smithi174.stdout:5/552: rmdir d1/d6/d90 0 2024-05-06T14:04:13.326 INFO:tasks.workunit.client.1.smithi174.stdout:4/567: dread d1/d9/d15/d74/d86/fc4 [106496,86016] 0 2024-05-06T14:04:13.326 INFO:tasks.workunit.client.1.smithi174.stdout:4/568: write d1/d9/f18 [1419287,3963] 0 2024-05-06T14:04:13.326 INFO:tasks.workunit.client.1.smithi174.stdout:4/569: dread - d1/fac zero size 2024-05-06T14:04:13.326 INFO:tasks.workunit.client.1.smithi174.stdout:4/570: chown d1/d9/d15/d98/fb3 500753 1 2024-05-06T14:04:13.327 INFO:tasks.workunit.client.1.smithi174.stdout:4/571: dread d1/d9/f23 [585728,8192] 0 2024-05-06T14:04:13.327 INFO:tasks.workunit.client.1.smithi174.stdout:4/572: mknod d1/d1f/d27/d84/cd1 0 2024-05-06T14:04:13.327 INFO:tasks.workunit.client.1.smithi174.stdout:4/573: stat d1/d48/d5a/d61/d68/l7e 0 2024-05-06T14:04:13.344 INFO:tasks.workunit.client.1.smithi174.stdout:5/553: fdatasync d1/d6/df/d35/d81/d60/db0/de/f26 0 2024-05-06T14:04:13.344 INFO:tasks.workunit.client.1.smithi174.stdout:9/518: fsync dc/d27/d63/fa3 0 2024-05-06T14:04:13.345 INFO:tasks.workunit.client.1.smithi174.stdout:1/482: fsync d11/d1f/d55/faa 0 2024-05-06T14:04:13.345 INFO:tasks.workunit.client.1.smithi174.stdout:5/554: creat d1/d6/df/d35/fbb x:0 0 0 2024-05-06T14:04:13.345 INFO:tasks.workunit.client.1.smithi174.stdout:5/555: creat d1/d6/d7/d3e/fbc x:0 0 0 2024-05-06T14:04:13.345 INFO:tasks.workunit.client.1.smithi174.stdout:5/556: dread - d1/d6/df/d35/d81/f4b zero size 2024-05-06T14:04:13.345 INFO:tasks.workunit.client.1.smithi174.stdout:5/557: dread d1/d6/d7/d36/f2c [4059136,12288] 0 2024-05-06T14:04:13.347 INFO:tasks.workunit.client.1.smithi174.stdout:1/483: dread d11/f20 [163840,16384] 0 2024-05-06T14:04:13.347 INFO:tasks.workunit.client.1.smithi174.stdout:1/484: mkdir d11/d57/d98/daf/db2 0 2024-05-06T14:04:13.347 INFO:tasks.workunit.client.1.smithi174.stdout:1/485: getdents d11/d1f/d27/d2d 0 2024-05-06T14:04:13.347 INFO:tasks.workunit.client.1.smithi174.stdout:5/558: mkdir d1/d6/df/d35/d81/d60/db0/de/dbd 0 2024-05-06T14:04:13.406 INFO:tasks.workunit.client.1.smithi174.stdout:1/486: fdatasync d11/d1f/d27/d32/f6b 0 2024-05-06T14:04:13.407 INFO:tasks.workunit.client.1.smithi174.stdout:1/487: write d11/d1f/d27/d32/f50 [961024,113938] 0 2024-05-06T14:04:13.413 INFO:tasks.workunit.client.1.smithi174.stdout:1/488: symlink d11/d1f/d27/d32/d84/d8c/d94/db0/lb3 0 2024-05-06T14:04:13.413 INFO:tasks.workunit.client.1.smithi174.stdout:4/574: dwrite d1/d48/f58 [1642496,77824] 0 2024-05-06T14:04:13.413 INFO:tasks.workunit.client.1.smithi174.stdout:4/575: truncate d1/f5 199199 0 2024-05-06T14:04:13.413 INFO:tasks.workunit.client.1.smithi174.stdout:4/576: chown d1/d9/d15/f47 1 1 2024-05-06T14:04:13.414 INFO:tasks.workunit.client.1.smithi174.stdout:4/577: truncate d1/d1f/f54 1066484 0 2024-05-06T14:04:13.414 INFO:tasks.workunit.client.1.smithi174.stdout:4/578: creat d1/d1f/d27/d84/fd2 x:0 0 0 2024-05-06T14:04:13.414 INFO:tasks.workunit.client.1.smithi174.stdout:5/559: dwrite d1/d6/df/d35/d81/d60/db0/f25 [2580480,45056] 0 2024-05-06T14:04:13.414 INFO:tasks.workunit.client.1.smithi174.stdout:5/560: rename d1/f45 to d1/d6/d7/d3e/d4c/fbe 0 2024-05-06T14:04:13.414 INFO:tasks.workunit.client.1.smithi174.stdout:5/561: mknod d1/d6/df/d35/d81/d60/cbf 0 2024-05-06T14:04:13.414 INFO:tasks.workunit.client.1.smithi174.stdout:5/562: readlink d1/d6/df/d35/d81/d60/db0/de/l4f 0 2024-05-06T14:04:13.414 INFO:tasks.workunit.client.1.smithi174.stdout:5/563: creat d1/d6/df/d35/d81/fc0 x:0 0 0 2024-05-06T14:04:13.414 INFO:tasks.workunit.client.1.smithi174.stdout:5/564: getdents d1/d6/d7/d36/d53/d59/d61 0 2024-05-06T14:04:13.415 INFO:tasks.workunit.client.1.smithi174.stdout:5/565: mknod d1/d6/d7/da1/cc1 0 2024-05-06T14:04:13.415 INFO:tasks.workunit.client.1.smithi174.stdout:5/566: write d1/d6/d7/f44 [2024311,43305] 0 2024-05-06T14:04:13.415 INFO:tasks.workunit.client.1.smithi174.stdout:5/567: rmdir d1/d6/d7/d36/d53 39 2024-05-06T14:04:13.415 INFO:tasks.workunit.client.1.smithi174.stdout:5/568: truncate d1/d6/df/d35/d81/d1e/f8c 2065594 0 2024-05-06T14:04:13.415 INFO:tasks.workunit.client.1.smithi174.stdout:5/569: rmdir d1/d6/df 39 2024-05-06T14:04:13.415 INFO:tasks.workunit.client.1.smithi174.stdout:5/570: chown d1/d6 0 1 2024-05-06T14:04:13.415 INFO:tasks.workunit.client.1.smithi174.stdout:5/571: readlink d1/d6/df/d35/d81/d60/lb9 0 2024-05-06T14:04:13.415 INFO:tasks.workunit.client.1.smithi174.stdout:5/572: dread - d1/d6/d7/d36/f47 zero size 2024-05-06T14:04:13.469 INFO:tasks.workunit.client.1.smithi174.stdout:1/489: fdatasync d11/d1f/d27/d2d/f8b 0 2024-05-06T14:04:13.472 INFO:tasks.workunit.client.1.smithi174.stdout:4/579: dwrite d1/d9/d15/d74/fb7 [212992,49152] 0 2024-05-06T14:04:13.472 INFO:tasks.workunit.client.1.smithi174.stdout:4/580: mknod d1/d9/d15/d41/cd3 0 2024-05-06T14:04:13.473 INFO:tasks.workunit.client.1.smithi174.stdout:4/581: dread d1/d9/d15/d74/d86/fc4 [24576,20480] 0 2024-05-06T14:04:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:13.496+0000 7f71b4865700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3135616195 2024-05-06T14:04:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:13.496+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-05-06T14:04:13.519 INFO:tasks.workunit.client.1.smithi174.stdout:2/496: fsync d0/db/d15/f30 0 2024-05-06T14:04:13.519 INFO:tasks.workunit.client.1.smithi174.stdout:5/573: fsync d1/d6/df/d35/d81/f1d 0 2024-05-06T14:04:13.521 INFO:tasks.workunit.client.1.smithi174.stdout:4/582: symlink d1/d1f/ld4 0 2024-05-06T14:04:13.521 INFO:tasks.workunit.client.1.smithi174.stdout:5/574: creat d1/d6/d7/da1/d9a/fc2 x:0 0 0 2024-05-06T14:04:13.521 INFO:tasks.workunit.client.1.smithi174.stdout:2/497: read d0/db/f7d [828383,24200] 0 2024-05-06T14:04:13.522 INFO:tasks.workunit.client.1.smithi174.stdout:5/575: chown d1/d6/d7/d36/d53/d59 10788900 1 2024-05-06T14:04:13.522 INFO:tasks.workunit.client.1.smithi174.stdout:4/583: write d1/d9/d15/f6d [161291,104363] 0 2024-05-06T14:04:13.599 INFO:tasks.workunit.client.1.smithi174.stdout:4/584: fsync d1/d48/d5a/d61/d68/f7d 0 2024-05-06T14:04:13.599 INFO:tasks.workunit.client.1.smithi174.stdout:4/585: write d1/d9/d15/d92/fad [1876574,89448] 0 2024-05-06T14:04:13.602 INFO:tasks.workunit.client.1.smithi174.stdout:4/586: rename d1/l11 to d1/d1f/ld5 0 2024-05-06T14:04:13.603 INFO:tasks.workunit.client.1.smithi174.stdout:4/587: chown d1 0 1 2024-05-06T14:04:13.603 INFO:tasks.workunit.client.1.smithi174.stdout:5/576: mkdir d1/d6/d7/d36/d53/d59/d61/d69/dc3 0 2024-05-06T14:04:13.603 INFO:tasks.workunit.client.1.smithi174.stdout:2/498: mkdir d0/d24/d77/d93/d9a 0 2024-05-06T14:04:13.603 INFO:tasks.workunit.client.1.smithi174.stdout:2/499: chown d0/d1/d2/d4/f6c 14124 1 2024-05-06T14:04:13.603 INFO:tasks.workunit.client.1.smithi174.stdout:4/588: rename d1/d1f/d27/d3e to d1/d1f/dd6 0 2024-05-06T14:04:13.603 INFO:tasks.workunit.client.1.smithi174.stdout:2/500: truncate d0/d1/d2/d4/d18/f91 522474 0 2024-05-06T14:04:13.603 INFO:tasks.workunit.client.1.smithi174.stdout:4/589: dread d1/d1f/dd6/d6e/f55 [462848,61440] 0 2024-05-06T14:04:13.603 INFO:tasks.workunit.client.1.smithi174.stdout:4/590: link d1/d9/d15/f6d d1/d1f/dd6/d6e/d50/db0/fd7 0 2024-05-06T14:04:13.604 INFO:tasks.workunit.client.1.smithi174.stdout:4/591: chown d1/d9/d15/d98/d56/c9f 27241846 1 2024-05-06T14:04:13.604 INFO:tasks.workunit.client.1.smithi174.stdout:4/592: stat d1/d9/d15/d74/d86/dc2 0 2024-05-06T14:04:13.604 INFO:tasks.workunit.client.1.smithi174.stdout:5/577: truncate d1/d6/d7/d3e/f77 3481923 0 2024-05-06T14:04:13.604 INFO:tasks.workunit.client.1.smithi174.stdout:4/593: symlink d1/d1f/dd6/d6e/ld8 0 2024-05-06T14:04:13.604 INFO:tasks.workunit.client.1.smithi174.stdout:4/594: readlink d1/d9/lbc 0 2024-05-06T14:04:13.605 INFO:tasks.workunit.client.1.smithi174.stdout:5/578: mknod d1/d6/d7/d36/d53/cc4 0 2024-05-06T14:04:13.605 INFO:tasks.workunit.client.1.smithi174.stdout:5/579: chown d1/d6/df/d35/d81/d1e/c6a 98148951 1 2024-05-06T14:04:13.606 INFO:tasks.workunit.client.1.smithi174.stdout:5/580: truncate d1/d6/df/d35/d81/d60/db0/de/f3f 1630053 0 2024-05-06T14:04:13.606 INFO:tasks.workunit.client.1.smithi174.stdout:5/581: dread d1/d6/fa2 [696320,4096] 0 2024-05-06T14:04:13.606 INFO:tasks.workunit.client.1.smithi174.stdout:5/582: mknod d1/d6/d7/d36/d53/d59/cc5 0 2024-05-06T14:04:13.606 INFO:tasks.workunit.client.1.smithi174.stdout:5/583: creat d1/d6/df/fc6 x:0 0 0 2024-05-06T14:04:13.606 INFO:tasks.workunit.client.1.smithi174.stdout:2/501: dwrite d0/d1/d2/d4/d6/f7 [94208,94208] 0 2024-05-06T14:04:13.606 INFO:tasks.workunit.client.1.smithi174.stdout:4/595: dwrite d1/d9/d15/d98/f51 [540672,57344] 0 2024-05-06T14:04:13.606 INFO:tasks.workunit.client.1.smithi174.stdout:4/596: rename d1/d48/db4 to d1/d9/d15/d35/dd9 0 2024-05-06T14:04:13.606 INFO:tasks.workunit.client.1.smithi174.stdout:4/597: dread - d1/d9/d15/d41/f83 zero size 2024-05-06T14:04:13.670 INFO:tasks.workunit.client.1.smithi174.stdout:7/460: sync 2024-05-06T14:04:13.671 INFO:tasks.workunit.client.1.smithi174.stdout:6/603: sync 2024-05-06T14:04:13.671 INFO:tasks.workunit.client.1.smithi174.stdout:0/483: sync 2024-05-06T14:04:13.671 INFO:tasks.workunit.client.1.smithi174.stdout:6/604: creat d0/df/fc7 x:0 0 0 2024-05-06T14:04:13.671 INFO:tasks.workunit.client.1.smithi174.stdout:6/605: creat d0/df/d45/da9/db3/fc8 x:0 0 0 2024-05-06T14:04:13.672 INFO:tasks.workunit.client.1.smithi174.stdout:0/484: write d0/d36/f9b [587869,49633] 0 2024-05-06T14:04:13.672 INFO:tasks.workunit.client.1.smithi174.stdout:0/485: chown d0 356965957 1 2024-05-06T14:04:13.672 INFO:tasks.workunit.client.1.smithi174.stdout:0/486: readlink d0/d3/d5d/l42 0 2024-05-06T14:04:13.672 INFO:tasks.workunit.client.1.smithi174.stdout:2/502: dwrite d0/d1/d2/d4/d6/fe [643072,65536] 0 2024-05-06T14:04:13.672 INFO:tasks.workunit.client.1.smithi174.stdout:0/487: getdents d0/d3/d5d 0 2024-05-06T14:04:13.672 INFO:tasks.workunit.client.1.smithi174.stdout:6/606: write d0/df/f5e [1561090,37628] 0 2024-05-06T14:04:13.672 INFO:tasks.workunit.client.1.smithi174.stdout:6/607: truncate d0/f73 1645881 0 2024-05-06T14:04:13.672 INFO:tasks.workunit.client.1.smithi174.stdout:0/488: mknod d0/d3/d5d/d38/c9d 0 2024-05-06T14:04:13.673 INFO:tasks.workunit.client.1.smithi174.stdout:6/608: rename d0/d25/d52/d4c/dbd to d0/d25/d52/d2c/d5f/dc9 0 2024-05-06T14:04:13.673 INFO:tasks.workunit.client.1.smithi174.stdout:6/609: chown d0/d25/d52/laf 1004896 1 2024-05-06T14:04:13.673 INFO:tasks.workunit.client.1.smithi174.stdout:2/503: write d0/d1/d2/d2a/f48 [391790,59378] 0 2024-05-06T14:04:13.673 INFO:tasks.workunit.client.1.smithi174.stdout:6/610: symlink d0/df/d45/da9/lca 0 2024-05-06T14:04:13.673 INFO:tasks.workunit.client.1.smithi174.stdout:6/611: write d0/d25/d52/d4c/fab [181189,76558] 0 2024-05-06T14:04:13.673 INFO:tasks.workunit.client.1.smithi174.stdout:6/612: mknod d0/d25/ccb 0 2024-05-06T14:04:13.673 INFO:tasks.workunit.client.1.smithi174.stdout:6/613: chown d0/df/l1e 48974206 1 2024-05-06T14:04:13.673 INFO:tasks.workunit.client.1.smithi174.stdout:4/598: dwrite d1/d48/d5a/d5f/f8a [389120,126976] 0 2024-05-06T14:04:13.674 INFO:tasks.workunit.client.1.smithi174.stdout:4/599: dread d1/f19 [143360,90112] 0 2024-05-06T14:04:13.674 INFO:tasks.workunit.client.1.smithi174.stdout:4/600: creat d1/d48/d5a/d61/fda x:0 0 0 2024-05-06T14:04:13.674 INFO:tasks.workunit.client.1.smithi174.stdout:4/601: symlink d1/d1f/ldb 0 2024-05-06T14:04:13.721 INFO:tasks.workunit.client.1.smithi174.stdout:7/461: fdatasync d0/d1d/d41/d61/d19/f7d 0 2024-05-06T14:04:13.721 INFO:tasks.workunit.client.1.smithi174.stdout:4/602: fdatasync d1/d1f/dd6/d6e/fb5 0 2024-05-06T14:04:13.721 INFO:tasks.workunit.client.1.smithi174.stdout:6/614: fdatasync d0/fc4 0 2024-05-06T14:04:13.721 INFO:tasks.workunit.client.1.smithi174.stdout:6/615: rmdir d0 39 2024-05-06T14:04:13.722 INFO:tasks.workunit.client.1.smithi174.stdout:6/616: rmdir d0/d25/d52/d2c/d6f 39 2024-05-06T14:04:13.722 INFO:tasks.workunit.client.1.smithi174.stdout:6/617: dread - d0/df/d45/da9/db3/fc8 zero size 2024-05-06T14:04:13.725 INFO:tasks.workunit.client.1.smithi174.stdout:6/618: write d0/f3a [1410717,49823] 0 2024-05-06T14:04:13.804 INFO:tasks.workunit.client.1.smithi174.stdout:6/619: fsync d0/d93/f9c 0 2024-05-06T14:04:13.807 INFO:tasks.workunit.client.1.smithi174.stdout:3/502: sync 2024-05-06T14:04:13.807 INFO:tasks.workunit.client.1.smithi174.stdout:3/503: chown df/d2d/f6c 8136 1 2024-05-06T14:04:13.809 INFO:tasks.workunit.client.1.smithi174.stdout:6/620: getdents d0/df 0 2024-05-06T14:04:13.809 INFO:tasks.workunit.client.1.smithi174.stdout:0/489: dwrite d0/d4/f3d [2129920,69632] 0 2024-05-06T14:04:13.809 INFO:tasks.workunit.client.1.smithi174.stdout:2/504: dwrite d0/d1/d2/f1a [2002944,86016] 0 2024-05-06T14:04:13.810 INFO:tasks.workunit.client.1.smithi174.stdout:0/490: rename d0/d4/f82 to d0/d1a/d17/f9e 0 2024-05-06T14:04:13.810 INFO:tasks.workunit.client.1.smithi174.stdout:4/603: write d1/d1f/dd6/d6e/f55 [2347380,20591] 0 2024-05-06T14:04:13.810 INFO:tasks.workunit.client.1.smithi174.stdout:2/505: mknod d0/d16/c9b 0 2024-05-06T14:04:13.810 INFO:tasks.workunit.client.1.smithi174.stdout:6/621: write d0/f3a [2395183,52225] 0 2024-05-06T14:04:13.810 INFO:tasks.workunit.client.1.smithi174.stdout:4/604: link d1/d48/d5a/d61/la9 d1/d1f/dd6/d6e/d50/d95/ldc 0 2024-05-06T14:04:13.810 INFO:tasks.workunit.client.1.smithi174.stdout:0/491: creat d0/d4/d8/d25/f9f x:0 0 0 2024-05-06T14:04:13.810 INFO:tasks.workunit.client.1.smithi174.stdout:2/506: dread d0/d1/d2/f1a [126976,102400] 0 2024-05-06T14:04:13.811 INFO:tasks.workunit.client.1.smithi174.stdout:2/507: rename d0/db/d15/f30 to d0/d24/d77/d93/f9c 0 2024-05-06T14:04:13.811 INFO:tasks.workunit.client.1.smithi174.stdout:2/508: readlink d0/d1/d2/ld 0 2024-05-06T14:04:13.811 INFO:tasks.workunit.client.1.smithi174.stdout:6/622: symlink d0/df/d45/lcc 0 2024-05-06T14:04:13.811 INFO:tasks.workunit.client.1.smithi174.stdout:6/623: chown d0/df/f5e 0 1 2024-05-06T14:04:13.811 INFO:tasks.workunit.client.1.smithi174.stdout:0/492: write d0/d3/f40 [1233014,53124] 0 2024-05-06T14:04:13.811 INFO:tasks.workunit.client.1.smithi174.stdout:6/624: dread - d0/d25/d52/d2c/d5f/f88 zero size 2024-05-06T14:04:13.811 INFO:tasks.workunit.client.1.smithi174.stdout:6/625: readlink d0/d25/d52/d4c/l64 0 2024-05-06T14:04:13.811 INFO:tasks.workunit.client.1.smithi174.stdout:2/509: write d0/d1/d2/d4/d18/d2d/d32/f47 [4551,20332] 0 2024-05-06T14:04:13.812 INFO:tasks.workunit.client.1.smithi174.stdout:0/493: creat d0/d4/d8/d25/d5c/fa0 x:0 0 0 2024-05-06T14:04:13.812 INFO:tasks.workunit.client.1.smithi174.stdout:0/494: symlink d0/d36/d45/la1 0 2024-05-06T14:04:13.812 INFO:tasks.workunit.client.1.smithi174.stdout:6/626: write d0/d25/d52/d80/fbe [909876,107038] 0 2024-05-06T14:04:13.812 INFO:tasks.workunit.client.1.smithi174.stdout:6/627: chown d0/d25/d52/d2c/d5f/dc9 24 1 2024-05-06T14:04:13.812 INFO:tasks.workunit.client.1.smithi174.stdout:0/495: symlink d0/d36/la2 0 2024-05-06T14:04:13.812 INFO:tasks.workunit.client.1.smithi174.stdout:7/462: dwrite d0/d1d/d41/d61/d28/f6e [274432,106496] 0 2024-05-06T14:04:13.812 INFO:tasks.workunit.client.1.smithi174.stdout:7/463: chown d0/d1d/d41/d61/d19/d24/d14/f33 175644746 1 2024-05-06T14:04:13.812 INFO:tasks.workunit.client.1.smithi174.stdout:7/464: unlink d0/d1d/d41/d61/d19/d39/d46/l99 0 2024-05-06T14:04:13.813 INFO:tasks.workunit.client.1.smithi174.stdout:3/504: dwrite df/f28 [696320,8192] 0 2024-05-06T14:04:13.813 INFO:tasks.workunit.client.1.smithi174.stdout:3/505: write df/d10/f2f [1700468,7847] 0 2024-05-06T14:04:13.813 INFO:tasks.workunit.client.1.smithi174.stdout:3/506: write df/d10/d1b/d7e/f8c [1042386,95230] 0 2024-05-06T14:04:13.888 INFO:tasks.workunit.client.1.smithi174.stdout:7/465: dwrite d0/d1d/d41/d61/d19/d24/d47/d70/d67/f80 [0,77824] 0 2024-05-06T14:04:13.888 INFO:tasks.workunit.client.1.smithi174.stdout:7/466: mkdir d0/d1d/d41/d61/d28/d59/da1 0 2024-05-06T14:04:13.888 INFO:tasks.workunit.client.1.smithi174.stdout:7/467: dread - d0/d1d/d41/d61/d28/d37/f4e zero size 2024-05-06T14:04:13.888 INFO:tasks.workunit.client.1.smithi174.stdout:6/628: dwrite d0/df/fc7 [176128,126976] 0 2024-05-06T14:04:13.888 INFO:tasks.workunit.client.1.smithi174.stdout:6/629: write d0/df/d45/d4b/f82 [1255518,15076] 0 2024-05-06T14:04:13.888 INFO:tasks.workunit.client.1.smithi174.stdout:6/630: readlink d0/df/l17 0 2024-05-06T14:04:13.946 INFO:tasks.workunit.client.1.smithi174.stdout:6/631: fdatasync d0/d25/d35/f87 0 2024-05-06T14:04:13.946 INFO:tasks.workunit.client.1.smithi174.stdout:6/632: write d0/d25/d35/fa4 [525422,22717] 0 2024-05-06T14:04:13.946 INFO:tasks.workunit.client.1.smithi174.stdout:6/633: chown d0/df/d45/l8c 70266 1 2024-05-06T14:04:13.948 INFO:tasks.workunit.client.1.smithi174.stdout:7/468: dwrite d0/d1d/d41/d61/d19/d24/d14/f6d [1712128,16384] 0 2024-05-06T14:04:13.948 INFO:tasks.workunit.client.1.smithi174.stdout:6/634: symlink d0/df/d45/d56/lcd 0 2024-05-06T14:04:13.948 INFO:tasks.workunit.client.1.smithi174.stdout:6/635: write d0/d25/d35/f9e [71341,102504] 0 2024-05-06T14:04:13.948 INFO:tasks.workunit.client.1.smithi174.stdout:6/636: link d0/df/d45/d4b/f86 d0/d25/d52/d2c/fce 0 2024-05-06T14:04:13.948 INFO:tasks.workunit.client.1.smithi174.stdout:6/637: chown d0/d25/d52/d2c/d6f 52623915 1 2024-05-06T14:04:13.949 INFO:tasks.workunit.client.1.smithi174.stdout:6/638: write d0/df/d45/d4b/f86 [123221,47172] 0 2024-05-06T14:04:13.949 INFO:tasks.workunit.client.1.smithi174.stdout:6/639: getdents d0/df/d45/da9 0 2024-05-06T14:04:13.949 INFO:tasks.workunit.client.1.smithi174.stdout:6/640: mkdir d0/df/d45/dcf 0 2024-05-06T14:04:13.949 INFO:tasks.workunit.client.1.smithi174.stdout:6/641: write d0/f26 [987660,21851] 0 2024-05-06T14:04:13.949 INFO:tasks.workunit.client.1.smithi174.stdout:6/642: dread d0/df/f6e [102400,126976] 0 2024-05-06T14:04:13.974 INFO:tasks.workunit.client.1.smithi174.stdout:7/469: fsync d0/d1d/d41/d61/d19/d24/d14/d52/f20 0 2024-05-06T14:04:13.976 INFO:tasks.workunit.client.1.smithi174.stdout:7/470: dwrite d0/d1d/d41/f97 [61440,32768] 0 2024-05-06T14:04:13.977 INFO:tasks.workunit.client.1.smithi174.stdout:7/471: dread d0/d1d/f1e [569344,16384] 0 2024-05-06T14:04:13.977 INFO:tasks.workunit.client.1.smithi174.stdout:7/472: creat d0/d1d/d41/d61/d19/d39/fa2 x:0 0 0 2024-05-06T14:04:13.981 INFO:tasks.workunit.client.1.smithi174.stdout:6/643: truncate d0/d25/f30 348869 0 2024-05-06T14:04:13.981 INFO:tasks.workunit.client.1.smithi174.stdout:6/644: mknod d0/df/d45/d4b/cd0 0 2024-05-06T14:04:13.982 INFO:tasks.workunit.client.1.smithi174.stdout:6/645: symlink d0/d25/d52/d2c/d5f/ld1 0 2024-05-06T14:04:13.982 INFO:tasks.workunit.client.1.smithi174.stdout:6/646: creat d0/fd2 x:0 0 0 2024-05-06T14:04:13.982 INFO:tasks.workunit.client.1.smithi174.stdout:6/647: read d0/d25/d52/d3b/f53 [102012,35426] 0 2024-05-06T14:04:13.982 INFO:tasks.workunit.client.1.smithi174.stdout:6/648: write d0/d25/d35/fa4 [1389978,44417] 0 2024-05-06T14:04:13.982 INFO:tasks.workunit.client.1.smithi174.stdout:6/649: creat d0/d25/d52/dba/fd3 x:0 0 0 2024-05-06T14:04:13.982 INFO:tasks.workunit.client.1.smithi174.stdout:6/650: dread d0/d25/d52/d2c/f63 [278528,53248] 0 2024-05-06T14:04:13.983 INFO:tasks.workunit.client.1.smithi174.stdout:6/651: creat d0/d25/d52/d2c/d5f/fd4 x:0 0 0 2024-05-06T14:04:13.983 INFO:tasks.workunit.client.1.smithi174.stdout:6/652: rmdir d0/df/d45/d56 39 2024-05-06T14:04:13.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:13.990+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 msgr2=0x7f7190006620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:13.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:13.990+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 0x7f7190006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:04:13.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:13.990+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:13.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:13.990+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:04:14.001 INFO:tasks.workunit.client.1.smithi174.stdout:0/496: fsync d0/d36/f9b 0 2024-05-06T14:04:14.001 INFO:tasks.workunit.client.1.smithi174.stdout:4/605: fdatasync d1/d9/f18 0 2024-05-06T14:04:14.001 INFO:tasks.workunit.client.1.smithi174.stdout:4/606: readlink d1/l8 0 2024-05-06T14:04:14.001 INFO:tasks.workunit.client.1.smithi174.stdout:0/497: creat d0/d1a/d17/d2e/fa3 x:0 0 0 2024-05-06T14:04:14.001 INFO:tasks.workunit.client.1.smithi174.stdout:0/498: chown d0/d36/d3f/d7a 2827 1 2024-05-06T14:04:14.001 INFO:tasks.workunit.client.1.smithi174.stdout:0/499: mknod d0/d4/d80/ca4 0 2024-05-06T14:04:14.001 INFO:tasks.workunit.client.1.smithi174.stdout:7/473: fsync d0/d1d/d41/f4b 0 2024-05-06T14:04:14.002 INFO:tasks.workunit.client.1.smithi174.stdout:0/500: truncate d0/d1a/d17/d2e/f53 2905435 0 2024-05-06T14:04:14.002 INFO:tasks.workunit.client.1.smithi174.stdout:3/507: fdatasync df/d10/d1b/d7e/f8c 0 2024-05-06T14:04:14.002 INFO:tasks.workunit.client.1.smithi174.stdout:0/501: rename d0/d4/d8/d25/d5c/d44/l98 to d0/d4/d8/d25/la5 0 2024-05-06T14:04:14.002 INFO:tasks.workunit.client.1.smithi174.stdout:7/474: write d0/d1d/d41/d61/d19/d39/d46/f57 [318714,18911] 0 2024-05-06T14:04:14.002 INFO:tasks.workunit.client.1.smithi174.stdout:3/508: mknod df/d2d/d4e/ca4 0 2024-05-06T14:04:14.002 INFO:tasks.workunit.client.1.smithi174.stdout:7/475: mknod d0/d1d/d41/d61/d28/d59/ca3 0 2024-05-06T14:04:14.002 INFO:tasks.workunit.client.1.smithi174.stdout:3/509: dread - df/f90 zero size 2024-05-06T14:04:14.002 INFO:tasks.workunit.client.1.smithi174.stdout:3/510: rmdir df/d10 39 2024-05-06T14:04:14.003 INFO:tasks.workunit.client.1.smithi174.stdout:7/476: rmdir d0/d1d/d41/d61/d28/d59/d82 0 2024-05-06T14:04:14.003 INFO:tasks.workunit.client.1.smithi174.stdout:6/653: dwrite d0/d25/f98 [1310720,24576] 0 2024-05-06T14:04:14.003 INFO:tasks.workunit.client.1.smithi174.stdout:7/477: rename d0/d1d/d41 to d0/d1d/da4 0 2024-05-06T14:04:14.003 INFO:tasks.workunit.client.1.smithi174.stdout:6/654: symlink d0/d25/d52/d2c/d5f/daa/ld5 0 2024-05-06T14:04:14.003 INFO:tasks.workunit.client.1.smithi174.stdout:7/478: write d0/d1d/da4/d61/d19/f9b [209096,25844] 0 2024-05-06T14:04:14.003 INFO:tasks.workunit.client.1.smithi174.stdout:7/479: mknod d0/d1d/da4/d61/d28/d37/ca5 0 2024-05-06T14:04:14.003 INFO:tasks.workunit.client.1.smithi174.stdout:6/655: truncate d0/df/d45/d4b/f82 389364 0 2024-05-06T14:04:14.003 INFO:tasks.workunit.client.1.smithi174.stdout:6/656: chown d0/df/f20 3 1 2024-05-06T14:04:14.004 INFO:tasks.workunit.client.1.smithi174.stdout:7/480: mkdir d0/d1d/da4/d61/d19/d39/d90/da6 0 2024-05-06T14:04:14.004 INFO:tasks.workunit.client.1.smithi174.stdout:6/657: write d0/d25/d35/f4d [487564,106162] 0 2024-05-06T14:04:14.004 INFO:tasks.workunit.client.1.smithi174.stdout:6/658: link d0/df/d45/da9/lbf d0/d25/d52/d2c/ld6 0 2024-05-06T14:04:14.006 INFO:tasks.workunit.client.1.smithi174.stdout:4/607: fdatasync d1/d1f/d27/d2c/fc6 0 2024-05-06T14:04:14.006 INFO:tasks.workunit.client.1.smithi174.stdout:4/608: unlink d1/d1f/d89/fcd 0 2024-05-06T14:04:14.006 INFO:tasks.workunit.client.1.smithi174.stdout:4/609: write d1/d9/d15/d74/fb7 [1257855,34565] 0 2024-05-06T14:04:14.012 INFO:tasks.workunit.client.1.smithi174.stdout:4/610: mkdir d1/d1f/d27/d2c/ddd 0 2024-05-06T14:04:14.012 INFO:tasks.workunit.client.1.smithi174.stdout:4/611: symlink d1/d9/d15/d74/d86/dc2/lde 0 2024-05-06T14:04:14.012 INFO:tasks.workunit.client.1.smithi174.stdout:4/612: mkdir d1/d9/d15/d35/dd9/d6b/ddf 0 2024-05-06T14:04:14.012 INFO:tasks.workunit.client.1.smithi174.stdout:4/613: creat d1/d1f/d27/d2c/d45/fe0 x:0 0 0 2024-05-06T14:04:14.012 INFO:tasks.workunit.client.1.smithi174.stdout:4/614: getdents d1/d48/d5a/d5f 0 2024-05-06T14:04:14.012 INFO:tasks.workunit.client.1.smithi174.stdout:4/615: read d1/d9/d15/f4e [50046,96116] 0 2024-05-06T14:04:14.012 INFO:tasks.workunit.client.1.smithi174.stdout:4/616: stat d1/d1f/dd6/d6e/d50/db0/lbe 0 2024-05-06T14:04:14.013 INFO:tasks.workunit.client.1.smithi174.stdout:4/617: write d1/d9/f23 [1268055,1339] 0 2024-05-06T14:04:14.013 INFO:tasks.workunit.client.1.smithi174.stdout:4/618: dread d1/d9/d15/d98/f66 [1454080,45056] 0 2024-05-06T14:04:14.013 INFO:tasks.workunit.client.1.smithi174.stdout:4/619: symlink d1/d9/d15/d41/le1 0 2024-05-06T14:04:14.013 INFO:tasks.workunit.client.1.smithi174.stdout:4/620: chown d1/d1f/f62 318846179 1 2024-05-06T14:04:14.013 INFO:tasks.workunit.client.1.smithi174.stdout:3/511: dwrite df/d10/d1b/f65 [1282048,12288] 0 2024-05-06T14:04:14.013 INFO:tasks.workunit.client.1.smithi174.stdout:3/512: write df/f28 [2597372,41530] 0 2024-05-06T14:04:14.063 INFO:tasks.workunit.client.1.smithi174.stdout:6/659: fsync d0/df/f20 0 2024-05-06T14:04:14.064 INFO:tasks.workunit.client.1.smithi174.stdout:6/660: mknod d0/df/d45/cd7 0 2024-05-06T14:04:14.064 INFO:tasks.workunit.client.1.smithi174.stdout:6/661: chown d0/d25/l7e 345 1 2024-05-06T14:04:14.066 INFO:tasks.workunit.client.1.smithi174.stdout:6/662: creat d0/df/d45/da9/db3/fd8 x:0 0 0 2024-05-06T14:04:14.068 INFO:tasks.workunit.client.1.smithi174.stdout:4/621: dwrite d1/d48/f58 [1777664,102400] 0 2024-05-06T14:04:14.068 INFO:tasks.workunit.client.1.smithi174.stdout:3/513: dwrite df/f90 [561152,12288] 0 2024-05-06T14:04:14.068 INFO:tasks.workunit.client.1.smithi174.stdout:4/622: write d1/d9/d15/d92/fad [1549534,89610] 0 2024-05-06T14:04:14.069 INFO:tasks.workunit.client.1.smithi174.stdout:0/502: symlink d0/d4/d8/d25/d5c/la6 0 2024-05-06T14:04:14.069 INFO:tasks.workunit.client.1.smithi174.stdout:0/503: chown d0/d4/d8/d25/f6f 5 1 2024-05-06T14:04:14.069 INFO:tasks.workunit.client.1.smithi174.stdout:4/623: write d1/d1f/d27/d84/fc0 [561063,68175] 0 2024-05-06T14:04:14.069 INFO:tasks.workunit.client.1.smithi174.stdout:0/504: write d0/d3/f29 [250381,73815] 0 2024-05-06T14:04:14.069 INFO:tasks.workunit.client.1.smithi174.stdout:0/505: dwrite d0/d36/d3f/d5e/f9a [815104,81920] 0 2024-05-06T14:04:14.069 INFO:tasks.workunit.client.1.smithi174.stdout:0/506: mkdir d0/d4/d8/d25/d5c/d4a/da7 0 2024-05-06T14:04:14.070 INFO:tasks.workunit.client.1.smithi174.stdout:0/507: readlink d0/d4/d8/d25/l6a 0 2024-05-06T14:04:14.070 INFO:tasks.workunit.client.1.smithi174.stdout:0/508: symlink d0/d1a/d17/d2e/d58/la8 0 2024-05-06T14:04:14.112 INFO:tasks.workunit.client.1.smithi174.stdout:3/514: fdatasync df/d10/d1b/d59/f89 0 2024-05-06T14:04:14.115 INFO:tasks.workunit.client.1.smithi174.stdout:0/509: dwrite d0/d3/d5d/d38/f31 [1126400,65536] 0 2024-05-06T14:04:14.115 INFO:tasks.workunit.client.1.smithi174.stdout:0/510: read d0/d36/d3f/d5e/f62 [21446,89817] 0 2024-05-06T14:04:14.116 INFO:tasks.workunit.client.1.smithi174.stdout:0/511: chown d0/d4/d8/d25/d5c/d4a 2 1 2024-05-06T14:04:14.116 INFO:tasks.workunit.client.1.smithi174.stdout:0/512: creat d0/d36/d3f/d5e/fa9 x:0 0 0 2024-05-06T14:04:14.116 INFO:tasks.workunit.client.1.smithi174.stdout:0/513: symlink d0/d4/d80/d93/laa 0 2024-05-06T14:04:14.116 INFO:tasks.workunit.client.1.smithi174.stdout:0/514: creat d0/d4/d8/d25/d5c/d4a/da7/fab x:0 0 0 2024-05-06T14:04:14.117 INFO:tasks.workunit.client.1.smithi174.stdout:3/515: dwrite df/d10/d1b/d7e/d5a/f99 [299008,122880] 0 2024-05-06T14:04:14.117 INFO:tasks.workunit.client.1.smithi174.stdout:3/516: chown fe 15713204 1 2024-05-06T14:04:14.117 INFO:tasks.workunit.client.1.smithi174.stdout:3/517: write df/d10/d1b/f9f [831447,53011] 0 2024-05-06T14:04:14.118 INFO:tasks.workunit.client.1.smithi174.stdout:3/518: truncate df/d10/d1b/d7e/f8c 188488 0 2024-05-06T14:04:14.118 INFO:tasks.workunit.client.1.smithi174.stdout:3/519: truncate df/f44 466761 0 2024-05-06T14:04:14.118 INFO:tasks.workunit.client.1.smithi174.stdout:3/520: write df/d10/d1b/d7e/d5a/f99 [1178934,32342] 0 2024-05-06T14:04:14.118 INFO:tasks.workunit.client.1.smithi174.stdout:3/521: write df/d10/d1b/f76 [701103,19037] 0 2024-05-06T14:04:14.118 INFO:tasks.workunit.client.1.smithi174.stdout:3/522: mkdir df/d2d/d4d/da5 0 2024-05-06T14:04:14.120 INFO:tasks.workunit.client.1.smithi174.stdout:2/510: sync 2024-05-06T14:04:14.120 INFO:tasks.workunit.client.1.smithi174.stdout:5/584: sync 2024-05-06T14:04:14.120 INFO:tasks.workunit.client.1.smithi174.stdout:1/490: sync 2024-05-06T14:04:14.120 INFO:tasks.workunit.client.1.smithi174.stdout:8/632: sync 2024-05-06T14:04:14.121 INFO:tasks.workunit.client.1.smithi174.stdout:9/519: sync 2024-05-06T14:04:14.121 INFO:tasks.workunit.client.1.smithi174.stdout:9/520: dread dc/f25 [86016,69632] 0 2024-05-06T14:04:14.121 INFO:tasks.workunit.client.1.smithi174.stdout:1/491: getdents d11/d1f/d27/d32/d84/d8c 0 2024-05-06T14:04:14.121 INFO:tasks.workunit.client.1.smithi174.stdout:5/585: mknod d1/d6/df/d35/cc7 0 2024-05-06T14:04:14.121 INFO:tasks.workunit.client.1.smithi174.stdout:9/521: chown dc/d1c/f38 97190 1 2024-05-06T14:04:14.121 INFO:tasks.workunit.client.1.smithi174.stdout:8/633: rename d4/d48/lb8 to d4/de/d24/dc1/ld4 0 2024-05-06T14:04:14.121 INFO:tasks.workunit.client.1.smithi174.stdout:5/586: rename d1/d6/f4a to d1/d6/d7/d36/fc8 0 2024-05-06T14:04:14.121 INFO:tasks.workunit.client.1.smithi174.stdout:9/522: rename dc/d27/d60/l90 to dc/de/d81/da6/lab 0 2024-05-06T14:04:14.121 INFO:tasks.workunit.client.1.smithi174.stdout:2/511: write d0/d1/d2/d2a/f48 [2145474,64864] 0 2024-05-06T14:04:14.122 INFO:tasks.workunit.client.1.smithi174.stdout:5/587: mknod d1/d6/d7/d36/d53/d59/cc9 0 2024-05-06T14:04:14.122 INFO:tasks.workunit.client.1.smithi174.stdout:5/588: link d1/d6/df/d35/d81/d60/db0/de/f89 d1/d6/d7/fca 0 2024-05-06T14:04:14.122 INFO:tasks.workunit.client.1.smithi174.stdout:9/523: unlink dc/d1c/f1d 0 2024-05-06T14:04:14.122 INFO:tasks.workunit.client.1.smithi174.stdout:3/523: dread df/d10/d1b/f65 [1208320,110592] 0 2024-05-06T14:04:14.122 INFO:tasks.workunit.client.1.smithi174.stdout:5/589: symlink d1/d6/d7/da1/d9a/da5/lcb 0 2024-05-06T14:04:14.122 INFO:tasks.workunit.client.1.smithi174.stdout:5/590: readlink d1/l19 0 2024-05-06T14:04:14.122 INFO:tasks.workunit.client.1.smithi174.stdout:5/591: link d1/d6/d2a/c97 d1/d6/df/d35/d81/d60/ccc 0 2024-05-06T14:04:14.123 INFO:tasks.workunit.client.1.smithi174.stdout:5/592: unlink d1/d6/df/d35/d81/c40 0 2024-05-06T14:04:14.123 INFO:tasks.workunit.client.1.smithi174.stdout:5/593: dread - d1/d6/df/d35/d81/fc0 zero size 2024-05-06T14:04:14.123 INFO:tasks.workunit.client.1.smithi174.stdout:5/594: symlink d1/d6/df/d35/d81/d60/db0/de/dbd/lcd 0 2024-05-06T14:04:14.123 INFO:tasks.workunit.client.1.smithi174.stdout:5/595: chown d1/d6/d7/d36/d53/d59/l65 2196695 1 2024-05-06T14:04:14.123 INFO:tasks.workunit.client.1.smithi174.stdout:1/492: dwrite d11/d1f/d27/d32/d84/d8c/d94/db0/f75 [983040,114688] 0 2024-05-06T14:04:14.126 INFO:tasks.workunit.client.1.smithi174.stdout:0/515: dread d0/d3/d5d/d38/f28 [282624,118784] 0 2024-05-06T14:04:14.126 INFO:tasks.workunit.client.1.smithi174.stdout:0/516: truncate d0/d1a/f6c 745133 0 2024-05-06T14:04:14.127 INFO:tasks.workunit.client.1.smithi174.stdout:0/517: mkdir d0/d3/dac 0 2024-05-06T14:04:14.127 INFO:tasks.workunit.client.1.smithi174.stdout:0/518: rename d0/d36/d3f/d5e to d0/d3/dad 0 2024-05-06T14:04:14.127 INFO:tasks.workunit.client.1.smithi174.stdout:9/524: dwrite dc/f42 [339968,40960] 0 2024-05-06T14:04:14.127 INFO:tasks.workunit.client.1.smithi174.stdout:9/525: dread dc/d1c/f5f [8192,86016] 0 2024-05-06T14:04:14.127 INFO:tasks.workunit.client.1.smithi174.stdout:9/526: dread dc/d14/f1e [544768,126976] 0 2024-05-06T14:04:14.127 INFO:tasks.workunit.client.1.smithi174.stdout:9/527: readlink dc/de/laa 0 2024-05-06T14:04:14.127 INFO:tasks.workunit.client.1.smithi174.stdout:9/528: creat dc/de/d7f/d93/fac x:0 0 0 2024-05-06T14:04:14.127 INFO:tasks.workunit.client.1.smithi174.stdout:9/529: mknod dc/d27/d60/cad 0 2024-05-06T14:04:14.128 INFO:tasks.workunit.client.1.smithi174.stdout:9/530: symlink dc/d14/d43/d8e/lae 0 2024-05-06T14:04:14.128 INFO:tasks.workunit.client.1.smithi174.stdout:9/531: readlink l8 0 2024-05-06T14:04:14.128 INFO:tasks.workunit.client.1.smithi174.stdout:9/532: rename dc/d14 to dc/d27/d60/daf 0 2024-05-06T14:04:14.128 INFO:tasks.workunit.client.1.smithi174.stdout:9/533: mknod dc/de/d6b/cb0 0 2024-05-06T14:04:14.128 INFO:tasks.workunit.client.1.smithi174.stdout:9/534: creat dc/d27/d51/da5/fb1 x:0 0 0 2024-05-06T14:04:14.128 INFO:tasks.workunit.client.1.smithi174.stdout:9/535: dread - dc/d17/d3a/d8d/f8f zero size 2024-05-06T14:04:14.128 INFO:tasks.workunit.client.1.smithi174.stdout:9/536: write dc/df/f12 [723651,1821] 0 2024-05-06T14:04:14.128 INFO:tasks.workunit.client.1.smithi174.stdout:2/512: write d0/d1/d2/d4/d6/f7 [286979,89503] 0 2024-05-06T14:04:14.128 INFO:tasks.workunit.client.1.smithi174.stdout:9/537: mkdir dc/d17/d3a/db2 0 2024-05-06T14:04:14.129 INFO:tasks.workunit.client.1.smithi174.stdout:9/538: link l6 dc/d17/lb3 0 2024-05-06T14:04:14.129 INFO:tasks.workunit.client.1.smithi174.stdout:9/539: rename dc to dc/df/db4 22 2024-05-06T14:04:14.129 INFO:tasks.workunit.client.1.smithi174.stdout:2/513: creat d0/d1/d2/d4/d51/f9d x:0 0 0 2024-05-06T14:04:14.129 INFO:tasks.workunit.client.1.smithi174.stdout:9/540: link f2 dc/d27/d60/daf/fb5 0 2024-05-06T14:04:14.129 INFO:tasks.workunit.client.1.smithi174.stdout:2/514: link d0/d1/d2/d4/d18/f64 d0/db/d15/f9e 0 2024-05-06T14:04:14.129 INFO:tasks.workunit.client.1.smithi174.stdout:2/515: symlink d0/d1/d2/d4/d51/l9f 0 2024-05-06T14:04:14.129 INFO:tasks.workunit.client.1.smithi174.stdout:5/596: dwrite d1/d6/df/fc6 [421888,90112] 0 2024-05-06T14:04:14.129 INFO:tasks.workunit.client.1.smithi174.stdout:5/597: rename d1/d6/d7/da1/l72 to d1/d6/d7/d36/d53/d59/d61/d69/dc3/lce 0 2024-05-06T14:04:14.130 INFO:tasks.workunit.client.1.smithi174.stdout:1/493: dread d11/d41/f85 [208896,102400] 0 2024-05-06T14:04:14.130 INFO:tasks.workunit.client.1.smithi174.stdout:1/494: chown ld 1457480 1 2024-05-06T14:04:14.130 INFO:tasks.workunit.client.1.smithi174.stdout:1/495: write d11/d1f/d27/d32/f4e [125589,13418] 0 2024-05-06T14:04:14.130 INFO:tasks.workunit.client.1.smithi174.stdout:1/496: chown d11/d1f/l4f 10 1 2024-05-06T14:04:14.130 INFO:tasks.workunit.client.1.smithi174.stdout:0/519: dread d0/f24 [1941504,102400] 0 2024-05-06T14:04:14.194 INFO:tasks.workunit.client.1.smithi174.stdout:3/524: fsync df/d10/f19 0 2024-05-06T14:04:14.195 INFO:tasks.workunit.client.1.smithi174.stdout:3/525: mknod df/d10/d1b/d7e/d5a/ca6 0 2024-05-06T14:04:14.195 INFO:tasks.workunit.client.1.smithi174.stdout:9/541: fsync dc/f4e 0 2024-05-06T14:04:14.195 INFO:tasks.workunit.client.1.smithi174.stdout:2/516: fsync d0/da/d3f/f71 0 2024-05-06T14:04:14.195 INFO:tasks.workunit.client.1.smithi174.stdout:2/517: creat d0/d1/d2/d4/d18/fa0 x:0 0 0 2024-05-06T14:04:14.195 INFO:tasks.workunit.client.1.smithi174.stdout:9/542: write dc/df/f12 [60971,71974] 0 2024-05-06T14:04:14.195 INFO:tasks.workunit.client.1.smithi174.stdout:2/518: creat d0/d1/d2/d4/d18/d2d/d32/fa1 x:0 0 0 2024-05-06T14:04:14.195 INFO:tasks.workunit.client.1.smithi174.stdout:9/543: symlink dc/d27/d60/lb6 0 2024-05-06T14:04:14.195 INFO:tasks.workunit.client.1.smithi174.stdout:9/544: creat dc/d1c/fb7 x:0 0 0 2024-05-06T14:04:14.196 INFO:tasks.workunit.client.1.smithi174.stdout:9/545: write dc/de/d6b/f8b [733327,94571] 0 2024-05-06T14:04:14.196 INFO:tasks.workunit.client.1.smithi174.stdout:9/546: write dc/de/f2e [548045,41302] 0 2024-05-06T14:04:14.196 INFO:tasks.workunit.client.1.smithi174.stdout:9/547: mkdir dc/d17/db8 0 2024-05-06T14:04:14.197 INFO:tasks.workunit.client.1.smithi174.stdout:2/519: dwrite d0/db/d15/f2e [634880,20480] 0 2024-05-06T14:04:14.198 INFO:tasks.workunit.client.1.smithi174.stdout:2/520: dread d0/d1/d2/f54 [774144,73728] 0 2024-05-06T14:04:14.198 INFO:tasks.workunit.client.1.smithi174.stdout:2/521: mkdir d0/d1/d2/d4/d6/d3c/da2 0 2024-05-06T14:04:14.198 INFO:tasks.workunit.client.1.smithi174.stdout:2/522: creat d0/d24/d77/d93/d9a/fa3 x:0 0 0 2024-05-06T14:04:14.198 INFO:tasks.workunit.client.1.smithi174.stdout:2/523: dread d0/d1/d2/d4/f6c [294912,81920] 0 2024-05-06T14:04:14.199 INFO:tasks.workunit.client.1.smithi174.stdout:5/598: dwrite d1/d6/df/d35/d81/d8d/fb3 [548864,40960] 0 2024-05-06T14:04:14.199 INFO:tasks.workunit.client.1.smithi174.stdout:3/526: dwrite df/d10/d1b/d7e/d57/f61 [151552,24576] 0 2024-05-06T14:04:14.200 INFO:tasks.workunit.client.1.smithi174.stdout:0/520: dwrite d0/d3/f29 [1179648,122880] 0 2024-05-06T14:04:14.200 INFO:tasks.workunit.client.1.smithi174.stdout:0/521: readlink d0/d4/d8/l49 0 2024-05-06T14:04:14.200 INFO:tasks.workunit.client.1.smithi174.stdout:0/522: write d0/d4/d8/d25/d5c/d44/f91 [395893,126422] 0 2024-05-06T14:04:14.200 INFO:tasks.workunit.client.1.smithi174.stdout:0/523: getdents d0/d4/d8/d25/d5c/d44 0 2024-05-06T14:04:14.200 INFO:tasks.workunit.client.1.smithi174.stdout:0/524: mknod d0/d4/d8/d25/d5c/d44/cae 0 2024-05-06T14:04:14.200 INFO:tasks.workunit.client.1.smithi174.stdout:0/525: stat d0/d16/c66 0 2024-05-06T14:04:14.207 INFO:tasks.workunit.client.1.smithi174.stdout:0/526: dwrite d0/d4/d8/d25/f6f [1335296,118784] 0 2024-05-06T14:04:14.207 INFO:tasks.workunit.client.1.smithi174.stdout:2/524: dread d0/f55 [1318912,65536] 0 2024-05-06T14:04:14.208 INFO:tasks.workunit.client.1.smithi174.stdout:2/525: stat d0/d1/d2/d4/d51/l7e 0 2024-05-06T14:04:14.208 INFO:tasks.workunit.client.1.smithi174.stdout:2/526: chown d0/da/d3f 370115 1 2024-05-06T14:04:14.208 INFO:tasks.workunit.client.1.smithi174.stdout:2/527: stat d0/d24/f6a 0 2024-05-06T14:04:14.208 INFO:tasks.workunit.client.1.smithi174.stdout:2/528: getdents d0/d1/d2/d4 0 2024-05-06T14:04:14.208 INFO:tasks.workunit.client.1.smithi174.stdout:2/529: write d0/db/d72/f8c [775879,44666] 0 2024-05-06T14:04:14.208 INFO:tasks.workunit.client.1.smithi174.stdout:2/530: rmdir d0/d1 39 2024-05-06T14:04:14.208 INFO:tasks.workunit.client.1.smithi174.stdout:3/527: read df/d10/d1b/d7e/d57/f61 [57755,113419] 0 2024-05-06T14:04:14.208 INFO:tasks.workunit.client.1.smithi174.stdout:5/599: dwrite d1/d6/df/d35/d8b/d9f/fb5 [573440,28672] 0 2024-05-06T14:04:14.209 INFO:tasks.workunit.client.1.smithi174.stdout:0/527: mknod d0/d1a/d17/d2e/caf 0 2024-05-06T14:04:14.209 INFO:tasks.workunit.client.1.smithi174.stdout:9/548: dwrite dc/d17/d4c/f72 [2527232,73728] 0 2024-05-06T14:04:14.209 INFO:tasks.workunit.client.1.smithi174.stdout:0/528: dread d0/d36/f9b [90112,61440] 0 2024-05-06T14:04:14.209 INFO:tasks.workunit.client.1.smithi174.stdout:3/528: truncate df/d2d/d4d/f4f 636394 0 2024-05-06T14:04:14.209 INFO:tasks.workunit.client.1.smithi174.stdout:5/600: creat d1/d6/df/d35/d81/d60/db0/d41/fcf x:0 0 0 2024-05-06T14:04:14.209 INFO:tasks.workunit.client.1.smithi174.stdout:9/549: symlink dc/d17/db8/lb9 0 2024-05-06T14:04:14.209 INFO:tasks.workunit.client.1.smithi174.stdout:3/529: mknod df/d10/d1b/d7e/d57/ca7 0 2024-05-06T14:04:14.209 INFO:tasks.workunit.client.1.smithi174.stdout:9/550: creat dc/d17/d4c/fba x:0 0 0 2024-05-06T14:04:14.210 INFO:tasks.workunit.client.1.smithi174.stdout:3/530: truncate df/f90 349372 0 2024-05-06T14:04:14.210 INFO:tasks.workunit.client.1.smithi174.stdout:9/551: readlink dc/l19 0 2024-05-06T14:04:14.210 INFO:tasks.workunit.client.1.smithi174.stdout:5/601: truncate d1/d6/df/d35/d81/d60/db0/f33 592746 0 2024-05-06T14:04:14.210 INFO:tasks.workunit.client.1.smithi174.stdout:9/552: dread - dc/d27/d60/f6a zero size 2024-05-06T14:04:14.210 INFO:tasks.workunit.client.1.smithi174.stdout:5/602: stat d1/d6/df/d35/d81/d60/db0/l4d 0 2024-05-06T14:04:14.210 INFO:tasks.workunit.client.1.smithi174.stdout:3/531: dread df/d10/d1b/d7e/f8c [61440,118784] 0 2024-05-06T14:04:14.210 INFO:tasks.workunit.client.1.smithi174.stdout:3/532: stat df/l98 0 2024-05-06T14:04:14.210 INFO:tasks.workunit.client.1.smithi174.stdout:5/603: getdents d1/d6/d2a 0 2024-05-06T14:04:14.211 INFO:tasks.workunit.client.1.smithi174.stdout:3/533: write df/d10/f1c [3333542,13311] 0 2024-05-06T14:04:14.211 INFO:tasks.workunit.client.1.smithi174.stdout:5/604: symlink d1/d6/df/d35/d81/d60/db0/ld0 0 2024-05-06T14:04:14.211 INFO:tasks.workunit.client.1.smithi174.stdout:5/605: chown d1/d6/df/f30 1894948 1 2024-05-06T14:04:14.211 INFO:tasks.workunit.client.1.smithi174.stdout:5/606: chown d1/d6/df/l73 35443 1 2024-05-06T14:04:14.211 INFO:tasks.workunit.client.1.smithi174.stdout:5/607: mkdir d1/d6/d7/d36/d53/d59/d61/d69/dc3/dd1 0 2024-05-06T14:04:14.211 INFO:tasks.workunit.client.1.smithi174.stdout:5/608: symlink d1/d6/d7/d36/d53/d59/d61/d69/ld2 0 2024-05-06T14:04:14.211 INFO:tasks.workunit.client.1.smithi174.stdout:5/609: symlink d1/d6/df/d35/ld3 0 2024-05-06T14:04:14.211 INFO:tasks.workunit.client.1.smithi174.stdout:0/529: dwrite d0/d4/d8/f47 [1335296,36864] 0 2024-05-06T14:04:14.212 INFO:tasks.workunit.client.1.smithi174.stdout:5/610: mkdir d1/d6/d7/d36/d53/d59/d61/d69/dd4 0 2024-05-06T14:04:14.212 INFO:tasks.workunit.client.1.smithi174.stdout:0/530: readlink d0/d4/d8/l65 0 2024-05-06T14:04:14.212 INFO:tasks.workunit.client.1.smithi174.stdout:0/531: rmdir d0/d3/d5d/d83 39 2024-05-06T14:04:14.212 INFO:tasks.workunit.client.1.smithi174.stdout:0/532: rename d0/d4/d8/d25/d5c to d0/d4/d8/d25/d5c/d4a/da7/db0 22 2024-05-06T14:04:14.212 INFO:tasks.workunit.client.1.smithi174.stdout:0/533: chown d0/d1a/d17/d2e/f3c 480342 1 2024-05-06T14:04:14.212 INFO:tasks.workunit.client.1.smithi174.stdout:5/611: creat d1/d6/d7/d36/d53/fd5 x:0 0 0 2024-05-06T14:04:14.212 INFO:tasks.workunit.client.1.smithi174.stdout:0/534: write d0/d4/d8/d25/f9f [121179,113850] 0 2024-05-06T14:04:14.212 INFO:tasks.workunit.client.1.smithi174.stdout:0/535: rename d0/d3/c21 to d0/d4/d8/d25/d5c/d44/cb1 0 2024-05-06T14:04:14.213 INFO:tasks.workunit.client.1.smithi174.stdout:5/612: write d1/d6/df/d35/d81/d60/db0/de/f80 [1857857,110134] 0 2024-05-06T14:04:14.213 INFO:tasks.workunit.client.1.smithi174.stdout:0/536: dread - d0/d36/f3b zero size 2024-05-06T14:04:14.213 INFO:tasks.workunit.client.1.smithi174.stdout:0/537: mknod d0/d36/d45/cb2 0 2024-05-06T14:04:14.213 INFO:tasks.workunit.client.1.smithi174.stdout:0/538: symlink d0/d4/d80/lb3 0 2024-05-06T14:04:14.213 INFO:tasks.workunit.client.1.smithi174.stdout:0/539: chown d0/d36/l7c 0 1 2024-05-06T14:04:14.213 INFO:tasks.workunit.client.1.smithi174.stdout:0/540: stat d0/d3/dad/f9a 0 2024-05-06T14:04:14.213 INFO:tasks.workunit.client.1.smithi174.stdout:0/541: symlink d0/d1a/d17/lb4 0 2024-05-06T14:04:14.213 INFO:tasks.workunit.client.1.smithi174.stdout:0/542: getdents d0/d3/dac 0 2024-05-06T14:04:14.214 INFO:tasks.workunit.client.1.smithi174.stdout:0/543: mknod d0/d4/d80/d93/cb5 0 2024-05-06T14:04:14.214 INFO:tasks.workunit.client.1.smithi174.stdout:5/613: write d1/d6/df/d35/d81/d60/d82/fb2 [181590,129665] 0 2024-05-06T14:04:14.214 INFO:tasks.workunit.client.1.smithi174.stdout:0/544: dread d0/d1a/d17/d2e/f5f [790528,94208] 0 2024-05-06T14:04:14.214 INFO:tasks.workunit.client.1.smithi174.stdout:5/614: dread - d1/d6/df/d35/d81/d60/db0/de/f89 zero size 2024-05-06T14:04:14.214 INFO:tasks.workunit.client.1.smithi174.stdout:0/545: link d0/d1a/d17/d2e/d58/c61 d0/d4/d8/d25/d5c/d44/cb6 0 2024-05-06T14:04:14.214 INFO:tasks.workunit.client.1.smithi174.stdout:0/546: truncate d0/d4/f37 1426842 0 2024-05-06T14:04:14.214 INFO:tasks.workunit.client.1.smithi174.stdout:0/547: dread d0/d4/d8/d25/d5c/f87 [671744,86016] 0 2024-05-06T14:04:14.214 INFO:tasks.workunit.client.1.smithi174.stdout:0/548: write d0/d1a/f22 [2902155,52134] 0 2024-05-06T14:04:14.215 INFO:tasks.workunit.client.1.smithi174.stdout:0/549: rmdir d0/d3/dac 0 2024-05-06T14:04:14.215 INFO:tasks.workunit.client.1.smithi174.stdout:0/550: unlink d0/d1a/d17/d2e/caf 0 2024-05-06T14:04:14.215 INFO:tasks.workunit.client.1.smithi174.stdout:0/551: truncate d0/d1a/f22 88974 0 2024-05-06T14:04:14.215 INFO:tasks.workunit.client.1.smithi174.stdout:0/552: symlink d0/d1a/d17/d2e/lb7 0 2024-05-06T14:04:14.215 INFO:tasks.workunit.client.1.smithi174.stdout:0/553: dread d0/d1a/f30 [212992,86016] 0 2024-05-06T14:04:14.215 INFO:tasks.workunit.client.1.smithi174.stdout:0/554: creat d0/d4/d8/d25/d5c/d4a/da7/fb8 x:0 0 0 2024-05-06T14:04:14.215 INFO:tasks.workunit.client.1.smithi174.stdout:0/555: truncate d0/d4/d8/d25/f6f 2053137 0 2024-05-06T14:04:14.215 INFO:tasks.workunit.client.1.smithi174.stdout:0/556: truncate d0/d3/d5d/f43 2364580 0 2024-05-06T14:04:14.215 INFO:tasks.workunit.client.1.smithi174.stdout:0/557: mkdir d0/d4/d8/d25/d5c/d44/db9 0 2024-05-06T14:04:14.216 INFO:tasks.workunit.client.1.smithi174.stdout:0/558: dread d0/d3/f40 [454656,49152] 0 2024-05-06T14:04:14.216 INFO:tasks.workunit.client.1.smithi174.stdout:0/559: dread d0/d4/d80/d93/f97 [438272,8192] 0 2024-05-06T14:04:14.216 INFO:tasks.workunit.client.1.smithi174.stdout:0/560: write d0/d16/f8f [760032,70396] 0 2024-05-06T14:04:14.216 INFO:tasks.workunit.client.1.smithi174.stdout:0/561: creat d0/d3/d5d/fba x:0 0 0 2024-05-06T14:04:14.216 INFO:tasks.workunit.client.1.smithi174.stdout:0/562: dread - d0/f51 zero size 2024-05-06T14:04:14.216 INFO:tasks.workunit.client.1.smithi174.stdout:0/563: creat d0/d36/d45/fbb x:0 0 0 2024-05-06T14:04:14.217 INFO:tasks.workunit.client.1.smithi174.stdout:1/497: write d11/d1f/d27/d2d/f31 [262259,107340] 0 2024-05-06T14:04:14.217 INFO:tasks.workunit.client.1.smithi174.stdout:1/498: rename d11/d1f/d27/d32/d84/d8c/d94/db0/f75 to d11/d57/fb4 0 2024-05-06T14:04:14.217 INFO:tasks.workunit.client.1.smithi174.stdout:1/499: chown d11/d1f/f38 23502728 1 2024-05-06T14:04:14.217 INFO:tasks.workunit.client.1.smithi174.stdout:1/500: symlink d11/d67/d6c/lb5 0 2024-05-06T14:04:14.347 INFO:tasks.workunit.client.1.smithi174.stdout:9/553: dwrite dc/d27/d60/daf/f97 [249856,86016] 0 2024-05-06T14:04:14.347 INFO:tasks.workunit.client.1.smithi174.stdout:9/554: getdents dc/de/d7f/d93 0 2024-05-06T14:04:14.348 INFO:tasks.workunit.client.1.smithi174.stdout:1/501: dwrite d11/d1f/d27/f6a [942080,77824] 0 2024-05-06T14:04:14.348 INFO:tasks.workunit.client.1.smithi174.stdout:1/502: unlink d11/l63 0 2024-05-06T14:04:14.348 INFO:tasks.workunit.client.1.smithi174.stdout:1/503: mkdir d11/d41/d4a/d5e/db6 0 2024-05-06T14:04:14.348 INFO:tasks.workunit.client.1.smithi174.stdout:1/504: write d11/d1f/f7f [96515,119447] 0 2024-05-06T14:04:14.348 INFO:tasks.workunit.client.1.smithi174.stdout:1/505: link d11/f20 d11/d57/d98/daf/db2/fb7 0 2024-05-06T14:04:14.348 INFO:tasks.workunit.client.1.smithi174.stdout:1/506: creat d11/d67/d6c/fb8 x:0 0 0 2024-05-06T14:04:14.348 INFO:tasks.workunit.client.1.smithi174.stdout:1/507: read d11/d57/fb4 [550049,80860] 0 2024-05-06T14:04:14.348 INFO:tasks.workunit.client.1.smithi174.stdout:1/508: chown d11/d67/d6c/lb5 383844 1 2024-05-06T14:04:14.349 INFO:tasks.workunit.client.1.smithi174.stdout:1/509: write d11/d1f/d27/d32/d92/fac [914881,111016] 0 2024-05-06T14:04:14.349 INFO:tasks.workunit.client.1.smithi174.stdout:1/510: write d11/d67/d6c/f72 [1093034,40604] 0 2024-05-06T14:04:14.349 INFO:tasks.workunit.client.1.smithi174.stdout:1/511: creat d11/d1f/d27/d32/d84/d8c/d94/db0/fb9 x:0 0 0 2024-05-06T14:04:14.354 INFO:tasks.workunit.client.1.smithi174.stdout:5/615: dread d1/d6/f54 [303104,114688] 0 2024-05-06T14:04:14.355 INFO:tasks.workunit.client.1.smithi174.stdout:5/616: creat d1/d6/df/d35/d81/d60/d82/fd6 x:0 0 0 2024-05-06T14:04:14.355 INFO:tasks.workunit.client.1.smithi174.stdout:5/617: creat d1/d6/d7/d36/d53/d59/d61/d69/dd4/fd7 x:0 0 0 2024-05-06T14:04:14.355 INFO:tasks.workunit.client.1.smithi174.stdout:5/618: chown d1/d6/d7/da1/c6c 27 1 2024-05-06T14:04:14.355 INFO:tasks.workunit.client.1.smithi174.stdout:5/619: mkdir d1/d6/d7/da1/dd8 0 2024-05-06T14:04:14.355 INFO:tasks.workunit.client.1.smithi174.stdout:5/620: chown d1/d6/d7/d36/la4 3055900 1 2024-05-06T14:04:14.355 INFO:tasks.workunit.client.1.smithi174.stdout:5/621: write d1/d6/df/d35/d8b/d9f/fb5 [706387,119607] 0 2024-05-06T14:04:14.355 INFO:tasks.workunit.client.1.smithi174.stdout:5/622: chown d1/d6/d7/da1/f88 86 1 2024-05-06T14:04:14.356 INFO:tasks.workunit.client.1.smithi174.stdout:5/623: chown d1/d6/d7/da1/fb8 447784 1 2024-05-06T14:04:14.356 INFO:tasks.workunit.client.1.smithi174.stdout:5/624: rmdir d1/d6/df/d35/d81/d8d 39 2024-05-06T14:04:14.357 INFO:tasks.workunit.client.1.smithi174.stdout:0/564: dread d0/d1a/d17/d2e/f5f [114688,86016] 0 2024-05-06T14:04:14.357 INFO:tasks.workunit.client.1.smithi174.stdout:0/565: chown d0/d4/d8/d25/d5c/l56 210 1 2024-05-06T14:04:14.357 INFO:tasks.workunit.client.1.smithi174.stdout:0/566: stat d0/d1a/d17/d2e/lb7 0 2024-05-06T14:04:14.357 INFO:tasks.workunit.client.1.smithi174.stdout:0/567: write d0/d3/d5d/fba [269084,76170] 0 2024-05-06T14:04:14.357 INFO:tasks.workunit.client.1.smithi174.stdout:0/568: stat d0/d3/dad 0 2024-05-06T14:04:14.357 INFO:tasks.workunit.client.1.smithi174.stdout:0/569: unlink d0/d3/d5d/fba 0 2024-05-06T14:04:14.370 INFO:tasks.workunit.client.1.smithi174.stdout:2/531: fdatasync d0/d1/d2/d4/d51/f9d 0 2024-05-06T14:04:14.370 INFO:tasks.workunit.client.1.smithi174.stdout:9/555: fsync dc/d27/d6d/fa7 0 2024-05-06T14:04:14.370 INFO:tasks.workunit.client.1.smithi174.stdout:2/532: fdatasync d0/da/f56 0 2024-05-06T14:04:14.370 INFO:tasks.workunit.client.1.smithi174.stdout:2/533: chown d0/d24/d77/d93/f9c 5997542 1 2024-05-06T14:04:14.370 INFO:tasks.workunit.client.1.smithi174.stdout:2/534: rmdir d0/d92 39 2024-05-06T14:04:14.370 INFO:tasks.workunit.client.1.smithi174.stdout:2/535: chown d0/d1/d2/d4/d18/f91 862 1 2024-05-06T14:04:14.375 INFO:tasks.workunit.client.1.smithi174.stdout:0/570: dread d0/d4/d8/d25/d5c/d44/f46 [2170880,12288] 0 2024-05-06T14:04:14.375 INFO:tasks.workunit.client.1.smithi174.stdout:0/571: rmdir d0/d4/d8/d25/d5c/d44 39 2024-05-06T14:04:14.375 INFO:tasks.workunit.client.1.smithi174.stdout:5/625: dwrite d1/d6/d7/da1/d9a/fc2 [929792,8192] 0 2024-05-06T14:04:14.376 INFO:tasks.workunit.client.1.smithi174.stdout:9/556: mknod dc/d9b/cbb 0 2024-05-06T14:04:14.376 INFO:tasks.workunit.client.1.smithi174.stdout:5/626: chown d1/d6/df/d35/d81/d60/d82 0 1 2024-05-06T14:04:14.376 INFO:tasks.workunit.client.1.smithi174.stdout:9/557: dread dc/d27/d60/daf/fb5 [798720,57344] 0 2024-05-06T14:04:14.376 INFO:tasks.workunit.client.1.smithi174.stdout:0/572: creat d0/d3/d5d/d83/fbc x:0 0 0 2024-05-06T14:04:14.376 INFO:tasks.workunit.client.1.smithi174.stdout:9/558: creat dc/d17/d3a/db2/fbc x:0 0 0 2024-05-06T14:04:14.376 INFO:tasks.workunit.client.1.smithi174.stdout:9/559: readlink dc/d27/d6d/l6e 0 2024-05-06T14:04:14.376 INFO:tasks.workunit.client.1.smithi174.stdout:5/627: write d1/d6/df/d35/fbb [880551,43868] 0 2024-05-06T14:04:14.376 INFO:tasks.workunit.client.1.smithi174.stdout:9/560: read dc/d17/d4c/f72 [2106165,60006] 0 2024-05-06T14:04:14.377 INFO:tasks.workunit.client.1.smithi174.stdout:2/536: truncate d0/db/d15/f2e 460124 0 2024-05-06T14:04:14.377 INFO:tasks.workunit.client.1.smithi174.stdout:5/628: unlink d1/d6/d7/d3e/f5b 0 2024-05-06T14:04:14.377 INFO:tasks.workunit.client.1.smithi174.stdout:2/537: rmdir d0/d1/d2/d4/d43 39 2024-05-06T14:04:14.377 INFO:tasks.workunit.client.1.smithi174.stdout:5/629: creat d1/d6/df/d35/d81/fd9 x:0 0 0 2024-05-06T14:04:14.377 INFO:tasks.workunit.client.1.smithi174.stdout:2/538: unlink d0/d1/d2/f1a 0 2024-05-06T14:04:14.377 INFO:tasks.workunit.client.1.smithi174.stdout:5/630: creat d1/d6/d7/da1/fda x:0 0 0 2024-05-06T14:04:14.377 INFO:tasks.workunit.client.1.smithi174.stdout:5/631: creat d1/fdb x:0 0 0 2024-05-06T14:04:14.377 INFO:tasks.workunit.client.1.smithi174.stdout:5/632: mknod d1/d6/df/d35/d81/d60/db0/d41/cdc 0 2024-05-06T14:04:14.377 INFO:tasks.workunit.client.1.smithi174.stdout:5/633: mknod d1/d6/d7/da1/d9a/cdd 0 2024-05-06T14:04:14.378 INFO:tasks.workunit.client.1.smithi174.stdout:0/573: dwrite d0/d3/f40 [671744,4096] 0 2024-05-06T14:04:14.378 INFO:tasks.workunit.client.1.smithi174.stdout:5/634: dwrite d1/d6/df/d35/d81/d60/db0/de/f63 [1748992,98304] 0 2024-05-06T14:04:14.384 INFO:tasks.workunit.client.1.smithi174.stdout:1/512: read d11/d1f/f38 [1423393,112660] 0 2024-05-06T14:04:14.384 INFO:tasks.workunit.client.1.smithi174.stdout:1/513: write d11/d67/fad [632253,5788] 0 2024-05-06T14:04:14.384 INFO:tasks.workunit.client.1.smithi174.stdout:1/514: link d11/d1f/f38 d11/d57/d98/daf/db2/fba 0 2024-05-06T14:04:14.385 INFO:tasks.workunit.client.1.smithi174.stdout:1/515: unlink d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/ca3 0 2024-05-06T14:04:14.385 INFO:tasks.workunit.client.1.smithi174.stdout:1/516: write d11/d1f/f38 [1262230,53774] 0 2024-05-06T14:04:14.385 INFO:tasks.workunit.client.1.smithi174.stdout:1/517: creat d11/fbb x:0 0 0 2024-05-06T14:04:14.385 INFO:tasks.workunit.client.1.smithi174.stdout:1/518: write fe [1000994,47221] 0 2024-05-06T14:04:14.467 INFO:tasks.workunit.client.1.smithi174.stdout:1/519: truncate d11/d1f/d27/d32/f4e 320376 0 2024-05-06T14:04:14.467 INFO:tasks.workunit.client.1.smithi174.stdout:1/520: chown d11/d1f/d27/d32/d84/d8c/d94/db0/c7b 378298149 1 2024-05-06T14:04:14.467 INFO:tasks.workunit.client.1.smithi174.stdout:1/521: mkdir d11/d1f/d27/d32/d92/dbc 0 2024-05-06T14:04:14.468 INFO:tasks.workunit.client.1.smithi174.stdout:0/574: dwrite d0/d3/dad/fa9 [557056,69632] 0 2024-05-06T14:04:14.468 INFO:tasks.workunit.client.1.smithi174.stdout:0/575: dread d0/d4/d8/d25/d5c/d4a/f95 [258048,126976] 0 2024-05-06T14:04:14.468 INFO:tasks.workunit.client.1.smithi174.stdout:0/576: chown d0/d3/dad/f62 459089007 1 2024-05-06T14:04:14.508 INFO:tasks.workunit.client.1.smithi174.stdout:2/539: fdatasync d0/d1/d2/d4/d43/f7c 0 2024-05-06T14:04:14.509 INFO:tasks.workunit.client.1.smithi174.stdout:3/534: fsync df/d2d/d4d/f4f 0 2024-05-06T14:04:14.509 INFO:tasks.workunit.client.1.smithi174.stdout:2/540: dread d0/db/f7b [864256,36864] 0 2024-05-06T14:04:14.509 INFO:tasks.workunit.client.1.smithi174.stdout:2/541: stat d0/db/c75 0 2024-05-06T14:04:14.509 INFO:tasks.workunit.client.1.smithi174.stdout:1/522: dwrite d11/d57/f74 [593920,90112] 0 2024-05-06T14:04:14.509 INFO:tasks.workunit.client.1.smithi174.stdout:1/523: write d11/d1f/d27/d2d/f8b [2775,99437] 0 2024-05-06T14:04:14.509 INFO:tasks.workunit.client.1.smithi174.stdout:1/524: unlink d11/d1f/d27/d32/f71 0 2024-05-06T14:04:14.509 INFO:tasks.workunit.client.1.smithi174.stdout:1/525: mknod d11/d1f/d27/d32/d84/d8c/d94/cbd 0 2024-05-06T14:04:14.512 INFO:tasks.workunit.client.1.smithi174.stdout:5/635: dwrite d1/d6/d7/fca [294912,102400] 0 2024-05-06T14:04:14.512 INFO:tasks.workunit.client.1.smithi174.stdout:5/636: getdents d1/d6/d2a 0 2024-05-06T14:04:14.512 INFO:tasks.workunit.client.1.smithi174.stdout:0/577: dwrite d0/d16/f8f [1097728,65536] 0 2024-05-06T14:04:14.512 INFO:tasks.workunit.client.1.smithi174.stdout:0/578: link d0/d1a/d17/d2e/f53 d0/d4/d8/d25/d5c/fbd 0 2024-05-06T14:04:14.512 INFO:tasks.workunit.client.1.smithi174.stdout:0/579: unlink d0/d4/d8/d25/d5c/d44/cb1 0 2024-05-06T14:04:14.512 INFO:tasks.workunit.client.1.smithi174.stdout:0/580: mkdir d0/d4/d80/d93/dbe 0 2024-05-06T14:04:14.513 INFO:tasks.workunit.client.1.smithi174.stdout:0/581: truncate d0/f68 292360 0 2024-05-06T14:04:14.513 INFO:tasks.workunit.client.1.smithi174.stdout:0/582: symlink d0/d4/d8/d25/d5c/d4a/da7/lbf 0 2024-05-06T14:04:14.513 INFO:tasks.workunit.client.1.smithi174.stdout:0/583: stat d0/c94 0 2024-05-06T14:04:14.514 INFO:tasks.workunit.client.1.smithi174.stdout:0/584: truncate d0/d4/d8/d25/d5c/d44/f69 660605 0 2024-05-06T14:04:14.514 INFO:tasks.workunit.client.1.smithi174.stdout:5/637: dwrite d1/d6/d2a/f2d [4071424,73728] 0 2024-05-06T14:04:14.515 INFO:tasks.workunit.client.1.smithi174.stdout:5/638: link d1/d6/df/d35/d81/fc0 d1/d6/d7/da1/d9a/da5/fde 0 2024-05-06T14:04:14.515 INFO:tasks.workunit.client.1.smithi174.stdout:5/639: dread - d1/d6/df/d35/d8b/d9f/fa9 zero size 2024-05-06T14:04:14.515 INFO:tasks.workunit.client.1.smithi174.stdout:5/640: write d1/d6/d7/f2e [835237,36663] 0 2024-05-06T14:04:14.515 INFO:tasks.workunit.client.1.smithi174.stdout:5/641: mkdir d1/ddf 0 2024-05-06T14:04:14.515 INFO:tasks.workunit.client.1.smithi174.stdout:5/642: mkdir d1/d6/df/d35/d81/d60/db0/de/dbd/de0 0 2024-05-06T14:04:14.515 INFO:tasks.workunit.client.1.smithi174.stdout:5/643: write d1/d6/df/d35/d81/f1d [116013,5564] 0 2024-05-06T14:04:14.515 INFO:tasks.workunit.client.1.smithi174.stdout:5/644: readlink d1/d6/df/d35/d81/d60/db0/d41/l49 0 2024-05-06T14:04:14.515 INFO:tasks.workunit.client.1.smithi174.stdout:5/645: write d1/d6/df/d35/d81/fc0 [302036,75894] 0 2024-05-06T14:04:14.516 INFO:tasks.workunit.client.1.smithi174.stdout:5/646: rmdir d1/d6/df/d35 39 2024-05-06T14:04:14.574 INFO:tasks.workunit.client.1.smithi174.stdout:3/535: fdatasync df/d2d/f42 0 2024-05-06T14:04:14.574 INFO:tasks.workunit.client.1.smithi174.stdout:2/542: fdatasync d0/d1/f35 0 2024-05-06T14:04:14.601 INFO:tasks.workunit.client.1.smithi174.stdout:5/647: fsync d1/d6/f34 0 2024-05-06T14:04:14.601 INFO:tasks.workunit.client.1.smithi174.stdout:5/648: readlink d1/d6/d7/d36/d53/d59/d61/d69/dc3/lce 0 2024-05-06T14:04:14.605 INFO:tasks.workunit.client.1.smithi174.stdout:5/649: creat d1/d6/df/d35/d81/d1e/fe1 x:0 0 0 2024-05-06T14:04:14.605 INFO:tasks.workunit.client.1.smithi174.stdout:5/650: mkdir d1/d6/df/de2 0 2024-05-06T14:04:14.606 INFO:tasks.workunit.client.1.smithi174.stdout:5/651: link d1/d6/d7/d36/d53/l76 d1/d6/df/d35/d81/daf/le3 0 2024-05-06T14:04:14.606 INFO:tasks.workunit.client.1.smithi174.stdout:5/652: chown d1/d6/df/d35/d81/d60/db0/d41/c96 878349 1 2024-05-06T14:04:14.606 INFO:tasks.workunit.client.1.smithi174.stdout:3/536: creat df/d2d/d4e/fa8 x:0 0 0 2024-05-06T14:04:14.606 INFO:tasks.workunit.client.1.smithi174.stdout:5/653: write d1/d6/d7/d36/d53/d59/d61/f7e [837519,60572] 0 2024-05-06T14:04:14.606 INFO:tasks.workunit.client.1.smithi174.stdout:3/537: creat df/d10/d1b/d59/fa9 x:0 0 0 2024-05-06T14:04:14.606 INFO:tasks.workunit.client.1.smithi174.stdout:3/538: write df/d2d/f37 [487062,79231] 0 2024-05-06T14:04:14.606 INFO:tasks.workunit.client.1.smithi174.stdout:3/539: write df/d10/d1b/d7e/d57/f8f [65776,78293] 0 2024-05-06T14:04:14.606 INFO:tasks.workunit.client.1.smithi174.stdout:3/540: write df/d10/d1b/d7e/f83 [1288078,78610] 0 2024-05-06T14:04:14.607 INFO:tasks.workunit.client.1.smithi174.stdout:3/541: creat df/d10/faa x:0 0 0 2024-05-06T14:04:14.607 INFO:tasks.workunit.client.1.smithi174.stdout:3/542: dread - df/d10/d1b/f56 zero size 2024-05-06T14:04:14.607 INFO:tasks.workunit.client.1.smithi174.stdout:3/543: mknod df/d2d/d4d/cab 0 2024-05-06T14:04:14.608 INFO:tasks.workunit.client.1.smithi174.stdout:2/543: dwrite d0/d1/f94 [741376,126976] 0 2024-05-06T14:04:14.608 INFO:tasks.workunit.client.1.smithi174.stdout:2/544: symlink d0/d24/d77/d93/la4 0 2024-05-06T14:04:14.608 INFO:tasks.workunit.client.1.smithi174.stdout:5/654: dwrite d1/d6/df/d35/d81/d8d/fb7 [696320,28672] 0 2024-05-06T14:04:14.609 INFO:tasks.workunit.client.1.smithi174.stdout:2/545: symlink d0/d16/la5 0 2024-05-06T14:04:14.609 INFO:tasks.workunit.client.1.smithi174.stdout:5/655: creat d1/d6/df/d35/d81/d8d/fe4 x:0 0 0 2024-05-06T14:04:14.609 INFO:tasks.workunit.client.1.smithi174.stdout:2/546: truncate d0/da/d3f/f71 892256 0 2024-05-06T14:04:14.609 INFO:tasks.workunit.client.1.smithi174.stdout:2/547: mkdir d0/da/d3f/da6 0 2024-05-06T14:04:14.609 INFO:tasks.workunit.client.1.smithi174.stdout:2/548: creat d0/d24/fa7 x:0 0 0 2024-05-06T14:04:14.609 INFO:tasks.workunit.client.1.smithi174.stdout:2/549: creat d0/db/fa8 x:0 0 0 2024-05-06T14:04:14.609 INFO:tasks.workunit.client.1.smithi174.stdout:2/550: creat d0/d1/d2/d2a/fa9 x:0 0 0 2024-05-06T14:04:14.644 INFO:tasks.workunit.client.1.smithi174.stdout:2/551: dwrite d0/d92/f99 [892928,45056] 0 2024-05-06T14:04:14.644 INFO:tasks.workunit.client.1.smithi174.stdout:2/552: dread - d0/d1/d2/d4/d18/d2d/d32/f76 zero size 2024-05-06T14:04:14.645 INFO:tasks.workunit.client.1.smithi174.stdout:2/553: creat d0/d1/faa x:0 0 0 2024-05-06T14:04:14.645 INFO:tasks.workunit.client.1.smithi174.stdout:2/554: creat d0/d1/d2/d4/d18/fab x:0 0 0 2024-05-06T14:04:14.676 INFO:tasks.workunit.client.1.smithi174.stdout:3/544: fdatasync df/d2d/d5b/f71 0 2024-05-06T14:04:14.677 INFO:tasks.workunit.client.1.smithi174.stdout:3/545: truncate df/d10/d1b/d7e/f93 90213 0 2024-05-06T14:04:14.677 INFO:tasks.workunit.client.1.smithi174.stdout:3/546: creat df/d2d/d4e/fac x:0 0 0 2024-05-06T14:04:14.677 INFO:tasks.workunit.client.1.smithi174.stdout:1/526: fdatasync d11/d1f/d27/d2d/f8b 0 2024-05-06T14:04:14.677 INFO:tasks.workunit.client.1.smithi174.stdout:1/527: mknod d11/d1f/d27/d32/d84/cbe 0 2024-05-06T14:04:14.677 INFO:tasks.workunit.client.1.smithi174.stdout:1/528: unlink d11/d1f/d27/d32/d84/cbe 0 2024-05-06T14:04:14.677 INFO:tasks.workunit.client.1.smithi174.stdout:1/529: mknod d11/d1f/d27/d32/d92/cbf 0 2024-05-06T14:04:14.682 INFO:tasks.workunit.client.1.smithi174.stdout:5/656: fdatasync d1/d6/df/f30 0 2024-05-06T14:04:14.684 INFO:tasks.workunit.client.1.smithi174.stdout:5/657: truncate d1/d6/df/d35/d81/d60/db0/de/f26 2005371 0 2024-05-06T14:04:14.684 INFO:tasks.workunit.client.1.smithi174.stdout:3/547: unlink df/d10/d1b/f9f 0 2024-05-06T14:04:14.730 INFO:tasks.workunit.client.1.smithi174.stdout:5/658: fdatasync d1/d6/df/d35/d81/d60/db0/de/f3f 0 2024-05-06T14:04:14.731 INFO:tasks.workunit.client.1.smithi174.stdout:1/530: fdatasync d11/d57/d83/f97 0 2024-05-06T14:04:14.734 INFO:tasks.workunit.client.1.smithi174.stdout:1/531: mkdir d11/d1f/d27/d32/d92/dc0 0 2024-05-06T14:04:14.734 INFO:tasks.workunit.client.1.smithi174.stdout:3/548: rename df/d10/d1b/c96 to df/d2d/d87/cad 0 2024-05-06T14:04:14.735 INFO:tasks.workunit.client.1.smithi174.stdout:1/532: mknod d11/d1f/cc1 0 2024-05-06T14:04:14.735 INFO:tasks.workunit.client.1.smithi174.stdout:1/533: dread d11/d1f/d27/d2d/f43 [282624,45056] 0 2024-05-06T14:04:14.735 INFO:tasks.workunit.client.1.smithi174.stdout:1/534: symlink d11/d1f/d27/d32/d84/lc2 0 2024-05-06T14:04:14.735 INFO:tasks.workunit.client.1.smithi174.stdout:1/535: getdents d11/d41/d4a/d5e/db6 0 2024-05-06T14:04:14.735 INFO:tasks.workunit.client.1.smithi174.stdout:1/536: link d11/d1f/d27/d32/d84/d8c/d94/db0/l5f d11/d41/lc3 0 2024-05-06T14:04:14.737 INFO:tasks.workunit.client.1.smithi174.stdout:5/659: dwrite d1/d6/d7/fca [1249280,90112] 0 2024-05-06T14:04:14.737 INFO:tasks.workunit.client.1.smithi174.stdout:5/660: truncate d1/d6/df/d35/d81/d60/db0/de/f80 1914831 0 2024-05-06T14:04:14.737 INFO:tasks.workunit.client.1.smithi174.stdout:5/661: mkdir d1/d6/df/d35/d81/daf/de5 0 2024-05-06T14:04:14.737 INFO:tasks.workunit.client.1.smithi174.stdout:5/662: chown d1/d6/df/f79 169417509 1 2024-05-06T14:04:14.737 INFO:tasks.workunit.client.1.smithi174.stdout:1/537: dwrite f1 [2469888,61440] 0 2024-05-06T14:04:14.737 INFO:tasks.workunit.client.1.smithi174.stdout:1/538: unlink d11/d1f/d27/d32/d84/d8c/c95 0 2024-05-06T14:04:14.738 INFO:tasks.workunit.client.1.smithi174.stdout:1/539: write d11/d1f/d27/d32/d92/fac [1481073,96363] 0 2024-05-06T14:04:14.738 INFO:tasks.workunit.client.1.smithi174.stdout:1/540: write d11/d41/f85 [1188716,3087] 0 2024-05-06T14:04:14.738 INFO:tasks.workunit.client.1.smithi174.stdout:1/541: creat d11/d1f/fc4 x:0 0 0 2024-05-06T14:04:14.738 INFO:tasks.workunit.client.1.smithi174.stdout:1/542: symlink d11/d57/d83/lc5 0 2024-05-06T14:04:14.738 INFO:tasks.workunit.client.1.smithi174.stdout:1/543: mknod d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/cc6 0 2024-05-06T14:04:14.786 INFO:tasks.workunit.client.1.smithi174.stdout:5/663: write d1/d6/d7/d36/f2c [2517160,81354] 0 2024-05-06T14:04:14.786 INFO:tasks.workunit.client.1.smithi174.stdout:5/664: truncate d1/d6/d7/d36/f7f 298103 0 2024-05-06T14:04:14.786 INFO:tasks.workunit.client.1.smithi174.stdout:5/665: dread - d1/d6/d7/da1/fda zero size 2024-05-06T14:04:14.786 INFO:tasks.workunit.client.1.smithi174.stdout:5/666: symlink d1/d6/d7/d36/d53/d59/d61/d69/le6 0 2024-05-06T14:04:14.787 INFO:tasks.workunit.client.1.smithi174.stdout:5/667: truncate d1/d6/f34 125862 0 2024-05-06T14:04:14.838 INFO:tasks.workunit.client.1.smithi174.stdout:1/544: fdatasync d11/d41/d4a/f81 0 2024-05-06T14:04:14.838 INFO:tasks.workunit.client.1.smithi174.stdout:1/545: dread d11/d1f/d27/d2d/f3a [983040,8192] 0 2024-05-06T14:04:14.838 INFO:tasks.workunit.client.1.smithi174.stdout:1/546: getdents d11/d1f/d27/d2d/d9c 0 2024-05-06T14:04:14.838 INFO:tasks.workunit.client.1.smithi174.stdout:1/547: truncate d11/d67/fad 1010800 0 2024-05-06T14:04:14.839 INFO:tasks.workunit.client.1.smithi174.stdout:1/548: write d11/d41/d4a/f56 [1432568,27313] 0 2024-05-06T14:04:14.839 INFO:tasks.workunit.client.1.smithi174.stdout:5/668: dwrite d1/d6/df/d35/d81/d60/db0/f28 [1052672,32768] 0 2024-05-06T14:04:14.855 INFO:tasks.workunit.client.1.smithi174.stdout:8/634: sync 2024-05-06T14:04:14.856 INFO:tasks.workunit.client.1.smithi174.stdout:6/663: sync 2024-05-06T14:04:14.856 INFO:tasks.workunit.client.1.smithi174.stdout:4/624: sync 2024-05-06T14:04:14.856 INFO:tasks.workunit.client.1.smithi174.stdout:7/481: sync 2024-05-06T14:04:14.856 INFO:tasks.workunit.client.1.smithi174.stdout:6/664: read - d0/d25/d52/d2c/d6f/f71 zero size 2024-05-06T14:04:14.856 INFO:tasks.workunit.client.1.smithi174.stdout:4/625: dread d1/d1f/dd6/f4f [2318336,69632] 0 2024-05-06T14:04:14.856 INFO:tasks.workunit.client.1.smithi174.stdout:4/626: stat d1/f19 0 2024-05-06T14:04:14.856 INFO:tasks.workunit.client.1.smithi174.stdout:4/627: chown d1/d1f/d27/d84/f96 13 1 2024-05-06T14:04:14.857 INFO:tasks.workunit.client.1.smithi174.stdout:6/665: write d0/df/f14 [1641765,11660] 0 2024-05-06T14:04:14.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/635: symlink d4/de/d23/d3c/db2/da6/ld5 0 2024-05-06T14:04:14.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/636: creat d4/d15/d20/fd6 x:0 0 0 2024-05-06T14:04:14.857 INFO:tasks.workunit.client.1.smithi174.stdout:6/666: write d0/d25/d35/f4d [835801,105135] 0 2024-05-06T14:04:14.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/637: getdents d4/de/d23/d3c/db2/da6 0 2024-05-06T14:04:14.857 INFO:tasks.workunit.client.1.smithi174.stdout:6/667: rmdir d0/df/d45/d56 39 2024-05-06T14:04:14.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/638: creat d4/de/d24/d5e/fd7 x:0 0 0 2024-05-06T14:04:14.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/639: mknod d4/de/d23/d3c/cd8 0 2024-05-06T14:04:14.858 INFO:tasks.workunit.client.1.smithi174.stdout:6/668: write d0/df/f5e [100085,130073] 0 2024-05-06T14:04:14.858 INFO:tasks.workunit.client.1.smithi174.stdout:8/640: dread d4/d53/f76 [0,81920] 0 2024-05-06T14:04:14.858 INFO:tasks.workunit.client.1.smithi174.stdout:6/669: rename d0/d25/d52/d2c/ld6 to d0/df/d45/d56/ld9 0 2024-05-06T14:04:14.858 INFO:tasks.workunit.client.1.smithi174.stdout:6/670: mknod d0/df/d45/cda 0 2024-05-06T14:04:14.858 INFO:tasks.workunit.client.1.smithi174.stdout:8/641: creat d4/de/d23/d3c/db2/da6/fd9 x:0 0 0 2024-05-06T14:04:14.858 INFO:tasks.workunit.client.1.smithi174.stdout:6/671: symlink d0/d25/d52/d2c/d5f/dc9/ldb 0 2024-05-06T14:04:14.858 INFO:tasks.workunit.client.1.smithi174.stdout:8/642: symlink d4/de/lda 0 2024-05-06T14:04:14.858 INFO:tasks.workunit.client.1.smithi174.stdout:8/643: chown d4/de/d24/d5e/d85/d91/c9b 0 1 2024-05-06T14:04:14.859 INFO:tasks.workunit.client.1.smithi174.stdout:8/644: rmdir d4/de/d23/d41/d4e 39 2024-05-06T14:04:14.859 INFO:tasks.workunit.client.1.smithi174.stdout:8/645: creat d4/de/d23/d3c/fdb x:0 0 0 2024-05-06T14:04:14.859 INFO:tasks.workunit.client.1.smithi174.stdout:8/646: dread d4/d15/d20/f5f [45056,98304] 0 2024-05-06T14:04:14.859 INFO:tasks.workunit.client.1.smithi174.stdout:8/647: mknod d4/de/d23/cdc 0 2024-05-06T14:04:14.859 INFO:tasks.workunit.client.1.smithi174.stdout:8/648: creat d4/d15/d20/fdd x:0 0 0 2024-05-06T14:04:14.859 INFO:tasks.workunit.client.1.smithi174.stdout:8/649: chown d4/de/f17 66 1 2024-05-06T14:04:14.981 INFO:tasks.workunit.client.1.smithi174.stdout:4/628: dwrite d1/d9/f22 [1363968,12288] 0 2024-05-06T14:04:14.981 INFO:tasks.workunit.client.1.smithi174.stdout:4/629: unlink d1/d9/d15/d35/dd9/f69 0 2024-05-06T14:04:14.990 INFO:tasks.workunit.client.1.smithi174.stdout:6/672: read d0/df/f14 [783509,40930] 0 2024-05-06T14:04:14.991 INFO:tasks.workunit.client.1.smithi174.stdout:6/673: write d0/df/f24 [3229467,57956] 0 2024-05-06T14:04:14.991 INFO:tasks.workunit.client.1.smithi174.stdout:6/674: truncate d0/d25/d52/d2c/fa8 897764 0 2024-05-06T14:04:14.991 INFO:tasks.workunit.client.1.smithi174.stdout:6/675: chown d0/d25/f98 12926092 1 2024-05-06T14:04:14.991 INFO:tasks.workunit.client.1.smithi174.stdout:6/676: creat d0/d25/fdc x:0 0 0 2024-05-06T14:04:14.991 INFO:tasks.workunit.client.1.smithi174.stdout:6/677: mknod d0/df/d45/d56/cdd 0 2024-05-06T14:04:14.991 INFO:tasks.workunit.client.1.smithi174.stdout:6/678: symlink d0/d25/d52/d2c/d6f/lde 0 2024-05-06T14:04:14.991 INFO:tasks.workunit.client.1.smithi174.stdout:6/679: mkdir d0/df/d45/d85/ddf 0 2024-05-06T14:04:14.992 INFO:tasks.workunit.client.1.smithi174.stdout:6/680: truncate d0/d25/f98 1454404 0 2024-05-06T14:04:14.992 INFO:tasks.workunit.client.1.smithi174.stdout:8/650: read d4/d15/d20/d3e/f93 [302002,72793] 0 2024-05-06T14:04:14.992 INFO:tasks.workunit.client.1.smithi174.stdout:8/651: stat d4/de/d23/d3c/c4b 0 2024-05-06T14:04:14.997 INFO:tasks.workunit.client.1.smithi174.stdout:7/482: dread d0/f34 [4050944,57344] 0 2024-05-06T14:04:14.997 INFO:tasks.workunit.client.1.smithi174.stdout:7/483: chown d0/d1d/da4/d61/d19/d24/d47 62 1 2024-05-06T14:04:15.022 INFO:tasks.workunit.client.1.smithi174.stdout:6/681: dwrite d0/fd2 [856064,20480] 0 2024-05-06T14:04:15.022 INFO:tasks.workunit.client.1.smithi174.stdout:6/682: truncate d0/fc4 256313 0 2024-05-06T14:04:15.022 INFO:tasks.workunit.client.1.smithi174.stdout:6/683: symlink d0/df/d45/dcf/le0 0 2024-05-06T14:04:15.022 INFO:tasks.workunit.client.1.smithi174.stdout:6/684: truncate d0/d25/d35/f9b 839968 0 2024-05-06T14:04:15.022 INFO:tasks.workunit.client.1.smithi174.stdout:6/685: readlink d0/d25/d52/d2c/d6f/lde 0 2024-05-06T14:04:15.023 INFO:tasks.workunit.client.1.smithi174.stdout:6/686: chown d0/l9 36726 1 2024-05-06T14:04:15.023 INFO:tasks.workunit.client.1.smithi174.stdout:6/687: readlink d0/df/d45/dcf/le0 0 2024-05-06T14:04:15.023 INFO:tasks.workunit.client.1.smithi174.stdout:4/630: write d1/f19 [1778895,56766] 0 2024-05-06T14:04:15.023 INFO:tasks.workunit.client.1.smithi174.stdout:4/631: truncate d1/d1f/d27/d2c/f3f 1234748 0 2024-05-06T14:04:15.023 INFO:tasks.workunit.client.1.smithi174.stdout:4/632: read d1/d1f/dd6/f75 [183700,11099] 0 2024-05-06T14:04:15.024 INFO:tasks.workunit.client.1.smithi174.stdout:4/633: dwrite d1/d1f/dd6/d6e/d50/f5c [241664,86016] 0 2024-05-06T14:04:15.024 INFO:tasks.workunit.client.1.smithi174.stdout:4/634: chown d1/d48/d5a/d61/d68/f7d 8571 1 2024-05-06T14:04:15.030 INFO:tasks.workunit.client.1.smithi174.stdout:6/688: dread d0/df/d45/d85/fb2 [212992,90112] 0 2024-05-06T14:04:15.036 INFO:tasks.workunit.client.1.smithi174.stdout:6/689: creat d0/df/d45/dcf/fe1 x:0 0 0 2024-05-06T14:04:15.036 INFO:tasks.workunit.client.1.smithi174.stdout:4/635: dwrite d1/fc [1003520,40960] 0 2024-05-06T14:04:15.037 INFO:tasks.workunit.client.1.smithi174.stdout:6/690: truncate d0/d25/d35/f9e 1332460 0 2024-05-06T14:04:15.037 INFO:tasks.workunit.client.1.smithi174.stdout:6/691: read d0/d25/d52/d3b/f95 [59505,1250] 0 2024-05-06T14:04:15.037 INFO:tasks.workunit.client.1.smithi174.stdout:4/636: dread d1/d9/d15/d98/f66 [483328,81920] 0 2024-05-06T14:04:15.037 INFO:tasks.workunit.client.1.smithi174.stdout:4/637: chown d1/d9 3155732 1 2024-05-06T14:04:15.037 INFO:tasks.workunit.client.1.smithi174.stdout:4/638: unlink d1/d9/d15/d35/c71 0 2024-05-06T14:04:15.203 INFO:tasks.workunit.client.1.smithi174.stdout:6/692: dwrite d0/f7c [2220032,86016] 0 2024-05-06T14:04:15.204 INFO:tasks.workunit.client.1.smithi174.stdout:6/693: creat d0/d93/fe2 x:0 0 0 2024-05-06T14:04:15.204 INFO:tasks.workunit.client.1.smithi174.stdout:6/694: mkdir d0/d25/d35/de3 0 2024-05-06T14:04:15.204 INFO:tasks.workunit.client.1.smithi174.stdout:4/639: dwrite d1/f19 [1712128,20480] 0 2024-05-06T14:04:15.205 INFO:tasks.workunit.client.1.smithi174.stdout:6/695: write d0/d25/d52/d2c/fa8 [1739095,10162] 0 2024-05-06T14:04:15.205 INFO:tasks.workunit.client.1.smithi174.stdout:4/640: write d1/d9/d15/d98/fb3 [973701,12432] 0 2024-05-06T14:04:15.205 INFO:tasks.workunit.client.1.smithi174.stdout:6/696: rmdir d0/df/d45/d4b 39 2024-05-06T14:04:15.205 INFO:tasks.workunit.client.1.smithi174.stdout:6/697: truncate d0/d25/d52/d2c/d6f/f71 581382 0 2024-05-06T14:04:15.205 INFO:tasks.workunit.client.1.smithi174.stdout:4/641: mknod d1/d48/ce2 0 2024-05-06T14:04:15.205 INFO:tasks.workunit.client.1.smithi174.stdout:4/642: getdents d1/d9 0 2024-05-06T14:04:15.206 INFO:tasks.workunit.client.1.smithi174.stdout:4/643: mknod d1/d1f/ce3 0 2024-05-06T14:04:15.223 INFO:tasks.workunit.client.1.smithi174.stdout:4/644: fdatasync d1/d1f/dd6/d6e/d50/db0/fd7 0 2024-05-06T14:04:15.225 INFO:tasks.workunit.client.1.smithi174.stdout:4/645: unlink d1/d48/l80 0 2024-05-06T14:04:15.225 INFO:tasks.workunit.client.1.smithi174.stdout:4/646: getdents d1/d9 0 2024-05-06T14:04:15.226 INFO:tasks.workunit.client.1.smithi174.stdout:4/647: write d1/d1f/dd6/d6e/d50/db0/fd7 [2160053,79279] 0 2024-05-06T14:04:15.226 INFO:tasks.workunit.client.1.smithi174.stdout:4/648: symlink d1/d9/d15/d98/le4 0 2024-05-06T14:04:15.226 INFO:tasks.workunit.client.1.smithi174.stdout:4/649: symlink d1/d48/le5 0 2024-05-06T14:04:15.226 INFO:tasks.workunit.client.1.smithi174.stdout:4/650: creat d1/d1f/d89/fe6 x:0 0 0 2024-05-06T14:04:15.226 INFO:tasks.workunit.client.1.smithi174.stdout:4/651: creat d1/d1f/d27/d2c/ddd/fe7 x:0 0 0 2024-05-06T14:04:15.226 INFO:tasks.workunit.client.1.smithi174.stdout:4/652: write d1/d9/d15/d98/f28 [2156003,111043] 0 2024-05-06T14:04:15.383 INFO:tasks.workunit.client.1.smithi174.stdout:2/555: sync 2024-05-06T14:04:15.383 INFO:tasks.workunit.client.1.smithi174.stdout:8/652: sync 2024-05-06T14:04:15.384 INFO:tasks.workunit.client.1.smithi174.stdout:7/484: sync 2024-05-06T14:04:15.384 INFO:tasks.workunit.client.1.smithi174.stdout:7/485: chown d0/d1d/da4/d61/d28/d37 0 1 2024-05-06T14:04:15.384 INFO:tasks.workunit.client.1.smithi174.stdout:3/549: sync 2024-05-06T14:04:15.384 INFO:tasks.workunit.client.1.smithi174.stdout:0/585: sync 2024-05-06T14:04:15.384 INFO:tasks.workunit.client.1.smithi174.stdout:2/556: creat d0/da/d3f/fac x:0 0 0 2024-05-06T14:04:15.384 INFO:tasks.workunit.client.1.smithi174.stdout:1/549: sync 2024-05-06T14:04:15.384 INFO:tasks.workunit.client.1.smithi174.stdout:2/557: rmdir d0/d1/d2/d4/d43 39 2024-05-06T14:04:15.385 INFO:tasks.workunit.client.1.smithi174.stdout:5/669: sync 2024-05-06T14:04:15.385 INFO:tasks.workunit.client.1.smithi174.stdout:2/558: dread - d0/d1/d2/d4/d18/f6d zero size 2024-05-06T14:04:15.385 INFO:tasks.workunit.client.1.smithi174.stdout:0/586: readlink d0/d1a/d17/d2e/d58/la8 0 2024-05-06T14:04:15.385 INFO:tasks.workunit.client.1.smithi174.stdout:5/670: stat d1/d6/d7/d36/d53/d59/f7a 0 2024-05-06T14:04:15.385 INFO:tasks.workunit.client.1.smithi174.stdout:7/486: symlink d0/la7 0 2024-05-06T14:04:15.385 INFO:tasks.workunit.client.1.smithi174.stdout:1/550: rename d11/d1f/d27/d32/d84/d8c/d94/cbd to d11/d1f/d27/d32/d84/d8c/d94/db0/cc7 0 2024-05-06T14:04:15.385 INFO:tasks.workunit.client.1.smithi174.stdout:2/559: link d0/d1/d2/d4/d6/l79 d0/d1/d2/d4/d43/lad 0 2024-05-06T14:04:15.386 INFO:tasks.workunit.client.1.smithi174.stdout:5/671: dread d1/d6/f54 [28672,73728] 0 2024-05-06T14:04:15.386 INFO:tasks.workunit.client.1.smithi174.stdout:7/487: mknod d0/d1d/da4/d61/d19/d24/d6f/ca8 0 2024-05-06T14:04:15.386 INFO:tasks.workunit.client.1.smithi174.stdout:8/653: dread d4/de/d24/f33 [1482752,126976] 0 2024-05-06T14:04:15.386 INFO:tasks.workunit.client.1.smithi174.stdout:9/561: sync 2024-05-06T14:04:15.386 INFO:tasks.workunit.client.1.smithi174.stdout:5/672: mkdir d1/d6/d7/da1/dd8/de7 0 2024-05-06T14:04:15.386 INFO:tasks.workunit.client.1.smithi174.stdout:9/562: symlink dc/lbd 0 2024-05-06T14:04:15.386 INFO:tasks.workunit.client.1.smithi174.stdout:8/654: symlink d4/de/d23/d3c/db2/lde 0 2024-05-06T14:04:15.387 INFO:tasks.workunit.client.1.smithi174.stdout:7/488: write d0/d1d/da4/d61/d19/d24/d14/f6d [991321,59325] 0 2024-05-06T14:04:15.387 INFO:tasks.workunit.client.1.smithi174.stdout:5/673: truncate d1/d6/df/d35/d81/f1d 941127 0 2024-05-06T14:04:15.387 INFO:tasks.workunit.client.1.smithi174.stdout:5/674: read - d1/d6/d7/d36/d53/fd5 zero size 2024-05-06T14:04:15.387 INFO:tasks.workunit.client.1.smithi174.stdout:8/655: link d4/de/d23/d3c/laf d4/de/d23/ldf 0 2024-05-06T14:04:15.387 INFO:tasks.workunit.client.1.smithi174.stdout:8/656: readlink d4/d15/d66/l75 0 2024-05-06T14:04:15.387 INFO:tasks.workunit.client.1.smithi174.stdout:5/675: chown d1/d6/df/d35/d81/d60/db0/d41/fcf 413 1 2024-05-06T14:04:15.387 INFO:tasks.workunit.client.1.smithi174.stdout:8/657: chown d4/d15/d20/fdd 18695 1 2024-05-06T14:04:15.388 INFO:tasks.workunit.client.1.smithi174.stdout:7/489: creat d0/d1d/da4/d61/d19/d24/d47/d64/fa9 x:0 0 0 2024-05-06T14:04:15.388 INFO:tasks.workunit.client.1.smithi174.stdout:3/550: write df/d2d/d4e/fa8 [35609,128991] 0 2024-05-06T14:04:15.388 INFO:tasks.workunit.client.1.smithi174.stdout:5/676: dread d1/d6/df/d35/d81/d60/db0/de/f3f [1183744,65536] 0 2024-05-06T14:04:15.388 INFO:tasks.workunit.client.1.smithi174.stdout:8/658: getdents d4/d15/d20/d3e/d79/dcc 0 2024-05-06T14:04:15.388 INFO:tasks.workunit.client.1.smithi174.stdout:8/659: dread - d4/de/d24/d46/f61 zero size 2024-05-06T14:04:15.388 INFO:tasks.workunit.client.1.smithi174.stdout:5/677: link d1/d6/df/d35/d81/d60/db0/de/f26 d1/d6/d7/d36/fe8 0 2024-05-06T14:04:15.388 INFO:tasks.workunit.client.1.smithi174.stdout:9/563: write dc/d17/d4c/fba [751723,55538] 0 2024-05-06T14:04:15.388 INFO:tasks.workunit.client.1.smithi174.stdout:3/551: creat df/d10/da2/fae x:0 0 0 2024-05-06T14:04:15.389 INFO:tasks.workunit.client.1.smithi174.stdout:7/490: symlink d0/d1d/da4/d61/d19/d24/d47/laa 0 2024-05-06T14:04:15.419 INFO:tasks.workunit.client.1.smithi174.stdout:1/551: fdatasync f1 0 2024-05-06T14:04:15.419 INFO:tasks.workunit.client.1.smithi174.stdout:2/560: fdatasync d0/da/d3f/d67/f80 0 2024-05-06T14:04:15.419 INFO:tasks.workunit.client.1.smithi174.stdout:1/552: unlink d11/d1f/d27/d32/f4b 0 2024-05-06T14:04:15.420 INFO:tasks.workunit.client.1.smithi174.stdout:0/587: dwrite d0/d1a/d17/d2e/f5f [1384448,69632] 0 2024-05-06T14:04:15.420 INFO:tasks.workunit.client.1.smithi174.stdout:0/588: unlink d0/d4/d8/d25/l27 0 2024-05-06T14:04:15.420 INFO:tasks.workunit.client.1.smithi174.stdout:0/589: creat d0/d1a/d17/d2e/fc0 x:0 0 0 2024-05-06T14:04:15.423 INFO:tasks.workunit.client.1.smithi174.stdout:5/678: dwrite d1/d6/df/d35/d81/f1d [561152,4096] 0 2024-05-06T14:04:15.423 INFO:tasks.workunit.client.1.smithi174.stdout:3/552: dwrite df/d10/d1b/d7e/d5a/f77 [679936,16384] 0 2024-05-06T14:04:15.423 INFO:tasks.workunit.client.1.smithi174.stdout:3/553: unlink df/d10/l47 0 2024-05-06T14:04:15.423 INFO:tasks.workunit.client.1.smithi174.stdout:0/590: mknod d0/d36/d3f/cc1 0 2024-05-06T14:04:15.424 INFO:tasks.workunit.client.1.smithi174.stdout:8/660: mknod d4/d53/ce0 0 2024-05-06T14:04:15.424 INFO:tasks.workunit.client.1.smithi174.stdout:9/564: creat dc/de/d7f/d93/fbe x:0 0 0 2024-05-06T14:04:15.424 INFO:tasks.workunit.client.1.smithi174.stdout:2/561: mknod d0/d1/d2/d1b/d90/cae 0 2024-05-06T14:04:15.424 INFO:tasks.workunit.client.1.smithi174.stdout:9/565: unlink dc/df/l33 0 2024-05-06T14:04:15.424 INFO:tasks.workunit.client.1.smithi174.stdout:8/661: truncate d4/de/d24/d5e/d85/d91/fae 1707383 0 2024-05-06T14:04:15.424 INFO:tasks.workunit.client.1.smithi174.stdout:2/562: creat d0/d1/d2/d4/d18/d2d/d32/d89/faf x:0 0 0 2024-05-06T14:04:15.424 INFO:tasks.workunit.client.1.smithi174.stdout:2/563: symlink d0/d16/lb0 0 2024-05-06T14:04:15.425 INFO:tasks.workunit.client.1.smithi174.stdout:8/662: write d4/d15/fd2 [998813,54961] 0 2024-05-06T14:04:15.425 INFO:tasks.workunit.client.1.smithi174.stdout:2/564: unlink d0/d1/d2/d4/d18/d2d/d32/f76 0 2024-05-06T14:04:15.425 INFO:tasks.workunit.client.1.smithi174.stdout:8/663: read d4/de/f12 [1044396,88903] 0 2024-05-06T14:04:15.425 INFO:tasks.workunit.client.1.smithi174.stdout:2/565: mknod d0/d1/d2/d2a/cb1 0 2024-05-06T14:04:15.425 INFO:tasks.workunit.client.1.smithi174.stdout:2/566: creat d0/d16/fb2 x:0 0 0 2024-05-06T14:04:15.425 INFO:tasks.workunit.client.1.smithi174.stdout:5/679: mknod d1/d6/df/ce9 0 2024-05-06T14:04:15.425 INFO:tasks.workunit.client.1.smithi174.stdout:5/680: chown d1/d6/d7/d36/d53/d59/d61/d69/f91 242 1 2024-05-06T14:04:15.425 INFO:tasks.workunit.client.1.smithi174.stdout:8/664: write d4/f35 [489217,86119] 0 2024-05-06T14:04:15.425 INFO:tasks.workunit.client.1.smithi174.stdout:5/681: creat d1/d6/df/d35/d8b/fea x:0 0 0 2024-05-06T14:04:15.426 INFO:tasks.workunit.client.1.smithi174.stdout:8/665: symlink d4/de/d24/le1 0 2024-05-06T14:04:15.431 INFO:tasks.workunit.client.1.smithi174.stdout:3/554: rename df/d10/d1b/d7e/f93 to df/d2d/d4d/faf 0 2024-05-06T14:04:15.431 INFO:tasks.workunit.client.1.smithi174.stdout:9/566: rename dc/df/l49 to dc/d1c/lbf 0 2024-05-06T14:04:15.431 INFO:tasks.workunit.client.1.smithi174.stdout:8/666: rename d4/de/d24/d5e/d85/d91/fae to d4/d15/d20/d3e/d79/dbf/fe2 0 2024-05-06T14:04:15.431 INFO:tasks.workunit.client.1.smithi174.stdout:9/567: mknod dc/d17/d3a/cc0 0 2024-05-06T14:04:15.431 INFO:tasks.workunit.client.1.smithi174.stdout:3/555: write df/f55 [1899964,43617] 0 2024-05-06T14:04:15.431 INFO:tasks.workunit.client.1.smithi174.stdout:8/667: creat d4/de/d23/d41/d4e/fe3 x:0 0 0 2024-05-06T14:04:15.431 INFO:tasks.workunit.client.1.smithi174.stdout:8/668: stat d4/de/d23/l96 0 2024-05-06T14:04:15.432 INFO:tasks.workunit.client.1.smithi174.stdout:8/669: dread - d4/de/d24/d5e/d85/d91/fbe zero size 2024-05-06T14:04:15.432 INFO:tasks.workunit.client.1.smithi174.stdout:9/568: write dc/f42 [942168,34603] 0 2024-05-06T14:04:15.432 INFO:tasks.workunit.client.1.smithi174.stdout:8/670: write d4/d15/f16 [1294870,35860] 0 2024-05-06T14:04:15.432 INFO:tasks.workunit.client.1.smithi174.stdout:9/569: mkdir dc/de/d6b/dc1 0 2024-05-06T14:04:15.432 INFO:tasks.workunit.client.1.smithi174.stdout:8/671: readlink d4/d15/l18 0 2024-05-06T14:04:15.432 INFO:tasks.workunit.client.1.smithi174.stdout:8/672: getdents d4/de/d23/d41 0 2024-05-06T14:04:15.432 INFO:tasks.workunit.client.1.smithi174.stdout:9/570: unlink dc/df/l23 0 2024-05-06T14:04:15.433 INFO:tasks.workunit.client.1.smithi174.stdout:8/673: unlink d4/de/d24/d46/f61 0 2024-05-06T14:04:15.433 INFO:tasks.workunit.client.1.smithi174.stdout:9/571: write dc/f4e [1602960,52137] 0 2024-05-06T14:04:15.433 INFO:tasks.workunit.client.1.smithi174.stdout:8/674: symlink d4/de/d23/le4 0 2024-05-06T14:04:15.433 INFO:tasks.workunit.client.1.smithi174.stdout:8/675: rmdir d4/de/d23/d41 39 2024-05-06T14:04:15.433 INFO:tasks.workunit.client.1.smithi174.stdout:8/676: write d4/d53/f76 [119178,96118] 0 2024-05-06T14:04:15.433 INFO:tasks.workunit.client.1.smithi174.stdout:8/677: unlink d4/de/c38 0 2024-05-06T14:04:15.433 INFO:tasks.workunit.client.1.smithi174.stdout:8/678: unlink d4/de/d23/d3c/db2/da6/ld5 0 2024-05-06T14:04:15.433 INFO:tasks.workunit.client.1.smithi174.stdout:8/679: dread d4/de/fa3 [32768,86016] 0 2024-05-06T14:04:15.434 INFO:tasks.workunit.client.1.smithi174.stdout:4/653: sync 2024-05-06T14:04:15.434 INFO:tasks.workunit.client.1.smithi174.stdout:6/698: sync 2024-05-06T14:04:15.434 INFO:tasks.workunit.client.1.smithi174.stdout:6/699: dread - d0/d25/d52/dba/fd3 zero size 2024-05-06T14:04:15.434 INFO:tasks.workunit.client.1.smithi174.stdout:4/654: unlink d1/d48/d5a/d61/d68/f7d 0 2024-05-06T14:04:15.434 INFO:tasks.workunit.client.1.smithi174.stdout:4/655: link d1/d2e/l34 d1/d48/d5a/d61/le8 0 2024-05-06T14:04:15.434 INFO:tasks.workunit.client.1.smithi174.stdout:6/700: dread d0/fc4 [192512,126976] 0 2024-05-06T14:04:15.435 INFO:tasks.workunit.client.1.smithi174.stdout:1/553: dwrite d11/d57/d98/daf/d9b/fa0 [180224,40960] 0 2024-05-06T14:04:15.435 INFO:tasks.workunit.client.1.smithi174.stdout:6/701: symlink d0/d25/d52/d2c/d6f/dc3/le4 0 2024-05-06T14:04:15.435 INFO:tasks.workunit.client.1.smithi174.stdout:6/702: dread d0/fd2 [409600,28672] 0 2024-05-06T14:04:15.435 INFO:tasks.workunit.client.1.smithi174.stdout:6/703: rename d0/df/d45/d4b/cd0 to d0/df/d45/d4b/ce5 0 2024-05-06T14:04:15.435 INFO:tasks.workunit.client.1.smithi174.stdout:6/704: dread d0/df/d3c/f9f [1667072,73728] 0 2024-05-06T14:04:15.435 INFO:tasks.workunit.client.1.smithi174.stdout:6/705: rename d0/c2a to d0/d25/d52/d2c/d6f/ce6 0 2024-05-06T14:04:15.435 INFO:tasks.workunit.client.1.smithi174.stdout:6/706: mknod d0/d25/d35/ce7 0 2024-05-06T14:04:15.435 INFO:tasks.workunit.client.1.smithi174.stdout:6/707: write d0/df/d45/d4b/f82 [948159,28503] 0 2024-05-06T14:04:15.436 INFO:tasks.workunit.client.1.smithi174.stdout:6/708: write d0/d25/f40 [7182,79660] 0 2024-05-06T14:04:15.436 INFO:tasks.workunit.client.1.smithi174.stdout:6/709: mknod d0/d25/d52/d2c/d5f/dc9/ce8 0 2024-05-06T14:04:15.436 INFO:tasks.workunit.client.1.smithi174.stdout:5/682: dwrite d1/d6/d7/d3e/f77 [548864,65536] 0 2024-05-06T14:04:15.436 INFO:tasks.workunit.client.1.smithi174.stdout:3/556: dwrite df/d10/d1b/f5c [1957888,45056] 0 2024-05-06T14:04:15.436 INFO:tasks.workunit.client.1.smithi174.stdout:4/656: dwrite d1/d9/d15/f4e [1105920,102400] 0 2024-05-06T14:04:15.436 INFO:tasks.workunit.client.1.smithi174.stdout:2/567: dwrite d0/d16/fb2 [806912,86016] 0 2024-05-06T14:04:15.436 INFO:tasks.workunit.client.1.smithi174.stdout:3/557: chown df/d2d/l50 48869 1 2024-05-06T14:04:15.436 INFO:tasks.workunit.client.1.smithi174.stdout:3/558: creat df/d2d/d4d/da5/fb0 x:0 0 0 2024-05-06T14:04:15.437 INFO:tasks.workunit.client.1.smithi174.stdout:4/657: creat d1/d9/d15/d41/fe9 x:0 0 0 2024-05-06T14:04:15.437 INFO:tasks.workunit.client.1.smithi174.stdout:2/568: rename d0/db/c5b to d0/d1/d2/d4/d18/d97/cb3 0 2024-05-06T14:04:15.437 INFO:tasks.workunit.client.1.smithi174.stdout:4/658: readlink d1/d1f/d27/d2c/d45/dc1/lb8 0 2024-05-06T14:04:15.437 INFO:tasks.workunit.client.1.smithi174.stdout:1/554: dwrite d11/d57/f74 [700416,24576] 0 2024-05-06T14:04:15.437 INFO:tasks.workunit.client.1.smithi174.stdout:4/659: mknod d1/d1f/cea 0 2024-05-06T14:04:15.437 INFO:tasks.workunit.client.1.smithi174.stdout:2/569: creat d0/d1/d2/d4/fb4 x:0 0 0 2024-05-06T14:04:15.437 INFO:tasks.workunit.client.1.smithi174.stdout:2/570: truncate d0/d1/d2/d4/d6/f7a 814509 0 2024-05-06T14:04:15.437 INFO:tasks.workunit.client.1.smithi174.stdout:1/555: creat d11/d1f/d27/d2d/d9c/fc8 x:0 0 0 2024-05-06T14:04:15.438 INFO:tasks.workunit.client.1.smithi174.stdout:6/710: dwrite d0/df/d45/d4b/fc5 [860160,65536] 0 2024-05-06T14:04:15.438 INFO:tasks.workunit.client.1.smithi174.stdout:1/556: rename d11/d67 to d11/d41/dc9 0 2024-05-06T14:04:15.438 INFO:tasks.workunit.client.1.smithi174.stdout:4/660: symlink d1/d48/d5a/d61/leb 0 2024-05-06T14:04:15.438 INFO:tasks.workunit.client.1.smithi174.stdout:6/711: rename d0/f7f to d0/d25/d52/da6/fe9 0 2024-05-06T14:04:15.438 INFO:tasks.workunit.client.1.smithi174.stdout:4/661: mkdir d1/d48/d5a/d61/d68/dec 0 2024-05-06T14:04:15.438 INFO:tasks.workunit.client.1.smithi174.stdout:6/712: rename d0/d25/d52/d2c/fce to d0/d25/d35/de3/fea 0 2024-05-06T14:04:15.438 INFO:tasks.workunit.client.1.smithi174.stdout:6/713: readlink d0/d25/d52/d2c/l6c 0 2024-05-06T14:04:15.438 INFO:tasks.workunit.client.1.smithi174.stdout:6/714: stat d0/df/c55 0 2024-05-06T14:04:15.439 INFO:tasks.workunit.client.1.smithi174.stdout:4/662: rename d1/d9/c82 to d1/d1f/dd6/ced 0 2024-05-06T14:04:15.439 INFO:tasks.workunit.client.1.smithi174.stdout:6/715: readlink d0/df/d45/l8c 0 2024-05-06T14:04:15.439 INFO:tasks.workunit.client.1.smithi174.stdout:6/716: mknod d0/d25/d52/d2c/ceb 0 2024-05-06T14:04:15.439 INFO:tasks.workunit.client.1.smithi174.stdout:6/717: read - d0/df/d45/da9/db3/fc8 zero size 2024-05-06T14:04:15.440 INFO:tasks.workunit.client.1.smithi174.stdout:7/491: dread d0/d1d/da4/d61/d28/d59/f3f [270336,118784] 0 2024-05-06T14:04:15.440 INFO:tasks.workunit.client.1.smithi174.stdout:7/492: dread d0/d1d/da4/d61/d19/d24/d14/d52/f76 [638976,36864] 0 2024-05-06T14:04:15.440 INFO:tasks.workunit.client.1.smithi174.stdout:7/493: chown d0/d1d/d9c 56217 1 2024-05-06T14:04:15.440 INFO:tasks.workunit.client.1.smithi174.stdout:5/683: dread d1/d6/df/d35/d81/d60/db0/f25 [1966080,102400] 0 2024-05-06T14:04:15.441 INFO:tasks.workunit.client.1.smithi174.stdout:5/684: creat d1/d6/df/d35/d81/daf/feb x:0 0 0 2024-05-06T14:04:15.441 INFO:tasks.workunit.client.1.smithi174.stdout:5/685: write d1/d6/d7/d8e/f94 [1948917,129033] 0 2024-05-06T14:04:15.441 INFO:tasks.workunit.client.1.smithi174.stdout:5/686: link d1/d6/d7/d3e/d4c/lba d1/d6/d7/d36/d53/d59/d61/d69/lec 0 2024-05-06T14:04:15.441 INFO:tasks.workunit.client.1.smithi174.stdout:5/687: chown d1/d6/d7/d36/d53/d59/d61/d69/dd4 0 1 2024-05-06T14:04:15.441 INFO:tasks.workunit.client.1.smithi174.stdout:5/688: truncate d1/d6/d7/da1/d9a/fc2 585520 0 2024-05-06T14:04:15.553 INFO:tasks.workunit.client.1.smithi174.stdout:3/559: dwrite df/d10/f1c [1921024,106496] 0 2024-05-06T14:04:15.553 INFO:tasks.workunit.client.1.smithi174.stdout:3/560: symlink df/d10/da2/lb1 0 2024-05-06T14:04:15.553 INFO:tasks.workunit.client.1.smithi174.stdout:3/561: dread df/d10/d1b/f5c [2154496,81920] 0 2024-05-06T14:04:15.553 INFO:tasks.workunit.client.1.smithi174.stdout:3/562: dread df/f9c [622592,122880] 0 2024-05-06T14:04:15.553 INFO:tasks.workunit.client.1.smithi174.stdout:1/557: dwrite d11/d1f/d27/d32/d84/d8c/fa4 [1200128,118784] 0 2024-05-06T14:04:15.554 INFO:tasks.workunit.client.1.smithi174.stdout:4/663: dwrite d1/d9/d15/d74/fb7 [1568768,12288] 0 2024-05-06T14:04:15.554 INFO:tasks.workunit.client.1.smithi174.stdout:1/558: creat d11/d1f/d27/d2d/d9c/fca x:0 0 0 2024-05-06T14:04:15.554 INFO:tasks.workunit.client.1.smithi174.stdout:1/559: unlink d11/d1f/d55/faa 0 2024-05-06T14:04:15.554 INFO:tasks.workunit.client.1.smithi174.stdout:1/560: stat d11/d1f/d27/d32/d84/d8c/d94/db0/lb3 0 2024-05-06T14:04:15.554 INFO:tasks.workunit.client.1.smithi174.stdout:1/561: chown d11/d1f/d27/d32 2 1 2024-05-06T14:04:15.554 INFO:tasks.workunit.client.1.smithi174.stdout:1/562: write d11/d1f/fa7 [858061,107364] 0 2024-05-06T14:04:15.554 INFO:tasks.workunit.client.1.smithi174.stdout:7/494: dwrite d0/d1d/da4/d61/d19/f5b [552960,90112] 0 2024-05-06T14:04:15.554 INFO:tasks.workunit.client.1.smithi174.stdout:1/563: readlink d11/d1f/d27/d32/d84/lc2 0 2024-05-06T14:04:15.555 INFO:tasks.workunit.client.1.smithi174.stdout:1/564: creat d11/d1f/d27/d2d/fcb x:0 0 0 2024-05-06T14:04:15.555 INFO:tasks.workunit.client.1.smithi174.stdout:7/495: write d0/d3a/f6a [710666,80307] 0 2024-05-06T14:04:15.555 INFO:tasks.workunit.client.1.smithi174.stdout:1/565: write d11/d41/d4a/d5e/f6f [952450,48532] 0 2024-05-06T14:04:15.555 INFO:tasks.workunit.client.1.smithi174.stdout:6/718: dwrite d0/df/f6e [782336,4096] 0 2024-05-06T14:04:15.555 INFO:tasks.workunit.client.1.smithi174.stdout:6/719: creat d0/d93/fec x:0 0 0 2024-05-06T14:04:15.555 INFO:tasks.workunit.client.1.smithi174.stdout:6/720: write d0/f3a [3120750,107396] 0 2024-05-06T14:04:15.555 INFO:tasks.workunit.client.1.smithi174.stdout:6/721: read - d0/d25/fdc zero size 2024-05-06T14:04:15.555 INFO:tasks.workunit.client.1.smithi174.stdout:6/722: mkdir d0/df/d45/d85/ddf/ded 0 2024-05-06T14:04:15.556 INFO:tasks.workunit.client.1.smithi174.stdout:5/689: dwrite d1/d6/d7/d3e/fbc [823296,122880] 0 2024-05-06T14:04:15.556 INFO:tasks.workunit.client.1.smithi174.stdout:5/690: rmdir d1/d6/d7/da1/d9a 39 2024-05-06T14:04:15.556 INFO:tasks.workunit.client.1.smithi174.stdout:5/691: dread - d1/d6/d7/d36/d53/d59/f7a zero size 2024-05-06T14:04:15.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:15.591+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 msgr2=0x7f7190006620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:15.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:15.591+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 0x7f7190006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:04:15.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:15.591+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:15.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:15.591+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:04:15.624 INFO:tasks.workunit.client.1.smithi174.stdout:6/723: fsync d0/d25/d52/d2c/d6f/f99 0 2024-05-06T14:04:15.624 INFO:tasks.workunit.client.1.smithi174.stdout:6/724: rename d0/c7d to d0/cee 0 2024-05-06T14:04:15.627 INFO:tasks.workunit.client.1.smithi174.stdout:6/725: dwrite d0/d25/d52/d3b/f53 [790528,45056] 0 2024-05-06T14:04:15.630 INFO:tasks.workunit.client.1.smithi174.stdout:1/566: dwrite d11/d1f/d27/f6a [1744896,4096] 0 2024-05-06T14:04:15.630 INFO:tasks.workunit.client.1.smithi174.stdout:6/726: creat d0/d25/d52/d2c/d6f/fef x:0 0 0 2024-05-06T14:04:15.630 INFO:tasks.workunit.client.1.smithi174.stdout:4/664: dwrite d1/d9/d15/d98/f76 [57344,20480] 0 2024-05-06T14:04:15.631 INFO:tasks.workunit.client.1.smithi174.stdout:4/665: dread d1/d2e/f33 [561152,69632] 0 2024-05-06T14:04:15.631 INFO:tasks.workunit.client.1.smithi174.stdout:4/666: chown d1/d1f/dd6/f75 1034383 1 2024-05-06T14:04:15.631 INFO:tasks.workunit.client.1.smithi174.stdout:4/667: getdents d1/d9/d15/d74/d86/dc2 0 2024-05-06T14:04:15.631 INFO:tasks.workunit.client.1.smithi174.stdout:6/727: write d0/df/f6e [1124494,92359] 0 2024-05-06T14:04:15.631 INFO:tasks.workunit.client.1.smithi174.stdout:6/728: truncate d0/d93/fec 821124 0 2024-05-06T14:04:15.631 INFO:tasks.workunit.client.1.smithi174.stdout:6/729: write d0/fc4 [1244376,2772] 0 2024-05-06T14:04:15.631 INFO:tasks.workunit.client.1.smithi174.stdout:6/730: chown d0/d25/d52/d2c/d5f/dc9 24 1 2024-05-06T14:04:15.640 INFO:tasks.workunit.client.1.smithi174.stdout:3/563: dread df/d10/d1b/f2b [794624,8192] 0 2024-05-06T14:04:15.640 INFO:tasks.workunit.client.1.smithi174.stdout:3/564: read df/d10/d1b/d7e/f51 [732089,41432] 0 2024-05-06T14:04:15.640 INFO:tasks.workunit.client.1.smithi174.stdout:3/565: chown df/c21 534214 1 2024-05-06T14:04:15.640 INFO:tasks.workunit.client.1.smithi174.stdout:3/566: truncate df/d2d/f39 486386 0 2024-05-06T14:04:15.641 INFO:tasks.workunit.client.1.smithi174.stdout:3/567: write df/f90 [964190,19635] 0 2024-05-06T14:04:15.641 INFO:tasks.workunit.client.1.smithi174.stdout:3/568: symlink df/d2d/d4e/lb2 0 2024-05-06T14:04:15.641 INFO:tasks.workunit.client.1.smithi174.stdout:3/569: write df/d10/f52 [140522,96120] 0 2024-05-06T14:04:15.646 INFO:tasks.workunit.client.1.smithi174.stdout:7/496: dread d0/d1d/da4/d61/fb [1617920,102400] 0 2024-05-06T14:04:15.646 INFO:tasks.workunit.client.1.smithi174.stdout:7/497: creat d0/d1d/da4/d61/d19/d39/d46/fab x:0 0 0 2024-05-06T14:04:15.646 INFO:tasks.workunit.client.1.smithi174.stdout:7/498: write d0/d1d/da4/d61/d19/f31 [3788985,39808] 0 2024-05-06T14:04:15.709 INFO:tasks.workunit.client.1.smithi174.stdout:1/567: mknod d11/d1f/d27/d32/ccc 0 2024-05-06T14:04:15.709 INFO:tasks.workunit.client.1.smithi174.stdout:4/668: creat d1/d1f/dd6/d6e/d50/d95/fee x:0 0 0 2024-05-06T14:04:15.709 INFO:tasks.workunit.client.1.smithi174.stdout:6/731: rename d0/d25/fa5 to d0/df/d45/da9/ff0 0 2024-05-06T14:04:15.710 INFO:tasks.workunit.client.1.smithi174.stdout:6/732: chown d0/df/d45/d85 603688328 1 2024-05-06T14:04:15.710 INFO:tasks.workunit.client.1.smithi174.stdout:7/499: rename d0/d1d/da4/d61/d19/d39/l54 to d0/d1d/da4/d61/lac 0 2024-05-06T14:04:15.710 INFO:tasks.workunit.client.1.smithi174.stdout:6/733: dread d0/d25/d52/d3b/f53 [839680,4096] 0 2024-05-06T14:04:15.710 INFO:tasks.workunit.client.1.smithi174.stdout:7/500: getdents d0/d1d/da4/d61/d19/d24/d47 0 2024-05-06T14:04:15.710 INFO:tasks.workunit.client.1.smithi174.stdout:6/734: mkdir d0/d25/d52/d2c/d6f/df1 0 2024-05-06T14:04:15.710 INFO:tasks.workunit.client.1.smithi174.stdout:6/735: write d0/d25/fdc [532727,31185] 0 2024-05-06T14:04:15.710 INFO:tasks.workunit.client.1.smithi174.stdout:7/501: mkdir d0/d1d/d9c/dad 0 2024-05-06T14:04:15.711 INFO:tasks.workunit.client.1.smithi174.stdout:6/736: mknod d0/d25/cf2 0 2024-05-06T14:04:15.711 INFO:tasks.workunit.client.1.smithi174.stdout:6/737: mknod d0/d25/d52/d2c/d5f/cf3 0 2024-05-06T14:04:15.711 INFO:tasks.workunit.client.1.smithi174.stdout:6/738: write d0/df/d45/da9/ff0 [1383335,95459] 0 2024-05-06T14:04:15.711 INFO:tasks.workunit.client.1.smithi174.stdout:6/739: rename d0/d25/d52/d2c/d6f/l7b to d0/df/d45/lf4 0 2024-05-06T14:04:15.711 INFO:tasks.workunit.client.1.smithi174.stdout:6/740: chown d0/d25/d52/d2c/d5f/l96 927 1 2024-05-06T14:04:15.711 INFO:tasks.workunit.client.1.smithi174.stdout:3/570: dwrite df/d10/f3a [745472,73728] 0 2024-05-06T14:04:15.752 INFO:tasks.workunit.client.1.smithi174.stdout:5/692: fsync d1/d6/df/d35/d81/d60/db0/fd 0 2024-05-06T14:04:15.752 INFO:tasks.workunit.client.1.smithi174.stdout:5/693: truncate d1/d6/d7/fca 2292096 0 2024-05-06T14:04:15.752 INFO:tasks.workunit.client.1.smithi174.stdout:5/694: creat d1/d6/d7/d8e/fed x:0 0 0 2024-05-06T14:04:15.752 INFO:tasks.workunit.client.1.smithi174.stdout:5/695: symlink d1/d6/df/d35/lee 0 2024-05-06T14:04:15.752 INFO:tasks.workunit.client.1.smithi174.stdout:5/696: dread - d1/d6/df/d35/d81/d60/db0/d41/fcf zero size 2024-05-06T14:04:15.757 INFO:tasks.workunit.client.1.smithi174.stdout:1/568: dwrite d11/d1f/d27/d2d/f8b [360448,28672] 0 2024-05-06T14:04:15.757 INFO:tasks.workunit.client.1.smithi174.stdout:1/569: dread d11/d41/dc9/f70 [36864,86016] 0 2024-05-06T14:04:15.757 INFO:tasks.workunit.client.1.smithi174.stdout:1/570: dread d11/d41/dc9/d6c/f72 [614400,69632] 0 2024-05-06T14:04:15.757 INFO:tasks.workunit.client.1.smithi174.stdout:1/571: symlink d11/lcd 0 2024-05-06T14:04:15.757 INFO:tasks.workunit.client.1.smithi174.stdout:1/572: chown d11/d1f/d27/d2d/d9c 978 1 2024-05-06T14:04:15.757 INFO:tasks.workunit.client.1.smithi174.stdout:6/741: dwrite d0/df/f6e [565248,69632] 0 2024-05-06T14:04:15.757 INFO:tasks.workunit.client.1.smithi174.stdout:6/742: truncate d0/df/d45/d4b/f86 1251603 0 2024-05-06T14:04:15.757 INFO:tasks.workunit.client.1.smithi174.stdout:6/743: mkdir d0/d25/d52/d2c/d76/df5 0 2024-05-06T14:04:15.758 INFO:tasks.workunit.client.1.smithi174.stdout:4/669: dwrite d1/d1f/d27/f38 [991232,4096] 0 2024-05-06T14:04:15.758 INFO:tasks.workunit.client.1.smithi174.stdout:4/670: write d1/d48/d5a/d5f/f8a [1479516,83226] 0 2024-05-06T14:04:15.758 INFO:tasks.workunit.client.1.smithi174.stdout:4/671: creat d1/d9/d15/d35/fef x:0 0 0 2024-05-06T14:04:15.758 INFO:tasks.workunit.client.1.smithi174.stdout:4/672: stat d1/ca7 0 2024-05-06T14:04:15.759 INFO:tasks.workunit.client.1.smithi174.stdout:4/673: stat d1/d9/d15/f9c 0 2024-05-06T14:04:15.759 INFO:tasks.workunit.client.1.smithi174.stdout:4/674: mknod d1/d9/d15/d98/cf0 0 2024-05-06T14:04:15.759 INFO:tasks.workunit.client.1.smithi174.stdout:4/675: write d1/d48/d5a/d61/f63 [1852410,998] 0 2024-05-06T14:04:15.759 INFO:tasks.workunit.client.1.smithi174.stdout:4/676: rmdir d1/d9/d15/d74/d86 39 2024-05-06T14:04:15.759 INFO:tasks.workunit.client.1.smithi174.stdout:4/677: creat d1/d9/d15/d41/ff1 x:0 0 0 2024-05-06T14:04:15.759 INFO:tasks.workunit.client.1.smithi174.stdout:4/678: truncate d1/d1f/dd6/d6e/d50/f5c 554215 0 2024-05-06T14:04:15.759 INFO:tasks.workunit.client.1.smithi174.stdout:4/679: creat d1/d1f/d89/ff2 x:0 0 0 2024-05-06T14:04:15.760 INFO:tasks.workunit.client.1.smithi174.stdout:4/680: symlink d1/d1f/d27/d2c/ddd/lf3 0 2024-05-06T14:04:15.760 INFO:tasks.workunit.client.1.smithi174.stdout:4/681: rmdir d1/d1f/d27/d2c/d45/dc1 39 2024-05-06T14:04:15.760 INFO:tasks.workunit.client.1.smithi174.stdout:4/682: creat d1/d48/d5a/d61/d68/dec/ff4 x:0 0 0 2024-05-06T14:04:15.760 INFO:tasks.workunit.client.1.smithi174.stdout:4/683: write d1/d9/d15/d92/fca [2200588,94921] 0 2024-05-06T14:04:15.761 INFO:tasks.workunit.client.1.smithi174.stdout:5/697: dwrite d1/d6/f13 [2502656,126976] 0 2024-05-06T14:04:15.761 INFO:tasks.workunit.client.1.smithi174.stdout:1/573: dwrite d11/d1f/d27/d2d/fcb [8192,12288] 0 2024-05-06T14:04:15.761 INFO:tasks.workunit.client.1.smithi174.stdout:5/698: creat d1/d6/d7/da1/dd8/de7/fef x:0 0 0 2024-05-06T14:04:15.761 INFO:tasks.workunit.client.1.smithi174.stdout:5/699: truncate d1/d6/df/d35/d81/f1b 1433959 0 2024-05-06T14:04:15.761 INFO:tasks.workunit.client.1.smithi174.stdout:4/684: dwrite d1/d9/d15/d74/d86/fc4 [548864,16384] 0 2024-05-06T14:04:15.762 INFO:tasks.workunit.client.1.smithi174.stdout:1/574: write d11/d41/f85 [961079,120535] 0 2024-05-06T14:04:15.762 INFO:tasks.workunit.client.1.smithi174.stdout:1/575: truncate d11/d1f/d27/d2d/fcb 555929 0 2024-05-06T14:04:15.762 INFO:tasks.workunit.client.1.smithi174.stdout:1/576: link d11/l7c d11/d1f/d27/d2d/d9c/lce 0 2024-05-06T14:04:15.847 INFO:tasks.workunit.client.1.smithi174.stdout:6/744: fdatasync d0/d25/d52/d4c/fab 0 2024-05-06T14:04:15.848 INFO:tasks.workunit.client.1.smithi174.stdout:6/745: chown d0/d25/d52/d3b/f83 0 1 2024-05-06T14:04:15.853 INFO:tasks.workunit.client.1.smithi174.stdout:6/746: truncate d0/d25/f51 2718385 0 2024-05-06T14:04:15.853 INFO:tasks.workunit.client.1.smithi174.stdout:1/577: dread d11/d57/d98/daf/d9b/fa0 [4096,81920] 0 2024-05-06T14:04:15.853 INFO:tasks.workunit.client.1.smithi174.stdout:7/502: dread d0/d1d/da4/d61/d28/f6e [352256,12288] 0 2024-05-06T14:04:15.853 INFO:tasks.workunit.client.1.smithi174.stdout:6/747: dread d0/fc4 [126976,53248] 0 2024-05-06T14:04:15.853 INFO:tasks.workunit.client.1.smithi174.stdout:6/748: chown d0/df/d3c 64486496 1 2024-05-06T14:04:15.853 INFO:tasks.workunit.client.1.smithi174.stdout:6/749: symlink d0/df/d45/d85/ddf/ded/lf6 0 2024-05-06T14:04:15.853 INFO:tasks.workunit.client.1.smithi174.stdout:1/578: write d11/d57/f69 [627991,120506] 0 2024-05-06T14:04:15.854 INFO:tasks.workunit.client.1.smithi174.stdout:5/700: write d1/d6/df/d35/d81/d60/db0/de/f80 [1405142,114285] 0 2024-05-06T14:04:15.854 INFO:tasks.workunit.client.1.smithi174.stdout:5/701: rmdir d1/d6 39 2024-05-06T14:04:15.854 INFO:tasks.workunit.client.1.smithi174.stdout:5/702: chown d1/d6/d7/c23 2301 1 2024-05-06T14:04:15.854 INFO:tasks.workunit.client.1.smithi174.stdout:6/750: write d0/df/d45/da9/ff0 [1229780,114947] 0 2024-05-06T14:04:15.854 INFO:tasks.workunit.client.1.smithi174.stdout:1/579: creat d11/d1f/d27/fcf x:0 0 0 2024-05-06T14:04:15.986 INFO:tasks.workunit.client.1.smithi174.stdout:7/503: fdatasync d0/d1d/da4/d61/d19/d39/fa2 0 2024-05-06T14:04:15.987 INFO:tasks.workunit.client.1.smithi174.stdout:5/703: fdatasync d1/d6/d7/d36/d53/d59/d61/d69/f91 0 2024-05-06T14:04:15.987 INFO:tasks.workunit.client.1.smithi174.stdout:5/704: chown d1/d6 465783 1 2024-05-06T14:04:15.987 INFO:tasks.workunit.client.1.smithi174.stdout:5/705: getdents d1/d6/d7/d36/d53/d59/d61/d69 0 2024-05-06T14:04:15.987 INFO:tasks.workunit.client.1.smithi174.stdout:7/504: rename d0/d1d/da4/d61/d19/d24/d14/d52/f76 to d0/d1d/da4/d61/d19/d24/d47/d70/d83/fae 0 2024-05-06T14:04:15.991 INFO:tasks.workunit.client.1.smithi174.stdout:5/706: dread d1/d6/d7/d36/d53/f74 [299008,32768] 0 2024-05-06T14:04:15.992 INFO:tasks.workunit.client.1.smithi174.stdout:7/505: readlink d0/d1d/da4/d61/d19/d24/d47/laa 0 2024-05-06T14:04:15.992 INFO:tasks.workunit.client.1.smithi174.stdout:5/707: write d1/d6/df/d35/d81/f1d [688879,83560] 0 2024-05-06T14:04:15.992 INFO:tasks.workunit.client.1.smithi174.stdout:5/708: creat d1/d6/d7/da1/d9a/ff0 x:0 0 0 2024-05-06T14:04:16.056 INFO:tasks.workunit.client.1.smithi174.stdout:1/580: fsync d11/d1f/d27/f6a 0 2024-05-06T14:04:16.060 INFO:tasks.workunit.client.1.smithi174.stdout:1/581: rename d11/d1f/d27/d2d/fcb to d11/d1f/d27/d2d/fd0 0 2024-05-06T14:04:16.060 INFO:tasks.workunit.client.1.smithi174.stdout:1/582: rmdir d11/d1f/d55 39 2024-05-06T14:04:16.061 INFO:tasks.workunit.client.1.smithi174.stdout:7/506: creat d0/d1d/da4/d61/d28/d59/da1/faf x:0 0 0 2024-05-06T14:04:16.061 INFO:tasks.workunit.client.1.smithi174.stdout:5/709: mkdir d1/d6/df/d35/d81/d60/db0/de/dbd/df1 0 2024-05-06T14:04:16.061 INFO:tasks.workunit.client.1.smithi174.stdout:7/507: rmdir d0/d1d/d9c 39 2024-05-06T14:04:16.061 INFO:tasks.workunit.client.1.smithi174.stdout:5/710: chown d1/d6/df/d35/l5a 157420 1 2024-05-06T14:04:16.061 INFO:tasks.workunit.client.1.smithi174.stdout:1/583: write d11/d57/f69 [133640,57373] 0 2024-05-06T14:04:16.061 INFO:tasks.workunit.client.1.smithi174.stdout:1/584: chown d11/d1f/fc4 120643 1 2024-05-06T14:04:16.061 INFO:tasks.workunit.client.1.smithi174.stdout:1/585: chown c4 221494503 1 2024-05-06T14:04:16.062 INFO:tasks.workunit.client.1.smithi174.stdout:7/508: write d0/d1d/da4/d61/d19/d24/d47/d70/d67/f86 [974053,31391] 0 2024-05-06T14:04:16.062 INFO:tasks.workunit.client.1.smithi174.stdout:7/509: readlink d0/d1d/da4/d61/d19/d39/d46/l5a 0 2024-05-06T14:04:16.063 INFO:tasks.workunit.client.1.smithi174.stdout:7/510: mknod d0/d1d/da4/d61/d28/d37/cb0 0 2024-05-06T14:04:16.063 INFO:tasks.workunit.client.1.smithi174.stdout:7/511: mkdir d0/d1d/da4/d61/d28/db1 0 2024-05-06T14:04:16.063 INFO:tasks.workunit.client.1.smithi174.stdout:7/512: getdents d0/d1d/da4/d61/d19/d24/d6f/d88 0 2024-05-06T14:04:16.063 INFO:tasks.workunit.client.1.smithi174.stdout:7/513: link d0/d1d/da4/d61/d19/d24/f10 d0/d3a/fb2 0 2024-05-06T14:04:16.063 INFO:tasks.workunit.client.1.smithi174.stdout:7/514: mknod d0/d1d/da4/d61/d28/db1/cb3 0 2024-05-06T14:04:16.064 INFO:tasks.workunit.client.1.smithi174.stdout:7/515: dwrite d0/d1d/da4/d61/d19/d24/d6f/d88/f95 [712704,114688] 0 2024-05-06T14:04:16.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/711: dread d1/d6/df/d35/d81/d60/db0/f25 [1155072,122880] 0 2024-05-06T14:04:16.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/712: dread d1/d6/d7/d3e/fbc [299008,106496] 0 2024-05-06T14:04:16.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/713: dread - d1/d6/d7/da1/f88 zero size 2024-05-06T14:04:16.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/714: symlink d1/d6/df/d35/d81/lf2 0 2024-05-06T14:04:16.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/715: link d1/d6/df/d35/d81/d1e/f8c d1/d6/d7/d3e/d4c/ff3 0 2024-05-06T14:04:16.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/716: creat d1/d6/df/de2/ff4 x:0 0 0 2024-05-06T14:04:16.071 INFO:tasks.workunit.client.1.smithi174.stdout:5/717: creat d1/d6/df/d35/d81/d60/d82/ff5 x:0 0 0 2024-05-06T14:04:16.131 INFO:tasks.workunit.client.1.smithi174.stdout:7/516: link d0/d1d/da4/d61/d19/f5b d0/d1d/d9c/dad/fb4 0 2024-05-06T14:04:16.131 INFO:tasks.workunit.client.1.smithi174.stdout:9/572: sync 2024-05-06T14:04:16.131 INFO:tasks.workunit.client.1.smithi174.stdout:7/517: creat d0/d1d/da4/d61/d19/d24/d6f/fb5 x:0 0 0 2024-05-06T14:04:16.131 INFO:tasks.workunit.client.1.smithi174.stdout:0/591: sync 2024-05-06T14:04:16.131 INFO:tasks.workunit.client.1.smithi174.stdout:2/571: sync 2024-05-06T14:04:16.131 INFO:tasks.workunit.client.1.smithi174.stdout:8/680: sync 2024-05-06T14:04:16.133 INFO:tasks.workunit.client.1.smithi174.stdout:0/592: rmdir d0/d3 39 2024-05-06T14:04:16.133 INFO:tasks.workunit.client.1.smithi174.stdout:0/593: rename d0/d4/d8/d25/d5c/d4a/da7/fab to d0/d4/d8/d25/d5c/fc2 0 2024-05-06T14:04:16.133 INFO:tasks.workunit.client.1.smithi174.stdout:8/681: mknod d4/de/d24/dc1/ce5 0 2024-05-06T14:04:16.133 INFO:tasks.workunit.client.1.smithi174.stdout:2/572: creat d0/d24/fb5 x:0 0 0 2024-05-06T14:04:16.133 INFO:tasks.workunit.client.1.smithi174.stdout:8/682: mkdir d4/de/d23/d41/d56/de6 0 2024-05-06T14:04:16.133 INFO:tasks.workunit.client.1.smithi174.stdout:8/683: unlink d4/de/d23/d41/d4e/l51 0 2024-05-06T14:04:16.134 INFO:tasks.workunit.client.1.smithi174.stdout:2/573: mkdir d0/d1/d2/d4/d6/d3c/da2/db6 0 2024-05-06T14:04:16.134 INFO:tasks.workunit.client.1.smithi174.stdout:2/574: read - d0/d1/d2/d4/d18/f64 zero size 2024-05-06T14:04:16.134 INFO:tasks.workunit.client.1.smithi174.stdout:8/684: symlink d4/d15/d20/d3e/le7 0 2024-05-06T14:04:16.134 INFO:tasks.workunit.client.1.smithi174.stdout:2/575: write d0/da/f3b [737953,73002] 0 2024-05-06T14:04:16.134 INFO:tasks.workunit.client.1.smithi174.stdout:2/576: symlink d0/db/d15/lb7 0 2024-05-06T14:04:16.134 INFO:tasks.workunit.client.1.smithi174.stdout:2/577: write d0/d1/d2/d2a/f70 [794713,4557] 0 2024-05-06T14:04:16.134 INFO:tasks.workunit.client.1.smithi174.stdout:2/578: write d0/d1/d2/d4/d18/d2d/d32/f47 [830377,26110] 0 2024-05-06T14:04:16.134 INFO:tasks.workunit.client.1.smithi174.stdout:2/579: creat d0/da/d3f/d67/fb8 x:0 0 0 2024-05-06T14:04:16.135 INFO:tasks.workunit.client.1.smithi174.stdout:2/580: mknod d0/d1/d2/cb9 0 2024-05-06T14:04:16.135 INFO:tasks.workunit.client.1.smithi174.stdout:2/581: link d0/d1/d2/d2a/l52 d0/da/d3f/lba 0 2024-05-06T14:04:16.135 INFO:tasks.workunit.client.1.smithi174.stdout:2/582: readlink d0/d1/d2/d4/d51/l9f 0 2024-05-06T14:04:16.135 INFO:tasks.workunit.client.1.smithi174.stdout:2/583: dread - d0/d24/fa7 zero size 2024-05-06T14:04:16.135 INFO:tasks.workunit.client.1.smithi174.stdout:2/584: dread - d0/d16/f96 zero size 2024-05-06T14:04:16.135 INFO:tasks.workunit.client.1.smithi174.stdout:2/585: write d0/d16/f19 [1010541,27048] 0 2024-05-06T14:04:16.135 INFO:tasks.workunit.client.1.smithi174.stdout:2/586: symlink d0/da/d3f/d67/lbb 0 2024-05-06T14:04:16.135 INFO:tasks.workunit.client.1.smithi174.stdout:2/587: stat d0/d1/d2/d1b 0 2024-05-06T14:04:16.136 INFO:tasks.workunit.client.1.smithi174.stdout:2/588: getdents d0/d1/d2/d1b 0 2024-05-06T14:04:16.136 INFO:tasks.workunit.client.1.smithi174.stdout:2/589: mknod d0/da/d3f/da6/cbc 0 2024-05-06T14:04:16.136 INFO:tasks.workunit.client.1.smithi174.stdout:2/590: chown d0/d24/f65 169510 1 2024-05-06T14:04:16.136 INFO:tasks.workunit.client.1.smithi174.stdout:2/591: creat d0/d1/d2/d4/d18/d97/fbd x:0 0 0 2024-05-06T14:04:16.136 INFO:tasks.workunit.client.1.smithi174.stdout:2/592: dread - d0/d1/faa zero size 2024-05-06T14:04:16.166 INFO:tasks.workunit.client.1.smithi174.stdout:4/685: fdatasync d1/d48/d5a/d61/d68/dec/ff4 0 2024-05-06T14:04:16.166 INFO:tasks.workunit.client.1.smithi174.stdout:4/686: truncate d1/d9/d15/d74/fb7 1755125 0 2024-05-06T14:04:16.167 INFO:tasks.workunit.client.1.smithi174.stdout:5/718: fsync d1/d6/d7/da1/fb8 0 2024-05-06T14:04:16.167 INFO:tasks.workunit.client.1.smithi174.stdout:8/685: fdatasync d4/de/d24/d5e/f83 0 2024-05-06T14:04:16.167 INFO:tasks.workunit.client.1.smithi174.stdout:8/686: stat d4/de/d23/d41/d56/f9c 0 2024-05-06T14:04:16.167 INFO:tasks.workunit.client.1.smithi174.stdout:0/594: fdatasync d0/d4/d80/f99 0 2024-05-06T14:04:16.167 INFO:tasks.workunit.client.1.smithi174.stdout:5/719: truncate d1/d6/d7/d36/d53/f9e 30383 0 2024-05-06T14:04:16.167 INFO:tasks.workunit.client.1.smithi174.stdout:8/687: dread d4/d48/fa7 [77824,49152] 0 2024-05-06T14:04:16.167 INFO:tasks.workunit.client.1.smithi174.stdout:8/688: chown d4/de/d23/ldf 4 1 2024-05-06T14:04:16.168 INFO:tasks.workunit.client.1.smithi174.stdout:4/687: creat d1/d48/d5a/d61/ff5 x:0 0 0 2024-05-06T14:04:16.168 INFO:tasks.workunit.client.1.smithi174.stdout:0/595: getdents d0/d1a/d17 0 2024-05-06T14:04:16.168 INFO:tasks.workunit.client.1.smithi174.stdout:0/596: getdents d0/d4/d8/d25/d5c/d44/db9 0 2024-05-06T14:04:16.168 INFO:tasks.workunit.client.1.smithi174.stdout:8/689: symlink d4/de/d24/d5e/le8 0 2024-05-06T14:04:16.168 INFO:tasks.workunit.client.1.smithi174.stdout:8/690: chown d4/de/d23/d3c/db2/lde 1390969 1 2024-05-06T14:04:16.168 INFO:tasks.workunit.client.1.smithi174.stdout:9/573: dwrite dc/de/d6b/f8b [69632,81920] 0 2024-05-06T14:04:16.169 INFO:tasks.workunit.client.1.smithi174.stdout:7/518: dwrite d0/d1d/da4/d61/d19/d24/d47/f7a [593920,24576] 0 2024-05-06T14:04:16.169 INFO:tasks.workunit.client.1.smithi174.stdout:7/519: unlink d0/d1d/da4/d61/d19/d24/d47/d70/d67/f80 0 2024-05-06T14:04:16.169 INFO:tasks.workunit.client.1.smithi174.stdout:7/520: dread - d0/d1d/da4/d61/d19/d24/d47/d64/fa9 zero size 2024-05-06T14:04:16.170 INFO:tasks.workunit.client.1.smithi174.stdout:8/691: dwrite d4/de/d24/f45 [1376256,65536] 0 2024-05-06T14:04:16.170 INFO:tasks.workunit.client.1.smithi174.stdout:9/574: dwrite dc/d1c/f41 [495616,94208] 0 2024-05-06T14:04:16.170 INFO:tasks.workunit.client.1.smithi174.stdout:9/575: truncate dc/d27/d60/daf/f16 815974 0 2024-05-06T14:04:16.170 INFO:tasks.workunit.client.1.smithi174.stdout:9/576: getdents dc/d17 0 2024-05-06T14:04:16.212 INFO:tasks.workunit.client.1.smithi174.stdout:2/593: fdatasync d0/db/d72/f8c 0 2024-05-06T14:04:16.213 INFO:tasks.workunit.client.1.smithi174.stdout:2/594: write d0/d16/f96 [277423,69808] 0 2024-05-06T14:04:16.214 INFO:tasks.workunit.client.1.smithi174.stdout:8/692: dwrite d4/de/d23/d3c/fbb [499712,81920] 0 2024-05-06T14:04:16.214 INFO:tasks.workunit.client.1.smithi174.stdout:8/693: write d4/de/d24/d5e/f83 [32217,105539] 0 2024-05-06T14:04:16.215 INFO:tasks.workunit.client.1.smithi174.stdout:8/694: write d4/d15/d64/f84 [1434604,2451] 0 2024-05-06T14:04:16.215 INFO:tasks.workunit.client.1.smithi174.stdout:8/695: mkdir d4/de/d23/d3c/db2/da6/dad/de9 0 2024-05-06T14:04:16.215 INFO:tasks.workunit.client.1.smithi174.stdout:8/696: creat d4/de/d23/d3c/db2/da6/dad/de9/fea x:0 0 0 2024-05-06T14:04:16.216 INFO:tasks.workunit.client.1.smithi174.stdout:9/577: symlink dc/de/d7f/da4/lc2 0 2024-05-06T14:04:16.217 INFO:tasks.workunit.client.1.smithi174.stdout:9/578: chown dc/de/d6b 509663500 1 2024-05-06T14:04:16.217 INFO:tasks.workunit.client.1.smithi174.stdout:5/720: dread d1/d6/f9 [630784,102400] 0 2024-05-06T14:04:16.217 INFO:tasks.workunit.client.1.smithi174.stdout:2/595: mknod d0/d24/cbe 0 2024-05-06T14:04:16.217 INFO:tasks.workunit.client.1.smithi174.stdout:8/697: write d4/de/d24/d5e/d85/d91/fbe [974807,2969] 0 2024-05-06T14:04:16.217 INFO:tasks.workunit.client.1.smithi174.stdout:5/721: truncate d1/d6/df/d35/d81/f4b 284017 0 2024-05-06T14:04:16.217 INFO:tasks.workunit.client.1.smithi174.stdout:9/579: write dc/d27/d6d/f6f [212359,38990] 0 2024-05-06T14:04:16.217 INFO:tasks.workunit.client.1.smithi174.stdout:5/722: mknod d1/d6/df/d35/d81/d60/db0/de/dbd/df1/cf6 0 2024-05-06T14:04:16.218 INFO:tasks.workunit.client.1.smithi174.stdout:8/698: symlink d4/de/d23/d3c/db2/da6/leb 0 2024-05-06T14:04:16.218 INFO:tasks.workunit.client.1.smithi174.stdout:5/723: dread d1/d6/d7/d36/d53/f74 [135168,86016] 0 2024-05-06T14:04:16.218 INFO:tasks.workunit.client.1.smithi174.stdout:9/580: creat dc/d27/d60/daf/d43/d8e/fc3 x:0 0 0 2024-05-06T14:04:16.218 INFO:tasks.workunit.client.1.smithi174.stdout:9/581: rename dc/d17/f2f to dc/de/d7f/da4/fc4 0 2024-05-06T14:04:16.218 INFO:tasks.workunit.client.1.smithi174.stdout:5/724: mkdir d1/d6/d7/d36/d53/d59/df7 0 2024-05-06T14:04:16.218 INFO:tasks.workunit.client.1.smithi174.stdout:8/699: symlink d4/d15/d20/d3e/d79/dcc/lec 0 2024-05-06T14:04:16.218 INFO:tasks.workunit.client.1.smithi174.stdout:9/582: rmdir dc/d27/d60/daf/da8 0 2024-05-06T14:04:16.218 INFO:tasks.workunit.client.1.smithi174.stdout:9/583: creat dc/d27/d63/fc5 x:0 0 0 2024-05-06T14:04:16.219 INFO:tasks.workunit.client.1.smithi174.stdout:5/725: write d1/d6/df/d35/d81/d60/d82/ff5 [211303,105448] 0 2024-05-06T14:04:16.219 INFO:tasks.workunit.client.1.smithi174.stdout:5/726: write d1/d6/d7/fca [1619562,114288] 0 2024-05-06T14:04:16.219 INFO:tasks.workunit.client.1.smithi174.stdout:5/727: chown d1/d6/df/d35/d81/d60/db0/d41/f8f 13598 1 2024-05-06T14:04:16.219 INFO:tasks.workunit.client.1.smithi174.stdout:5/728: dread d1/d6/df/d35/d81/d60/d82/ff5 [49152,36864] 0 2024-05-06T14:04:16.252 INFO:tasks.workunit.client.1.smithi174.stdout:2/596: fsync d0/d1/d2/d4/d6/f44 0 2024-05-06T14:04:16.252 INFO:tasks.workunit.client.1.smithi174.stdout:9/584: fsync dc/de/f26 0 2024-05-06T14:04:16.252 INFO:tasks.workunit.client.1.smithi174.stdout:9/585: read - dc/de/d7f/d93/fac zero size 2024-05-06T14:04:16.252 INFO:tasks.workunit.client.1.smithi174.stdout:9/586: creat dc/d17/d3a/db2/fc6 x:0 0 0 2024-05-06T14:04:16.252 INFO:tasks.workunit.client.1.smithi174.stdout:9/587: write dc/de/f62 [2578006,45447] 0 2024-05-06T14:04:16.253 INFO:tasks.workunit.client.1.smithi174.stdout:8/700: dwrite d4/d15/f16 [278528,126976] 0 2024-05-06T14:04:16.253 INFO:tasks.workunit.client.1.smithi174.stdout:8/701: creat d4/d15/d20/d3e/d79/dcc/fed x:0 0 0 2024-05-06T14:04:16.253 INFO:tasks.workunit.client.1.smithi174.stdout:8/702: chown d4/d15/c81 5 1 2024-05-06T14:04:16.253 INFO:tasks.workunit.client.1.smithi174.stdout:8/703: unlink d4/d53/f76 0 2024-05-06T14:04:16.253 INFO:tasks.workunit.client.1.smithi174.stdout:8/704: chown d4/d15/d20/d3e/c57 4 1 2024-05-06T14:04:16.253 INFO:tasks.workunit.client.1.smithi174.stdout:8/705: readlink d4/d48/lb6 0 2024-05-06T14:04:16.253 INFO:tasks.workunit.client.1.smithi174.stdout:8/706: readlink d4/de/d23/ldf 0 2024-05-06T14:04:16.253 INFO:tasks.workunit.client.1.smithi174.stdout:8/707: link d4/de/d23/d41/ca0 d4/d15/d20/d3e/cee 0 2024-05-06T14:04:16.254 INFO:tasks.workunit.client.1.smithi174.stdout:8/708: creat d4/de/d23/d3c/db2/da6/dad/fef x:0 0 0 2024-05-06T14:04:16.254 INFO:tasks.workunit.client.1.smithi174.stdout:8/709: write d4/de/d23/d3c/db2/f8f [564856,68025] 0 2024-05-06T14:04:16.254 INFO:tasks.workunit.client.1.smithi174.stdout:8/710: write d4/de/d23/d3c/f7f [1634508,61386] 0 2024-05-06T14:04:16.254 INFO:tasks.workunit.client.1.smithi174.stdout:8/711: mkdir d4/de/d23/d41/d56/dc0/df0 0 2024-05-06T14:04:16.254 INFO:tasks.workunit.client.1.smithi174.stdout:8/712: rename d4/d15/c81 to d4/de/d23/d3c/db2/cf1 0 2024-05-06T14:04:16.254 INFO:tasks.workunit.client.1.smithi174.stdout:8/713: dread - d4/de/d24/d46/fa2 zero size 2024-05-06T14:04:16.256 INFO:tasks.workunit.client.1.smithi174.stdout:5/729: dwrite d1/d6/d2a/f2d [3657728,69632] 0 2024-05-06T14:04:16.256 INFO:tasks.workunit.client.1.smithi174.stdout:5/730: mkdir d1/d6/df/d35/d8b/d9f/df8 0 2024-05-06T14:04:16.257 INFO:tasks.workunit.client.1.smithi174.stdout:5/731: rename d1/d6/df/d35/d81/d60/db0/fac to d1/d6/d7/d36/d53/d59/d61/ff9 0 2024-05-06T14:04:16.257 INFO:tasks.workunit.client.1.smithi174.stdout:5/732: unlink d1/d6/d7/f95 0 2024-05-06T14:04:16.257 INFO:tasks.workunit.client.1.smithi174.stdout:5/733: dread d1/d6/d7/d36/d53/d59/d61/ff9 [28672,53248] 0 2024-05-06T14:04:16.257 INFO:tasks.workunit.client.1.smithi174.stdout:5/734: dread d1/d6/d7/d36/f7f [131072,28672] 0 2024-05-06T14:04:16.257 INFO:tasks.workunit.client.1.smithi174.stdout:5/735: truncate d1/d6/df/d35/d81/d60/db0/f33 386160 0 2024-05-06T14:04:16.257 INFO:tasks.workunit.client.1.smithi174.stdout:5/736: rmdir d1/d6/df/de2 39 2024-05-06T14:04:16.257 INFO:tasks.workunit.client.1.smithi174.stdout:5/737: write d1/d6/d7/da1/dd8/de7/fef [291349,18161] 0 2024-05-06T14:04:16.258 INFO:tasks.workunit.client.1.smithi174.stdout:5/738: mknod d1/d6/df/de2/cfa 0 2024-05-06T14:04:16.258 INFO:tasks.workunit.client.1.smithi174.stdout:5/739: write d1/d6/df/d35/d81/d1e/fe1 [672020,80324] 0 2024-05-06T14:04:16.258 INFO:tasks.workunit.client.1.smithi174.stdout:2/597: dwrite d0/d24/d77/d93/f9c [1216512,4096] 0 2024-05-06T14:04:16.259 INFO:tasks.workunit.client.1.smithi174.stdout:2/598: chown d0/d1 9 1 2024-05-06T14:04:16.259 INFO:tasks.workunit.client.1.smithi174.stdout:8/714: dwrite d4/de/f72 [126976,90112] 0 2024-05-06T14:04:16.259 INFO:tasks.workunit.client.1.smithi174.stdout:8/715: link d4/l1d d4/de/d23/d3c/db2/da6/lf2 0 2024-05-06T14:04:16.373 INFO:tasks.workunit.client.1.smithi174.stdout:5/740: dwrite d1/d6/df/d35/d81/daf/feb [90112,122880] 0 2024-05-06T14:04:16.373 INFO:tasks.workunit.client.1.smithi174.stdout:5/741: chown d1/d6/df/d35/d81/fd9 3418 1 2024-05-06T14:04:16.442 INFO:tasks.workunit.client.1.smithi174.stdout:5/742: fsync d1/d6/d7/d36/d53/d59/d61/f7e 0 2024-05-06T14:04:16.444 INFO:tasks.workunit.client.1.smithi174.stdout:5/743: creat d1/d6/d7/d36/d53/ffb x:0 0 0 2024-05-06T14:04:16.444 INFO:tasks.workunit.client.1.smithi174.stdout:5/744: unlink d1/d6/d7/fca 0 2024-05-06T14:04:16.498 INFO:tasks.workunit.client.1.smithi174.stdout:5/745: fsync d1/d6/d7/d3e/fbc 0 2024-05-06T14:04:16.499 INFO:tasks.workunit.client.1.smithi174.stdout:5/746: dread d1/d6/d7/d36/d53/f98 [192512,57344] 0 2024-05-06T14:04:16.501 INFO:tasks.workunit.client.1.smithi174.stdout:5/747: rename d1/d6/d2a to d1/d6/d7/da1/dfc 0 2024-05-06T14:04:16.502 INFO:tasks.workunit.client.1.smithi174.stdout:5/748: mknod d1/d6/cfd 0 2024-05-06T14:04:16.502 INFO:tasks.workunit.client.1.smithi174.stdout:5/749: getdents d1/d6/d7/da1 0 2024-05-06T14:04:16.583 INFO:tasks.workunit.client.1.smithi174.stdout:5/750: fdatasync d1/d6/d7/d3e/d4c/ff3 0 2024-05-06T14:04:16.584 INFO:tasks.workunit.client.1.smithi174.stdout:5/751: rmdir d1/d6/d7/d8e 39 2024-05-06T14:04:16.586 INFO:tasks.workunit.client.1.smithi174.stdout:5/752: creat d1/d6/df/d35/d81/d60/db0/de/dbd/ffe x:0 0 0 2024-05-06T14:04:16.588 INFO:tasks.workunit.client.1.smithi174.stdout:5/753: dwrite d1/d6/df/d35/d8b/d9f/fa9 [1003520,94208] 0 2024-05-06T14:04:16.588 INFO:tasks.workunit.client.1.smithi174.stdout:5/754: creat d1/d6/d7/d36/d53/d59/fff x:0 0 0 2024-05-06T14:04:16.593 INFO:tasks.workunit.client.1.smithi174.stdout:5/755: read d1/d6/df/d35/d81/d60/db0/de/f89 [319784,94635] 0 2024-05-06T14:04:16.599 INFO:tasks.workunit.client.1.smithi174.stdout:5/756: dread d1/d6/df/d35/d81/daf/feb [155648,20480] 0 2024-05-06T14:04:16.600 INFO:tasks.workunit.client.1.smithi174.stdout:5/757: write d1/d6/df/d35/d81/d60/db0/d41/f8f [1261368,19690] 0 2024-05-06T14:04:16.600 INFO:tasks.workunit.client.1.smithi174.stdout:5/758: creat d1/d6/d7/d8e/f100 x:0 0 0 2024-05-06T14:04:16.600 INFO:tasks.workunit.client.1.smithi174.stdout:0/597: sync 2024-05-06T14:04:16.600 INFO:tasks.workunit.client.1.smithi174.stdout:3/571: sync 2024-05-06T14:04:16.600 INFO:tasks.workunit.client.1.smithi174.stdout:9/588: sync 2024-05-06T14:04:16.600 INFO:tasks.workunit.client.1.smithi174.stdout:7/521: sync 2024-05-06T14:04:16.600 INFO:tasks.workunit.client.1.smithi174.stdout:4/688: sync 2024-05-06T14:04:16.601 INFO:tasks.workunit.client.1.smithi174.stdout:5/759: read d1/d6/d7/d3e/d4c/ff3 [1391037,97219] 0 2024-05-06T14:04:16.601 INFO:tasks.workunit.client.1.smithi174.stdout:8/716: sync 2024-05-06T14:04:16.601 INFO:tasks.workunit.client.1.smithi174.stdout:7/522: dread - d0/d1d/da4/d61/d19/d24/f87 zero size 2024-05-06T14:04:16.601 INFO:tasks.workunit.client.1.smithi174.stdout:2/599: sync 2024-05-06T14:04:16.601 INFO:tasks.workunit.client.1.smithi174.stdout:5/760: read - d1/d6/d7/da1/f88 zero size 2024-05-06T14:04:16.601 INFO:tasks.workunit.client.1.smithi174.stdout:7/523: stat d0/d1d/da4/d61/fb 0 2024-05-06T14:04:16.601 INFO:tasks.workunit.client.1.smithi174.stdout:0/598: write d0/d4/f37 [1332726,8079] 0 2024-05-06T14:04:16.601 INFO:tasks.workunit.client.1.smithi174.stdout:2/600: truncate d0/da/d3f/d67/f80 249098 0 2024-05-06T14:04:16.602 INFO:tasks.workunit.client.1.smithi174.stdout:9/589: symlink dc/d17/d3a/lc7 0 2024-05-06T14:04:16.602 INFO:tasks.workunit.client.1.smithi174.stdout:5/761: truncate d1/d6/df/d35/d81/d8d/fb3 485395 0 2024-05-06T14:04:16.602 INFO:tasks.workunit.client.1.smithi174.stdout:8/717: creat d4/d15/d20/d3e/d79/d94/ff3 x:0 0 0 2024-05-06T14:04:16.602 INFO:tasks.workunit.client.1.smithi174.stdout:7/524: mkdir d0/d1d/da4/d61/d19/d39/d90/da6/db6 0 2024-05-06T14:04:16.602 INFO:tasks.workunit.client.1.smithi174.stdout:9/590: getdents dc/d17/d3a/db2 0 2024-05-06T14:04:16.602 INFO:tasks.workunit.client.1.smithi174.stdout:4/689: write d1/d9/d15/d74/d86/fc4 [1514465,48190] 0 2024-05-06T14:04:16.602 INFO:tasks.workunit.client.1.smithi174.stdout:9/591: stat dc/f3d 0 2024-05-06T14:04:16.602 INFO:tasks.workunit.client.1.smithi174.stdout:9/592: chown dc/de/f68 168881 1 2024-05-06T14:04:16.603 INFO:tasks.workunit.client.1.smithi174.stdout:7/525: unlink d0/d1d/da4/d61/d19/d24/d89/f8f 0 2024-05-06T14:04:16.603 INFO:tasks.workunit.client.1.smithi174.stdout:8/718: unlink d4/d15/f1e 0 2024-05-06T14:04:16.603 INFO:tasks.workunit.client.1.smithi174.stdout:0/599: write d0/d1a/f30 [892901,105596] 0 2024-05-06T14:04:16.603 INFO:tasks.workunit.client.1.smithi174.stdout:9/593: mkdir dc/d27/d51/dc8 0 2024-05-06T14:04:16.603 INFO:tasks.workunit.client.1.smithi174.stdout:7/526: mkdir d0/d1d/da4/d61/d19/db7 0 2024-05-06T14:04:16.603 INFO:tasks.workunit.client.1.smithi174.stdout:8/719: getdents d4/d15/da1 0 2024-05-06T14:04:16.603 INFO:tasks.workunit.client.1.smithi174.stdout:9/594: truncate dc/d27/d60/daf/f6c 405397 0 2024-05-06T14:04:16.603 INFO:tasks.workunit.client.1.smithi174.stdout:7/527: read d0/d1d/da4/d61/d19/d39/f78 [55089,7027] 0 2024-05-06T14:04:16.604 INFO:tasks.workunit.client.1.smithi174.stdout:0/600: dread d0/d3/dad/fa9 [266240,40960] 0 2024-05-06T14:04:16.604 INFO:tasks.workunit.client.1.smithi174.stdout:2/601: dread d0/da/f74 [499712,122880] 0 2024-05-06T14:04:16.604 INFO:tasks.workunit.client.1.smithi174.stdout:7/528: truncate d0/d1d/d9c/dad/fb4 1864812 0 2024-05-06T14:04:16.604 INFO:tasks.workunit.client.1.smithi174.stdout:9/595: rename dc/d27/d51/dc8 to dc/d27/dc9 0 2024-05-06T14:04:16.604 INFO:tasks.workunit.client.1.smithi174.stdout:0/601: getdents d0/d4/d80/d93/dbe 0 2024-05-06T14:04:16.604 INFO:tasks.workunit.client.1.smithi174.stdout:2/602: truncate d0/db/f86 441901 0 2024-05-06T14:04:16.604 INFO:tasks.workunit.client.1.smithi174.stdout:5/762: write d1/d6/df/d35/d81/d60/d82/ff5 [183717,121277] 0 2024-05-06T14:04:16.604 INFO:tasks.workunit.client.1.smithi174.stdout:7/529: rename d0/d1d/f77 to d0/d1d/da4/d61/d19/d39/d90/da6/fb8 0 2024-05-06T14:04:16.605 INFO:tasks.workunit.client.1.smithi174.stdout:9/596: dread dc/de/d6b/f8b [479232,73728] 0 2024-05-06T14:04:16.605 INFO:tasks.workunit.client.1.smithi174.stdout:9/597: write dc/de/d6b/f71 [260306,52596] 0 2024-05-06T14:04:16.605 INFO:tasks.workunit.client.1.smithi174.stdout:2/603: symlink d0/d1/d2/d4/d18/lbf 0 2024-05-06T14:04:16.605 INFO:tasks.workunit.client.1.smithi174.stdout:3/572: symlink df/d10/d1b/lb3 0 2024-05-06T14:04:16.605 INFO:tasks.workunit.client.1.smithi174.stdout:9/598: mknod dc/cca 0 2024-05-06T14:04:16.605 INFO:tasks.workunit.client.1.smithi174.stdout:5/763: write d1/d6/d7/d36/fc8 [1416773,82260] 0 2024-05-06T14:04:16.605 INFO:tasks.workunit.client.1.smithi174.stdout:6/751: sync 2024-05-06T14:04:16.605 INFO:tasks.workunit.client.1.smithi174.stdout:1/586: sync 2024-05-06T14:04:16.606 INFO:tasks.workunit.client.1.smithi174.stdout:9/599: rename dc/d27/d60 to dc/d17/d3a/dcb 0 2024-05-06T14:04:16.606 INFO:tasks.workunit.client.1.smithi174.stdout:1/587: chown d11/d1f/d27/d2d/l90 979291454 1 2024-05-06T14:04:16.606 INFO:tasks.workunit.client.1.smithi174.stdout:5/764: dread d1/d6/d7/d36/d53/f9e [12288,77824] 0 2024-05-06T14:04:16.606 INFO:tasks.workunit.client.1.smithi174.stdout:9/600: rmdir dc/d17/d3a 39 2024-05-06T14:04:16.606 INFO:tasks.workunit.client.1.smithi174.stdout:3/573: truncate df/d2d/d87/f88 190491 0 2024-05-06T14:04:16.606 INFO:tasks.workunit.client.1.smithi174.stdout:1/588: link d11/d1f/d55/l6d d11/d57/d98/daf/ld1 0 2024-05-06T14:04:16.606 INFO:tasks.workunit.client.1.smithi174.stdout:3/574: readlink df/l32 0 2024-05-06T14:04:16.606 INFO:tasks.workunit.client.1.smithi174.stdout:9/601: creat dc/d9b/fcc x:0 0 0 2024-05-06T14:04:16.606 INFO:tasks.workunit.client.1.smithi174.stdout:9/602: mknod dc/de/d81/ccd 0 2024-05-06T14:04:16.607 INFO:tasks.workunit.client.1.smithi174.stdout:3/575: write df/d10/f16 [1922608,65967] 0 2024-05-06T14:04:16.607 INFO:tasks.workunit.client.1.smithi174.stdout:3/576: rmdir df/d10/d1b 39 2024-05-06T14:04:16.607 INFO:tasks.workunit.client.1.smithi174.stdout:3/577: getdents df/d10/d1b/d7e/d5a 0 2024-05-06T14:04:16.607 INFO:tasks.workunit.client.1.smithi174.stdout:3/578: link df/d2d/d4e/fac df/d2d/d4d/fb4 0 2024-05-06T14:04:16.607 INFO:tasks.workunit.client.1.smithi174.stdout:3/579: rename df/d10/l29 to df/d2d/d87/lb5 0 2024-05-06T14:04:16.607 INFO:tasks.workunit.client.1.smithi174.stdout:3/580: chown df/d2d/d5b 49 1 2024-05-06T14:04:16.671 INFO:tasks.workunit.client.1.smithi174.stdout:8/720: dwrite d4/de/d23/d3c/db2/da6/dad/fef [741376,12288] 0 2024-05-06T14:04:16.672 INFO:tasks.workunit.client.1.smithi174.stdout:8/721: creat d4/de/d23/d3c/db2/da6/ff4 x:0 0 0 2024-05-06T14:04:16.672 INFO:tasks.workunit.client.1.smithi174.stdout:8/722: dread d4/de/d23/d3c/fbb [4096,61440] 0 2024-05-06T14:04:16.672 INFO:tasks.workunit.client.1.smithi174.stdout:8/723: write d4/de/f17 [1528204,71823] 0 2024-05-06T14:04:16.672 INFO:tasks.workunit.client.1.smithi174.stdout:8/724: dread d4/de/f12 [651264,8192] 0 2024-05-06T14:04:16.672 INFO:tasks.workunit.client.1.smithi174.stdout:8/725: chown d4/de/d23/d41/d56/f9c 2423470 1 2024-05-06T14:04:16.672 INFO:tasks.workunit.client.1.smithi174.stdout:8/726: getdents d4/de/d24/d46/d63 0 2024-05-06T14:04:16.672 INFO:tasks.workunit.client.1.smithi174.stdout:8/727: mknod d4/d15/d66/cf5 0 2024-05-06T14:04:16.673 INFO:tasks.workunit.client.1.smithi174.stdout:8/728: readlink d4/de/d24/d5e/d85/d91/lc5 0 2024-05-06T14:04:16.673 INFO:tasks.workunit.client.1.smithi174.stdout:8/729: dread - d4/de/d24/d46/d63/fac zero size 2024-05-06T14:04:16.673 INFO:tasks.workunit.client.1.smithi174.stdout:8/730: dread d4/de/f17 [1150976,32768] 0 2024-05-06T14:04:16.673 INFO:tasks.workunit.client.1.smithi174.stdout:8/731: rmdir d4/d15/d20/d3e/d79/d94 39 2024-05-06T14:04:16.673 INFO:tasks.workunit.client.1.smithi174.stdout:8/732: symlink d4/de/d23/d3c/db2/da6/dad/lf6 0 2024-05-06T14:04:16.673 INFO:tasks.workunit.client.1.smithi174.stdout:8/733: readlink d4/de/d23/lcb 0 2024-05-06T14:04:16.673 INFO:tasks.workunit.client.1.smithi174.stdout:8/734: symlink d4/lf7 0 2024-05-06T14:04:16.678 INFO:tasks.workunit.client.1.smithi174.stdout:0/602: dwrite d0/d1a/d17/f9e [266240,69632] 0 2024-05-06T14:04:16.679 INFO:tasks.workunit.client.1.smithi174.stdout:0/603: rmdir d0/d16 39 2024-05-06T14:04:16.679 INFO:tasks.workunit.client.1.smithi174.stdout:0/604: write d0/d36/f3b [185303,59750] 0 2024-05-06T14:04:16.679 INFO:tasks.workunit.client.1.smithi174.stdout:0/605: getdents d0/d4/d8/d25 0 2024-05-06T14:04:16.679 INFO:tasks.workunit.client.1.smithi174.stdout:0/606: chown d0/d4/d8/d25/d5c 1480223 1 2024-05-06T14:04:16.679 INFO:tasks.workunit.client.1.smithi174.stdout:0/607: rmdir d0/d3/d5d 39 2024-05-06T14:04:16.679 INFO:tasks.workunit.client.1.smithi174.stdout:0/608: creat d0/fc3 x:0 0 0 2024-05-06T14:04:16.679 INFO:tasks.workunit.client.1.smithi174.stdout:0/609: truncate d0/d1a/d17/d2e/f5f 670503 0 2024-05-06T14:04:16.679 INFO:tasks.workunit.client.1.smithi174.stdout:0/610: symlink d0/d3/lc4 0 2024-05-06T14:04:16.680 INFO:tasks.workunit.client.1.smithi174.stdout:7/530: dwrite d0/d1d/da4/d61/f5c [1220608,118784] 0 2024-05-06T14:04:16.680 INFO:tasks.workunit.client.1.smithi174.stdout:0/611: write d0/d36/f3b [934504,48064] 0 2024-05-06T14:04:16.680 INFO:tasks.workunit.client.1.smithi174.stdout:0/612: write d0/d4/d8/f47 [1292992,26228] 0 2024-05-06T14:04:16.680 INFO:tasks.workunit.client.1.smithi174.stdout:0/613: dread - d0/d1a/d17/f2a zero size 2024-05-06T14:04:16.680 INFO:tasks.workunit.client.1.smithi174.stdout:7/531: truncate d0/d1d/da4/d61/d19/d39/d46/f57 1150929 0 2024-05-06T14:04:16.680 INFO:tasks.workunit.client.1.smithi174.stdout:0/614: chown d0/d1a/d17/fe 406818084 1 2024-05-06T14:04:16.680 INFO:tasks.workunit.client.1.smithi174.stdout:7/532: creat d0/d1d/da4/d61/fb9 x:0 0 0 2024-05-06T14:04:16.680 INFO:tasks.workunit.client.1.smithi174.stdout:0/615: creat d0/d36/d45/fc5 x:0 0 0 2024-05-06T14:04:16.681 INFO:tasks.workunit.client.1.smithi174.stdout:0/616: creat d0/d4/d80/d93/dbe/fc6 x:0 0 0 2024-05-06T14:04:16.681 INFO:tasks.workunit.client.1.smithi174.stdout:7/533: symlink d0/d3a/lba 0 2024-05-06T14:04:16.681 INFO:tasks.workunit.client.1.smithi174.stdout:7/534: rmdir d0/d1d/d9c 39 2024-05-06T14:04:16.681 INFO:tasks.workunit.client.1.smithi174.stdout:7/535: chown d0/d1d/da4/d61/d28/c4f 0 1 2024-05-06T14:04:16.681 INFO:tasks.workunit.client.1.smithi174.stdout:0/617: symlink d0/d4/d8/d25/d5c/d44/lc7 0 2024-05-06T14:04:16.681 INFO:tasks.workunit.client.1.smithi174.stdout:2/604: dwrite d0/d1/d2/d4/fb4 [180224,98304] 0 2024-05-06T14:04:16.681 INFO:tasks.workunit.client.1.smithi174.stdout:0/618: symlink d0/d3/d5d/d83/lc8 0 2024-05-06T14:04:16.681 INFO:tasks.workunit.client.1.smithi174.stdout:2/605: stat d0/d1/d2/d2a/l52 0 2024-05-06T14:04:16.682 INFO:tasks.workunit.client.1.smithi174.stdout:0/619: rename d0/d36/d45/cb2 to d0/d36/d3f/cc9 0 2024-05-06T14:04:16.682 INFO:tasks.workunit.client.1.smithi174.stdout:0/620: chown d0/d4/d8/d25/d5c/d44/cb6 1035237632 1 2024-05-06T14:04:16.682 INFO:tasks.workunit.client.1.smithi174.stdout:0/621: mknod d0/d1a/d17/cca 0 2024-05-06T14:04:16.682 INFO:tasks.workunit.client.1.smithi174.stdout:2/606: dread d0/d1/f94 [507904,57344] 0 2024-05-06T14:04:16.682 INFO:tasks.workunit.client.1.smithi174.stdout:2/607: rename d0/d1/d2/d2a/cb1 to d0/d16/cc0 0 2024-05-06T14:04:16.682 INFO:tasks.workunit.client.1.smithi174.stdout:0/622: mkdir d0/d4/d8/d25/d5c/d4a/da7/dcb 0 2024-05-06T14:04:16.682 INFO:tasks.workunit.client.1.smithi174.stdout:0/623: rename d0/d3/d5d/f35 to d0/d16/fcc 0 2024-05-06T14:04:16.683 INFO:tasks.workunit.client.1.smithi174.stdout:2/608: dread d0/d1/d2/d4/d18/d2d/d32/f47 [540672,4096] 0 2024-05-06T14:04:16.683 INFO:tasks.workunit.client.1.smithi174.stdout:0/624: readlink d0/d4/d8/d25/d5c/d4a/l88 0 2024-05-06T14:04:16.683 INFO:tasks.workunit.client.1.smithi174.stdout:2/609: link d0/d16/la5 d0/da/d3f/da6/lc1 0 2024-05-06T14:04:16.683 INFO:tasks.workunit.client.1.smithi174.stdout:2/610: creat d0/d1/d2/d4/d6/d3c/da2/fc2 x:0 0 0 2024-05-06T14:04:16.683 INFO:tasks.workunit.client.1.smithi174.stdout:0/625: write d0/d4/d8/d25/d5c/f87 [538764,73975] 0 2024-05-06T14:04:16.683 INFO:tasks.workunit.client.1.smithi174.stdout:2/611: rmdir d0/d1 39 2024-05-06T14:04:16.683 INFO:tasks.workunit.client.1.smithi174.stdout:2/612: unlink d0/d1/d2/cb9 0 2024-05-06T14:04:16.683 INFO:tasks.workunit.client.1.smithi174.stdout:2/613: read d0/db/f86 [39661,92415] 0 2024-05-06T14:04:16.684 INFO:tasks.workunit.client.1.smithi174.stdout:6/752: dwrite d0/d25/f30 [794624,90112] 0 2024-05-06T14:04:16.684 INFO:tasks.workunit.client.1.smithi174.stdout:6/753: dread d0/f73 [200704,69632] 0 2024-05-06T14:04:16.684 INFO:tasks.workunit.client.1.smithi174.stdout:6/754: rmdir d0/d25/d52/d2c/d6f 39 2024-05-06T14:04:16.684 INFO:tasks.workunit.client.1.smithi174.stdout:2/614: creat d0/d1/fc3 x:0 0 0 2024-05-06T14:04:16.684 INFO:tasks.workunit.client.1.smithi174.stdout:2/615: unlink d0/d1/d2/d4/d18/d97/cb3 0 2024-05-06T14:04:16.684 INFO:tasks.workunit.client.1.smithi174.stdout:2/616: unlink d0/d1/d2/d4/f46 0 2024-05-06T14:04:16.684 INFO:tasks.workunit.client.1.smithi174.stdout:2/617: stat d0/d1/d2/d4/d6/d3c/da2 0 2024-05-06T14:04:16.684 INFO:tasks.workunit.client.1.smithi174.stdout:1/589: dwrite d11/d1f/fa7 [1720320,94208] 0 2024-05-06T14:04:16.684 INFO:tasks.workunit.client.1.smithi174.stdout:1/590: symlink d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/ld2 0 2024-05-06T14:04:16.685 INFO:tasks.workunit.client.1.smithi174.stdout:1/591: rename d11 to d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/dd3 22 2024-05-06T14:04:16.685 INFO:tasks.workunit.client.1.smithi174.stdout:9/603: dwrite dc/de/f4f [282624,20480] 0 2024-05-06T14:04:16.685 INFO:tasks.workunit.client.1.smithi174.stdout:9/604: write dc/f3d [323665,107180] 0 2024-05-06T14:04:16.685 INFO:tasks.workunit.client.1.smithi174.stdout:3/581: dwrite df/d10/d1b/f56 [192512,90112] 0 2024-05-06T14:04:16.685 INFO:tasks.workunit.client.1.smithi174.stdout:3/582: chown df/d10/d1b/d7e/d5a/f77 205797 1 2024-05-06T14:04:16.685 INFO:tasks.workunit.client.1.smithi174.stdout:3/583: write df/f90 [1988335,109235] 0 2024-05-06T14:04:16.685 INFO:tasks.workunit.client.1.smithi174.stdout:3/584: mkdir df/d2d/d4e/db6 0 2024-05-06T14:04:16.685 INFO:tasks.workunit.client.1.smithi174.stdout:3/585: write df/d10/d1b/d7e/f51 [2050111,10750] 0 2024-05-06T14:04:16.686 INFO:tasks.workunit.client.1.smithi174.stdout:3/586: symlink df/d10/d1b/d7e/lb7 0 2024-05-06T14:04:16.686 INFO:tasks.workunit.client.1.smithi174.stdout:3/587: getdents df/d2d/d84 0 2024-05-06T14:04:16.686 INFO:tasks.workunit.client.1.smithi174.stdout:5/765: dread d1/d6/f54 [212992,69632] 0 2024-05-06T14:04:16.687 INFO:tasks.workunit.client.1.smithi174.stdout:8/735: dread d4/d15/d20/f5f [999424,90112] 0 2024-05-06T14:04:16.687 INFO:tasks.workunit.client.1.smithi174.stdout:8/736: creat d4/de/d23/d41/d56/de6/ff8 x:0 0 0 2024-05-06T14:04:16.687 INFO:tasks.workunit.client.1.smithi174.stdout:8/737: chown d4/d15/d20/d3e/d79/dcc/fed 0 1 2024-05-06T14:04:16.687 INFO:tasks.workunit.client.1.smithi174.stdout:8/738: creat d4/d15/da1/ff9 x:0 0 0 2024-05-06T14:04:16.687 INFO:tasks.workunit.client.1.smithi174.stdout:8/739: mknod d4/d15/d20/d3e/d79/dbf/cfa 0 2024-05-06T14:04:16.688 INFO:tasks.workunit.client.1.smithi174.stdout:8/740: read - d4/de/d23/d41/d4e/fe3 zero size 2024-05-06T14:04:16.688 INFO:tasks.workunit.client.1.smithi174.stdout:8/741: dread d4/f35 [1740800,86016] 0 2024-05-06T14:04:16.688 INFO:tasks.workunit.client.1.smithi174.stdout:8/742: getdents d4/d15/d20/d3e 0 2024-05-06T14:04:16.688 INFO:tasks.workunit.client.1.smithi174.stdout:8/743: write d4/de/d23/d41/f4c [781649,37978] 0 2024-05-06T14:04:16.778 INFO:tasks.workunit.client.1.smithi174.stdout:7/536: fsync d0/d1d/da4/d61/d19/d24/d47/d70/d83/fae 0 2024-05-06T14:04:16.778 INFO:tasks.workunit.client.1.smithi174.stdout:7/537: write d0/d1d/d9c/dad/fb4 [256819,130592] 0 2024-05-06T14:04:16.778 INFO:tasks.workunit.client.1.smithi174.stdout:7/538: write d0/d1d/da4/d61/d19/d39/f78 [1480524,86888] 0 2024-05-06T14:04:16.779 INFO:tasks.workunit.client.1.smithi174.stdout:7/539: creat d0/d1d/da4/d61/d19/d24/fbb x:0 0 0 2024-05-06T14:04:16.779 INFO:tasks.workunit.client.1.smithi174.stdout:7/540: rmdir d0/d1d/da4/d61/d19/d24/d14 39 2024-05-06T14:04:16.782 INFO:tasks.workunit.client.1.smithi174.stdout:2/618: dwrite d0/d16/f85 [856064,4096] 0 2024-05-06T14:04:16.782 INFO:tasks.workunit.client.1.smithi174.stdout:2/619: read d0/d1/d2/d2a/f70 [250914,38554] 0 2024-05-06T14:04:16.782 INFO:tasks.workunit.client.1.smithi174.stdout:2/620: unlink d0/d1/d2/d4/d51/f9d 0 2024-05-06T14:04:16.782 INFO:tasks.workunit.client.1.smithi174.stdout:2/621: read d0/d1/d2/d2a/f70 [240947,105513] 0 2024-05-06T14:04:16.783 INFO:tasks.workunit.client.1.smithi174.stdout:9/605: dwrite dc/f36 [1085440,81920] 0 2024-05-06T14:04:16.783 INFO:tasks.workunit.client.1.smithi174.stdout:2/622: write d0/da/f3b [443489,36938] 0 2024-05-06T14:04:16.783 INFO:tasks.workunit.client.1.smithi174.stdout:2/623: unlink d0/d1/d2/d1b/d90/cae 0 2024-05-06T14:04:16.783 INFO:tasks.workunit.client.1.smithi174.stdout:8/744: dwrite d4/de/d23/d41/d4e/fe3 [954368,49152] 0 2024-05-06T14:04:16.783 INFO:tasks.workunit.client.1.smithi174.stdout:8/745: chown d4/de/d23/ldf 450432672 1 2024-05-06T14:04:16.783 INFO:tasks.workunit.client.1.smithi174.stdout:8/746: dread d4/de/d23/d3c/f7f [712704,126976] 0 2024-05-06T14:04:16.783 INFO:tasks.workunit.client.1.smithi174.stdout:8/747: truncate d4/de/d24/d5e/d85/fd1 398884 0 2024-05-06T14:04:16.783 INFO:tasks.workunit.client.1.smithi174.stdout:8/748: read d4/de/fa3 [535250,62127] 0 2024-05-06T14:04:16.784 INFO:tasks.workunit.client.1.smithi174.stdout:5/766: dwrite d1/d6/d7/f2e [684032,86016] 0 2024-05-06T14:04:16.784 INFO:tasks.workunit.client.1.smithi174.stdout:5/767: chown d1/d6/d7/d36/d53/d59/d61/d69/dd4 3 1 2024-05-06T14:04:16.784 INFO:tasks.workunit.client.1.smithi174.stdout:5/768: dread d1/d6/d7/d36/f7f [110592,49152] 0 2024-05-06T14:04:16.784 INFO:tasks.workunit.client.1.smithi174.stdout:7/541: dwrite d0/d1d/da4/d61/d19/d24/d6f/d88/f95 [1220608,90112] 0 2024-05-06T14:04:16.784 INFO:tasks.workunit.client.1.smithi174.stdout:2/624: dwrite d0/d1/f94 [32768,28672] 0 2024-05-06T14:04:16.784 INFO:tasks.workunit.client.1.smithi174.stdout:9/606: dwrite dc/d1c/f41 [245760,4096] 0 2024-05-06T14:04:16.784 INFO:tasks.workunit.client.1.smithi174.stdout:2/625: write d0/d16/f85 [1045887,80963] 0 2024-05-06T14:04:16.784 INFO:tasks.workunit.client.1.smithi174.stdout:9/607: write dc/df/f12 [593752,117230] 0 2024-05-06T14:04:16.785 INFO:tasks.workunit.client.1.smithi174.stdout:2/626: write d0/d1/d2/d4/d18/f91 [23186,100628] 0 2024-05-06T14:04:16.785 INFO:tasks.workunit.client.1.smithi174.stdout:3/588: dread df/d10/d1b/f2b [196608,94208] 0 2024-05-06T14:04:16.786 INFO:tasks.workunit.client.1.smithi174.stdout:3/589: write df/d10/faa [229510,107817] 0 2024-05-06T14:04:16.820 INFO:tasks.workunit.client.1.smithi174.stdout:6/755: fsync d0/df/d45/d4b/f82 0 2024-05-06T14:04:16.821 INFO:tasks.workunit.client.1.smithi174.stdout:2/627: fdatasync d0/d16/f5f 0 2024-05-06T14:04:16.822 INFO:tasks.workunit.client.1.smithi174.stdout:8/749: dwrite d4/de/d23/f25 [3141632,102400] 0 2024-05-06T14:04:16.822 INFO:tasks.workunit.client.1.smithi174.stdout:8/750: dread - d4/de/d24/d46/d63/fac zero size 2024-05-06T14:04:16.823 INFO:tasks.workunit.client.1.smithi174.stdout:7/542: dwrite d0/d1d/da4/f4b [3289088,36864] 0 2024-05-06T14:04:16.823 INFO:tasks.workunit.client.1.smithi174.stdout:7/543: write d0/d1d/da4/d61/d19/d39/f8b [328877,67166] 0 2024-05-06T14:04:16.825 INFO:tasks.workunit.client.1.smithi174.stdout:5/769: rename d1/d6/df/fc6 to d1/d6/d7/d8e/f101 0 2024-05-06T14:04:16.825 INFO:tasks.workunit.client.1.smithi174.stdout:3/590: mkdir df/d2d/d4e/db6/db8 0 2024-05-06T14:04:16.825 INFO:tasks.workunit.client.1.smithi174.stdout:2/628: creat d0/da/d3f/da6/fc4 x:0 0 0 2024-05-06T14:04:16.825 INFO:tasks.workunit.client.1.smithi174.stdout:5/770: chown d1/d6/d7/d36/d53/d59/d61/d69/dd4/fd7 1107 1 2024-05-06T14:04:16.825 INFO:tasks.workunit.client.1.smithi174.stdout:9/608: truncate dc/f4e 1018274 0 2024-05-06T14:04:16.825 INFO:tasks.workunit.client.1.smithi174.stdout:5/771: chown d1/d6/d7/d36/d53/d59/d61/lb1 863 1 2024-05-06T14:04:16.825 INFO:tasks.workunit.client.1.smithi174.stdout:6/756: creat d0/d25/d52/dba/ff7 x:0 0 0 2024-05-06T14:04:16.826 INFO:tasks.workunit.client.1.smithi174.stdout:2/629: dread d0/d1/d2/d4/d6/f7a [172032,94208] 0 2024-05-06T14:04:16.826 INFO:tasks.workunit.client.1.smithi174.stdout:3/591: mkdir df/d2d/d4e/db6/db9 0 2024-05-06T14:04:16.826 INFO:tasks.workunit.client.1.smithi174.stdout:9/609: dread - dc/d17/d3a/dcb/daf/d43/d8e/f92 zero size 2024-05-06T14:04:16.826 INFO:tasks.workunit.client.1.smithi174.stdout:2/630: chown d0/d24/d77 1898 1 2024-05-06T14:04:16.826 INFO:tasks.workunit.client.1.smithi174.stdout:3/592: chown df/d2d/d4e/fac 101725 1 2024-05-06T14:04:16.826 INFO:tasks.workunit.client.1.smithi174.stdout:9/610: rename dc/d17/d3a/dcb to dc/d17/d3a/dcb/daf/dce 22 2024-05-06T14:04:16.826 INFO:tasks.workunit.client.1.smithi174.stdout:3/593: unlink df/d10/d1b/l85 0 2024-05-06T14:04:16.826 INFO:tasks.workunit.client.1.smithi174.stdout:2/631: write d0/d1/d2/d4/d18/d2d/d32/f53 [463858,22373] 0 2024-05-06T14:04:16.827 INFO:tasks.workunit.client.1.smithi174.stdout:3/594: symlink df/lba 0 2024-05-06T14:04:16.855 INFO:tasks.workunit.client.1.smithi174.stdout:8/751: fdatasync d4/d15/fd2 0 2024-05-06T14:04:16.855 INFO:tasks.workunit.client.1.smithi174.stdout:8/752: truncate d4/d48/f90 1170323 0 2024-05-06T14:04:16.855 INFO:tasks.workunit.client.1.smithi174.stdout:8/753: dread d4/d15/d20/d3e/d79/fcf [684032,73728] 0 2024-05-06T14:04:16.855 INFO:tasks.workunit.client.1.smithi174.stdout:8/754: creat d4/de/d24/d5e/d85/d91/ffb x:0 0 0 2024-05-06T14:04:16.856 INFO:tasks.workunit.client.1.smithi174.stdout:8/755: rename d4/d48/fa7 to d4/de/d23/d3c/ffc 0 2024-05-06T14:04:16.856 INFO:tasks.workunit.client.1.smithi174.stdout:8/756: mkdir d4/d15/d64/dfd 0 2024-05-06T14:04:16.856 INFO:tasks.workunit.client.1.smithi174.stdout:8/757: rmdir d4/de/d23/d3c/db2/da6 39 2024-05-06T14:04:16.856 INFO:tasks.workunit.client.1.smithi174.stdout:8/758: truncate d4/de/d24/d5e/fd7 778071 0 2024-05-06T14:04:16.856 INFO:tasks.workunit.client.1.smithi174.stdout:3/595: fdatasync df/d10/d1b/d7e/d57/f61 0 2024-05-06T14:04:16.856 INFO:tasks.workunit.client.1.smithi174.stdout:3/596: truncate df/d10/d1b/f33 234308 0 2024-05-06T14:04:16.856 INFO:tasks.workunit.client.1.smithi174.stdout:8/759: write d4/d15/d20/d3e/d79/dbf/fe2 [2607875,20236] 0 2024-05-06T14:04:16.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/760: creat d4/de/d23/d41/d56/dc0/df0/ffe x:0 0 0 2024-05-06T14:04:16.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/761: creat d4/d15/d20/d3e/d79/d94/fff x:0 0 0 2024-05-06T14:04:16.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/762: getdents d4/de/d23/d41/d56 0 2024-05-06T14:04:16.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/763: symlink d4/d15/da1/l100 0 2024-05-06T14:04:16.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/764: rename d4/de/d24/d5e/d85/fd0 to d4/de/d23/d41/d56/de6/f101 0 2024-05-06T14:04:16.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/765: truncate d4/d15/d20/d3e/d79/fcf 1131342 0 2024-05-06T14:04:16.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/766: unlink d4/de/d23/d3c/c4b 0 2024-05-06T14:04:16.857 INFO:tasks.workunit.client.1.smithi174.stdout:8/767: stat d4/d15/d20/d3e/d79/dcc 0 2024-05-06T14:04:16.858 INFO:tasks.workunit.client.1.smithi174.stdout:8/768: mknod d4/de/d23/d3c/db2/da6/c102 0 2024-05-06T14:04:16.858 INFO:tasks.workunit.client.1.smithi174.stdout:8/769: rmdir d4/de/d24/d5e/d85/d91 39 2024-05-06T14:04:16.858 INFO:tasks.workunit.client.1.smithi174.stdout:7/544: dwrite d0/d1d/da4/d61/d19/d24/f48 [905216,81920] 0 2024-05-06T14:04:16.858 INFO:tasks.workunit.client.1.smithi174.stdout:7/545: chown d0/d1d 15618 1 2024-05-06T14:04:16.858 INFO:tasks.workunit.client.1.smithi174.stdout:8/770: write d4/d15/d20/d3e/d79/fcf [1330860,23875] 0 2024-05-06T14:04:16.858 INFO:tasks.workunit.client.1.smithi174.stdout:8/771: mkdir d4/de/d23/d41/d56/dc0/d103 0 2024-05-06T14:04:16.860 INFO:tasks.workunit.client.1.smithi174.stdout:2/632: dwrite d0/d16/f96 [143360,77824] 0 2024-05-06T14:04:16.860 INFO:tasks.workunit.client.1.smithi174.stdout:2/633: symlink d0/d1/d2/d4/d18/d2d/d32/d89/lc5 0 2024-05-06T14:04:16.860 INFO:tasks.workunit.client.1.smithi174.stdout:9/611: dwrite dc/d17/d3a/dcb/daf/f97 [143360,118784] 0 2024-05-06T14:04:16.860 INFO:tasks.workunit.client.1.smithi174.stdout:9/612: creat dc/d1c/fcf x:0 0 0 2024-05-06T14:04:16.860 INFO:tasks.workunit.client.1.smithi174.stdout:5/772: dwrite d1/d6/f9 [1937408,53248] 0 2024-05-06T14:04:16.861 INFO:tasks.workunit.client.1.smithi174.stdout:6/757: dwrite d0/df/d45/da9/db3/fd8 [892928,4096] 0 2024-05-06T14:04:16.861 INFO:tasks.workunit.client.1.smithi174.stdout:6/758: creat d0/d25/d52/d2c/d5f/ff8 x:0 0 0 2024-05-06T14:04:16.861 INFO:tasks.workunit.client.1.smithi174.stdout:6/759: mkdir d0/df/d3c/df9 0 2024-05-06T14:04:16.861 INFO:tasks.workunit.client.1.smithi174.stdout:6/760: chown d0/d25/d52/d3b/f95 1 1 2024-05-06T14:04:16.861 INFO:tasks.workunit.client.1.smithi174.stdout:3/597: dwrite df/d10/d1b/f24 [385024,77824] 0 2024-05-06T14:04:16.861 INFO:tasks.workunit.client.1.smithi174.stdout:3/598: mknod df/d2d/d84/cbb 0 2024-05-06T14:04:16.861 INFO:tasks.workunit.client.1.smithi174.stdout:7/546: dwrite d0/d1d/da4/d61/f5c [61440,4096] 0 2024-05-06T14:04:16.861 INFO:tasks.workunit.client.1.smithi174.stdout:7/547: link d0/d1d/da4/d61/d19/d39/c44 d0/d1d/da4/d61/cbc 0 2024-05-06T14:04:16.862 INFO:tasks.workunit.client.1.smithi174.stdout:7/548: creat d0/d1d/da4/d61/d19/d24/d47/fbd x:0 0 0 2024-05-06T14:04:16.862 INFO:tasks.workunit.client.1.smithi174.stdout:7/549: write d0/d1d/da4/d61/f38 [674787,95688] 0 2024-05-06T14:04:16.954 INFO:tasks.workunit.client.1.smithi174.stdout:8/772: fsync d4/de/d23/d3c/db2/f8f 0 2024-05-06T14:04:16.955 INFO:tasks.workunit.client.1.smithi174.stdout:8/773: readlink d4/d15/da1/l100 0 2024-05-06T14:04:16.955 INFO:tasks.workunit.client.1.smithi174.stdout:8/774: mknod d4/de/d23/d41/dce/c104 0 2024-05-06T14:04:16.955 INFO:tasks.workunit.client.1.smithi174.stdout:8/775: chown d4/de/d24/d5e/d85/d91/lc7 436532914 1 2024-05-06T14:04:16.955 INFO:tasks.workunit.client.1.smithi174.stdout:2/634: fsync d0/d1/d2/d4/f6c 0 2024-05-06T14:04:16.955 INFO:tasks.workunit.client.1.smithi174.stdout:9/613: fsync dc/de/d6b/fa0 0 2024-05-06T14:04:16.955 INFO:tasks.workunit.client.1.smithi174.stdout:6/761: fsync d0/d25/d52/d3b/f95 0 2024-05-06T14:04:16.955 INFO:tasks.workunit.client.1.smithi174.stdout:9/614: readlink dc/d17/d3a/dcb/lb6 0 2024-05-06T14:04:16.956 INFO:tasks.workunit.client.1.smithi174.stdout:8/776: write d4/d15/d20/d3e/d79/f7d [355687,108156] 0 2024-05-06T14:04:16.960 INFO:tasks.workunit.client.1.smithi174.stdout:9/615: creat dc/d17/d3a/dcb/daf/d43/d8e/fd0 x:0 0 0 2024-05-06T14:04:16.960 INFO:tasks.workunit.client.1.smithi174.stdout:9/616: rmdir dc/de 39 2024-05-06T14:04:16.960 INFO:tasks.workunit.client.1.smithi174.stdout:5/773: dwrite d1/d6/d7/d3e/f77 [2068480,122880] 0 2024-05-06T14:04:16.960 INFO:tasks.workunit.client.1.smithi174.stdout:8/777: symlink d4/de/d23/l105 0 2024-05-06T14:04:16.960 INFO:tasks.workunit.client.1.smithi174.stdout:3/599: dwrite df/d10/f4c [1548288,8192] 0 2024-05-06T14:04:16.960 INFO:tasks.workunit.client.1.smithi174.stdout:6/762: write d0/d25/d52/d2c/f69 [172250,93482] 0 2024-05-06T14:04:16.960 INFO:tasks.workunit.client.1.smithi174.stdout:3/600: chown df/d10/d1b/d59/ca0 324071592 1 2024-05-06T14:04:16.961 INFO:tasks.workunit.client.1.smithi174.stdout:9/617: creat dc/de/d81/da6/fd1 x:0 0 0 2024-05-06T14:04:16.961 INFO:tasks.workunit.client.1.smithi174.stdout:6/763: read - d0/d25/d52/fc0 zero size 2024-05-06T14:04:16.961 INFO:tasks.workunit.client.1.smithi174.stdout:2/635: unlink d0/d1/f5 0 2024-05-06T14:04:16.961 INFO:tasks.workunit.client.1.smithi174.stdout:7/550: dwrite d0/d1d/da4/d61/d19/f5b [2166784,73728] 0 2024-05-06T14:04:16.961 INFO:tasks.workunit.client.1.smithi174.stdout:2/636: write d0/da/d3f/d67/fb8 [82477,57198] 0 2024-05-06T14:04:16.961 INFO:tasks.workunit.client.1.smithi174.stdout:2/637: creat d0/fc6 x:0 0 0 2024-05-06T14:04:16.961 INFO:tasks.workunit.client.1.smithi174.stdout:2/638: truncate d0/db/d15/f2e 1327799 0 2024-05-06T14:04:16.962 INFO:tasks.workunit.client.1.smithi174.stdout:2/639: rmdir d0/da 39 2024-05-06T14:04:16.962 INFO:tasks.workunit.client.1.smithi174.stdout:2/640: mkdir d0/d1/d2/d4/d6/d3c/dc7 0 2024-05-06T14:04:17.043 INFO:tasks.workunit.client.1.smithi174.stdout:5/774: dwrite d1/d6/d7/da1/dd8/de7/fef [245760,8192] 0 2024-05-06T14:04:17.043 INFO:tasks.workunit.client.1.smithi174.stdout:5/775: rename d1/d6/d7/d36/d53/d59/c75 to d1/ddf/c102 0 2024-05-06T14:04:17.043 INFO:tasks.workunit.client.1.smithi174.stdout:5/776: creat d1/d6/d7/d8e/f103 x:0 0 0 2024-05-06T14:04:17.044 INFO:tasks.workunit.client.1.smithi174.stdout:8/778: dread d4/de/d23/d41/d56/f71 [925696,61440] 0 2024-05-06T14:04:17.044 INFO:tasks.workunit.client.1.smithi174.stdout:8/779: truncate d4/de/d24/d5e/d85/fd1 414860 0 2024-05-06T14:04:17.044 INFO:tasks.workunit.client.1.smithi174.stdout:8/780: write d4/de/f12 [747066,52285] 0 2024-05-06T14:04:17.044 INFO:tasks.workunit.client.1.smithi174.stdout:3/601: dwrite df/d10/d1b/f5c [2387968,53248] 0 2024-05-06T14:04:17.045 INFO:tasks.workunit.client.1.smithi174.stdout:3/602: getdents df/d2d/d5b 0 2024-05-06T14:04:17.045 INFO:tasks.workunit.client.1.smithi174.stdout:3/603: mkdir df/dbc 0 2024-05-06T14:04:17.052 INFO:tasks.workunit.client.1.smithi174.stdout:6/764: write d0/fd2 [870403,82624] 0 2024-05-06T14:04:17.095 INFO:tasks.workunit.client.1.smithi174.stdout:9/618: fsync dc/d27/d63/fa3 0 2024-05-06T14:04:17.095 INFO:tasks.workunit.client.1.smithi174.stdout:5/777: fdatasync d1/d6/d7/da1/f88 0 2024-05-06T14:04:17.095 INFO:tasks.workunit.client.1.smithi174.stdout:9/619: chown dc/d27/l7a 10892032 1 2024-05-06T14:04:17.095 INFO:tasks.workunit.client.1.smithi174.stdout:5/778: dread d1/d6/df/d35/d81/d60/db0/d41/f8f [348160,12288] 0 2024-05-06T14:04:17.095 INFO:tasks.workunit.client.1.smithi174.stdout:5/779: creat d1/d6/df/d35/d81/d8d/f104 x:0 0 0 2024-05-06T14:04:17.096 INFO:tasks.workunit.client.1.smithi174.stdout:5/780: dread - d1/d6/df/d35/d81/d60/db0/de/dbd/ffe zero size 2024-05-06T14:04:17.096 INFO:tasks.workunit.client.1.smithi174.stdout:9/620: write dc/d17/d4c/f72 [3017832,65758] 0 2024-05-06T14:04:17.096 INFO:tasks.workunit.client.1.smithi174.stdout:5/781: mknod d1/d6/d7/d36/d53/d59/c105 0 2024-05-06T14:04:17.096 INFO:tasks.workunit.client.1.smithi174.stdout:8/781: dwrite d4/d15/d20/fdd [122880,106496] 0 2024-05-06T14:04:17.098 INFO:tasks.workunit.client.1.smithi174.stdout:3/604: mknod df/d2d/d87/cbd 0 2024-05-06T14:04:17.098 INFO:tasks.workunit.client.1.smithi174.stdout:3/605: rename df/d2d/d4d/c82 to df/d10/da2/cbe 0 2024-05-06T14:04:17.098 INFO:tasks.workunit.client.1.smithi174.stdout:3/606: symlink df/d2d/d4e/db6/db9/lbf 0 2024-05-06T14:04:17.099 INFO:tasks.workunit.client.1.smithi174.stdout:6/765: dwrite d0/d25/d52/d2c/d6f/f72 [1495040,102400] 0 2024-05-06T14:04:17.100 INFO:tasks.workunit.client.1.smithi174.stdout:9/621: dwrite dc/de/d7f/d93/fbe [94208,90112] 0 2024-05-06T14:04:17.100 INFO:tasks.workunit.client.1.smithi174.stdout:5/782: dwrite d1/d6/df/de2/ff4 [294912,122880] 0 2024-05-06T14:04:17.106 INFO:tasks.workunit.client.1.smithi174.stdout:3/607: dread df/d2d/d87/f88 [90112,110592] 0 2024-05-06T14:04:17.106 INFO:tasks.workunit.client.1.smithi174.stdout:3/608: write df/d10/d1b/f20 [177452,64076] 0 2024-05-06T14:04:17.135 INFO:tasks.workunit.client.1.smithi174.stdout:8/782: fdatasync d4/d15/d20/d3e/f93 0 2024-05-06T14:04:17.140 INFO:tasks.workunit.client.1.smithi174.stdout:5/783: rename d1/d6/d7/c23 to d1/d6/d7/c106 0 2024-05-06T14:04:17.140 INFO:tasks.workunit.client.1.smithi174.stdout:9/622: mkdir dc/d17/d3a/dcb/daf/d43/d8e/dd2 0 2024-05-06T14:04:17.140 INFO:tasks.workunit.client.1.smithi174.stdout:5/784: stat d1/d6/df/d35/d81/d60/db0/d41/l49 0 2024-05-06T14:04:17.140 INFO:tasks.workunit.client.1.smithi174.stdout:8/783: rename d4/de/d24/c88 to d4/de/d24/d46/d63/db7/c106 0 2024-05-06T14:04:17.141 INFO:tasks.workunit.client.1.smithi174.stdout:3/609: creat df/d10/fc0 x:0 0 0 2024-05-06T14:04:17.141 INFO:tasks.workunit.client.1.smithi174.stdout:5/785: dread d1/d6/f34 [77824,45056] 0 2024-05-06T14:04:17.141 INFO:tasks.workunit.client.1.smithi174.stdout:8/784: dread - d4/de/d23/d41/d56/dc0/df0/ffe zero size 2024-05-06T14:04:17.141 INFO:tasks.workunit.client.1.smithi174.stdout:3/610: rename df/d2d/d87/f88 to df/d2d/d4e/db6/fc1 0 2024-05-06T14:04:17.141 INFO:tasks.workunit.client.1.smithi174.stdout:3/611: symlink df/d10/d1b/d59/lc2 0 2024-05-06T14:04:17.141 INFO:tasks.workunit.client.1.smithi174.stdout:8/785: write d4/d15/d20/d3e/d79/d94/ff3 [740866,48102] 0 2024-05-06T14:04:17.141 INFO:tasks.workunit.client.1.smithi174.stdout:3/612: symlink df/d10/d1b/lc3 0 2024-05-06T14:04:17.141 INFO:tasks.workunit.client.1.smithi174.stdout:8/786: write d4/de/d24/f2e [56266,68713] 0 2024-05-06T14:04:17.142 INFO:tasks.workunit.client.1.smithi174.stdout:8/787: truncate d4/de/d23/d41/d56/dc0/fc6 854312 0 2024-05-06T14:04:17.142 INFO:tasks.workunit.client.1.smithi174.stdout:8/788: mkdir d4/de/d23/d3c/db2/da6/dad/d107 0 2024-05-06T14:04:17.142 INFO:tasks.workunit.client.1.smithi174.stdout:8/789: getdents d4/de/d23 0 2024-05-06T14:04:17.142 INFO:tasks.workunit.client.1.smithi174.stdout:8/790: truncate d4/de/d24/d46/d63/f6f 281221 0 2024-05-06T14:04:17.142 INFO:tasks.workunit.client.1.smithi174.stdout:3/613: write df/d10/d1b/d7e/f6d [475646,117173] 0 2024-05-06T14:04:17.142 INFO:tasks.workunit.client.1.smithi174.stdout:3/614: dread fd [487424,110592] 0 2024-05-06T14:04:17.157 INFO:tasks.workunit.client.1.smithi174.stdout:6/766: fdatasync d0/d25/d52/d3b/f95 0 2024-05-06T14:04:17.157 INFO:tasks.workunit.client.1.smithi174.stdout:6/767: chown d0/d25/d52/d2c/d5f/ff8 31 1 2024-05-06T14:04:17.159 INFO:tasks.workunit.client.1.smithi174.stdout:9/623: dwrite dc/de/f2e [970752,77824] 0 2024-05-06T14:04:17.162 INFO:tasks.workunit.client.1.smithi174.stdout:5/786: truncate d1/d6/df/d35/d81/f1a 456703 0 2024-05-06T14:04:17.162 INFO:tasks.workunit.client.1.smithi174.stdout:5/787: dread - d1/d6/df/d35/d81/d60/db0/de/fa6 zero size 2024-05-06T14:04:17.162 INFO:tasks.workunit.client.1.smithi174.stdout:5/788: creat d1/d6/df/d35/d81/f107 x:0 0 0 2024-05-06T14:04:17.162 INFO:tasks.workunit.client.1.smithi174.stdout:5/789: rename d1/d6/cfd to d1/d6/df/d35/d8b/d9f/df8/c108 0 2024-05-06T14:04:17.162 INFO:tasks.workunit.client.1.smithi174.stdout:5/790: truncate d1/d6/d7/d36/d53/ffb 523885 0 2024-05-06T14:04:17.163 INFO:tasks.workunit.client.1.smithi174.stdout:5/791: dread d1/d6/d7/d36/f2c [524288,8192] 0 2024-05-06T14:04:17.163 INFO:tasks.workunit.client.1.smithi174.stdout:6/768: write d0/df/d3c/f8b [658490,73641] 0 2024-05-06T14:04:17.163 INFO:tasks.workunit.client.1.smithi174.stdout:6/769: mkdir d0/d25/d52/d2c/d6f/dfa 0 2024-05-06T14:04:17.163 INFO:tasks.workunit.client.1.smithi174.stdout:6/770: write d0/d25/d52/d2c/d5f/ff8 [83016,66838] 0 2024-05-06T14:04:17.163 INFO:tasks.workunit.client.1.smithi174.stdout:6/771: rename d0/d25/d52/d2c/d5f/dc9 to d0/d25/d35/de3/dfb 0 2024-05-06T14:04:17.190 INFO:tasks.workunit.client.1.smithi174.stdout:8/791: fsync d4/d15/f4d 0 2024-05-06T14:04:17.194 INFO:tasks.workunit.client.1.smithi174.stdout:6/772: dwrite d0/d25/d35/f9b [491520,4096] 0 2024-05-06T14:04:17.194 INFO:tasks.workunit.client.1.smithi174.stdout:6/773: creat d0/d25/d52/ffc x:0 0 0 2024-05-06T14:04:17.195 INFO:tasks.workunit.client.1.smithi174.stdout:6/774: mknod d0/d25/d35/de3/dfb/cfd 0 2024-05-06T14:04:17.195 INFO:tasks.workunit.client.1.smithi174.stdout:6/775: write d0/f73 [2304282,98082] 0 2024-05-06T14:04:17.195 INFO:tasks.workunit.client.1.smithi174.stdout:6/776: creat d0/df/d45/d4b/ffe x:0 0 0 2024-05-06T14:04:17.195 INFO:tasks.workunit.client.1.smithi174.stdout:6/777: write d0/df/d3c/f9f [254385,114213] 0 2024-05-06T14:04:17.195 INFO:tasks.workunit.client.1.smithi174.stdout:6/778: rename d0/d25/d52/fc0 to d0/d25/d52/d4c/fff 0 2024-05-06T14:04:17.196 INFO:tasks.workunit.client.1.smithi174.stdout:6/779: truncate d0/d25/d35/fa4 1606199 0 2024-05-06T14:04:17.196 INFO:tasks.workunit.client.1.smithi174.stdout:6/780: creat d0/d93/f100 x:0 0 0 2024-05-06T14:04:17.196 INFO:tasks.workunit.client.1.smithi174.stdout:8/792: dwrite d4/d15/d20/d3e/d79/dbf/fe2 [3641344,49152] 0 2024-05-06T14:04:17.199 INFO:tasks.workunit.client.1.smithi174.stdout:5/792: write d1/d6/df/d35/d8b/d9f/fb5 [534719,51961] 0 2024-05-06T14:04:17.201 INFO:tasks.workunit.client.1.smithi174.stdout:5/793: unlink d1/d6/df/d35/d81/daf/le3 0 2024-05-06T14:04:17.202 INFO:tasks.workunit.client.1.smithi174.stdout:9/624: write dc/df/f4a [495411,113388] 0 2024-05-06T14:04:17.204 INFO:tasks.workunit.client.1.smithi174.stdout:6/781: dread d0/df/d45/d4b/f86 [933888,114688] 0 2024-05-06T14:04:17.204 INFO:tasks.workunit.client.1.smithi174.stdout:9/625: write dc/f3d [1238639,91669] 0 2024-05-06T14:04:17.204 INFO:tasks.workunit.client.1.smithi174.stdout:8/793: dwrite d4/d15/d64/f7c [503808,114688] 0 2024-05-06T14:04:17.207 INFO:tasks.workunit.client.1.smithi174.stdout:5/794: dwrite d1/d6/d7/f2e [950272,77824] 0 2024-05-06T14:04:17.208 INFO:tasks.workunit.client.1.smithi174.stdout:5/795: link d1/d6/df/d35/d81/d8d/l9b d1/ddf/l109 0 2024-05-06T14:04:17.210 INFO:tasks.workunit.client.1.smithi174.stdout:6/782: creat d0/df/d45/d85/f101 x:0 0 0 2024-05-06T14:04:17.210 INFO:tasks.workunit.client.1.smithi174.stdout:5/796: rename d1/d6/df/d35/d81/d1e/c4e to d1/d6/d7/d3e/c10a 0 2024-05-06T14:04:17.211 INFO:tasks.workunit.client.1.smithi174.stdout:6/783: truncate d0/d25/f98 324159 0 2024-05-06T14:04:17.211 INFO:tasks.workunit.client.1.smithi174.stdout:6/784: chown d0/df/d45/lcc 24447603 1 2024-05-06T14:04:17.211 INFO:tasks.workunit.client.1.smithi174.stdout:6/785: creat d0/d25/d52/d2c/d5f/f102 x:0 0 0 2024-05-06T14:04:17.211 INFO:tasks.workunit.client.1.smithi174.stdout:6/786: symlink d0/d25/d52/d4c/l103 0 2024-05-06T14:04:17.211 INFO:tasks.workunit.client.1.smithi174.stdout:5/797: write d1/d6/df/d35/d81/d60/db0/de/dbd/ffe [570466,124488] 0 2024-05-06T14:04:17.211 INFO:tasks.workunit.client.1.smithi174.stdout:6/787: rename d0/df/d45/f47 to d0/df/d45/da9/db3/f104 0 2024-05-06T14:04:17.211 INFO:tasks.workunit.client.1.smithi174.stdout:5/798: truncate d1/d6/d7/d36/f2c 5038630 0 2024-05-06T14:04:17.211 INFO:tasks.workunit.client.1.smithi174.stdout:6/788: stat d0/d25/d35/ca7 0 2024-05-06T14:04:17.212 INFO:tasks.workunit.client.1.smithi174.stdout:5/799: unlink d1/d6/d7/l51 0 2024-05-06T14:04:17.212 INFO:tasks.workunit.client.1.smithi174.stdout:6/789: rename d0/df/d45 to d0/d25/d52/d2c/d105 0 2024-05-06T14:04:17.212 INFO:tasks.workunit.client.1.smithi174.stdout:5/800: dread d1/d6/df/d35/d81/d60/db0/f3c [36864,40960] 0 2024-05-06T14:04:17.212 INFO:tasks.workunit.client.1.smithi174.stdout:5/801: write d1/d6/df/d35/d81/d60/db0/f3c [23011,36177] 0 2024-05-06T14:04:17.214 INFO:tasks.workunit.client.1.smithi174.stdout:9/626: dwrite dc/de/d7f/da4/fc4 [536576,45056] 0 2024-05-06T14:04:17.215 INFO:tasks.workunit.client.1.smithi174.stdout:9/627: rename dc/d1c/c52 to dc/de/d7f/cd3 0 2024-05-06T14:04:17.215 INFO:tasks.workunit.client.1.smithi174.stdout:9/628: chown dc/d17/d3a/dcb/daf/d43/c57 38 1 2024-05-06T14:04:17.215 INFO:tasks.workunit.client.1.smithi174.stdout:9/629: mkdir dc/d9b/dd4 0 2024-05-06T14:04:17.215 INFO:tasks.workunit.client.1.smithi174.stdout:9/630: read dc/d27/d63/f9e [375461,18534] 0 2024-05-06T14:04:17.215 INFO:tasks.workunit.client.1.smithi174.stdout:9/631: truncate f2 1779545 0 2024-05-06T14:04:17.215 INFO:tasks.workunit.client.1.smithi174.stdout:9/632: chown dc/d17/d3a/dcb/daf/d43 31 1 2024-05-06T14:04:17.215 INFO:tasks.workunit.client.1.smithi174.stdout:9/633: stat dc/d17/d3a/l3f 0 2024-05-06T14:04:17.215 INFO:tasks.workunit.client.1.smithi174.stdout:6/790: dwrite d0/f7c [757760,126976] 0 2024-05-06T14:04:17.216 INFO:tasks.workunit.client.1.smithi174.stdout:6/791: dread d0/d25/d52/d2c/fa8 [1490944,94208] 0 2024-05-06T14:04:17.216 INFO:tasks.workunit.client.1.smithi174.stdout:6/792: truncate d0/d25/d52/d3b/f53 1324776 0 2024-05-06T14:04:17.216 INFO:tasks.workunit.client.1.smithi174.stdout:6/793: mkdir d0/d25/d52/d2c/d105/d85/ddf/ded/d106 0 2024-05-06T14:04:17.216 INFO:tasks.workunit.client.1.smithi174.stdout:4/690: sync 2024-05-06T14:04:17.216 INFO:tasks.workunit.client.1.smithi174.stdout:1/592: sync 2024-05-06T14:04:17.216 INFO:tasks.workunit.client.1.smithi174.stdout:0/626: sync 2024-05-06T14:04:17.216 INFO:tasks.workunit.client.1.smithi174.stdout:0/627: mkdir d0/d3/d5d/d38/dcd 0 2024-05-06T14:04:17.216 INFO:tasks.workunit.client.1.smithi174.stdout:1/593: write d11/d1f/d27/d32/d84/f9a [267206,121915] 0 2024-05-06T14:04:17.217 INFO:tasks.workunit.client.1.smithi174.stdout:1/594: stat d11/d1f/d27/d32/d84/d8c/d94/db0/c93 0 2024-05-06T14:04:17.217 INFO:tasks.workunit.client.1.smithi174.stdout:0/628: write d0/d1a/f30 [1821031,79307] 0 2024-05-06T14:04:17.217 INFO:tasks.workunit.client.1.smithi174.stdout:0/629: mkdir d0/d4/d8/dce 0 2024-05-06T14:04:17.217 INFO:tasks.workunit.client.1.smithi174.stdout:1/595: mkdir d11/d1f/dd4 0 2024-05-06T14:04:17.217 INFO:tasks.workunit.client.1.smithi174.stdout:1/596: truncate d11/d1f/d27/d32/f59 1714874 0 2024-05-06T14:04:17.217 INFO:tasks.workunit.client.1.smithi174.stdout:1/597: write d11/d1f/d27/d2d/f8b [1187901,80657] 0 2024-05-06T14:04:17.217 INFO:tasks.workunit.client.1.smithi174.stdout:1/598: stat d11/d1f/d27/d32/d84/d8c/d94/db0/lb3 0 2024-05-06T14:04:17.217 INFO:tasks.workunit.client.1.smithi174.stdout:1/599: symlink d11/d1f/d27/d2d/d9c/ld5 0 2024-05-06T14:04:17.218 INFO:tasks.workunit.client.1.smithi174.stdout:1/600: dread d11/d1f/d27/d32/f50 [32768,57344] 0 2024-05-06T14:04:17.218 INFO:tasks.workunit.client.1.smithi174.stdout:1/601: mknod d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/cd6 0 2024-05-06T14:04:17.218 INFO:tasks.workunit.client.1.smithi174.stdout:1/602: rename d11/d57/d98/daf/ld1 to d11/d57/d83/ld7 0 2024-05-06T14:04:17.353 INFO:tasks.workunit.client.1.smithi174.stdout:1/603: dwrite d11/d1f/f7f [339968,81920] 0 2024-05-06T14:04:17.353 INFO:tasks.workunit.client.1.smithi174.stdout:1/604: write f1 [3118722,61525] 0 2024-05-06T14:04:17.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/605: creat d11/d57/fd8 x:0 0 0 2024-05-06T14:04:17.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/606: dread d11/d41/f66 [28672,118784] 0 2024-05-06T14:04:17.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/607: dread d11/d57/d98/daf/db2/fba [155648,40960] 0 2024-05-06T14:04:17.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/608: truncate d11/d1f/d27/f5d 1928664 0 2024-05-06T14:04:17.354 INFO:tasks.workunit.client.1.smithi174.stdout:6/794: dwrite d0/d25/d52/d2c/fa8 [1990656,102400] 0 2024-05-06T14:04:17.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/609: rename d11/d1f/c3f to d11/d1f/d27/d32/d84/d8c/cd9 0 2024-05-06T14:04:17.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/610: mknod d11/d41/dc9/d6c/cda 0 2024-05-06T14:04:17.355 INFO:tasks.workunit.client.1.smithi174.stdout:6/795: rmdir d0/d25/d52/d2c/d105/d85/ddf/ded/d106 0 2024-05-06T14:04:17.355 INFO:tasks.workunit.client.1.smithi174.stdout:1/611: chown d11/d1f/d27/d32/d84/d8c/d94/db0/cc7 514 1 2024-05-06T14:04:17.355 INFO:tasks.workunit.client.1.smithi174.stdout:6/796: link d0/d25/d52/d2c/d6f/fbc d0/d25/d52/f107 0 2024-05-06T14:04:17.355 INFO:tasks.workunit.client.1.smithi174.stdout:6/797: write d0/d25/d52/d2c/d105/d4b/f82 [1495825,73715] 0 2024-05-06T14:04:17.355 INFO:tasks.workunit.client.1.smithi174.stdout:6/798: chown d0/d25/d52/d2c/f6a 354798722 1 2024-05-06T14:04:17.355 INFO:tasks.workunit.client.1.smithi174.stdout:0/630: dwrite d0/d4/d8/f47 [2125824,102400] 0 2024-05-06T14:04:17.355 INFO:tasks.workunit.client.1.smithi174.stdout:0/631: dread - d0/f51 zero size 2024-05-06T14:04:17.355 INFO:tasks.workunit.client.1.smithi174.stdout:0/632: link d0/f24 d0/d3/d5d/d83/fcf 0 2024-05-06T14:04:17.355 INFO:tasks.workunit.client.1.smithi174.stdout:0/633: creat d0/d1a/d17/fd0 x:0 0 0 2024-05-06T14:04:17.356 INFO:tasks.workunit.client.1.smithi174.stdout:0/634: mknod d0/d36/d45/cd1 0 2024-05-06T14:04:17.356 INFO:tasks.workunit.client.1.smithi174.stdout:0/635: stat d0/d1a/f22 0 2024-05-06T14:04:17.356 INFO:tasks.workunit.client.1.smithi174.stdout:0/636: truncate d0/d16/f3a 386435 0 2024-05-06T14:04:17.356 INFO:tasks.workunit.client.1.smithi174.stdout:0/637: write d0/d36/d45/fc5 [1004029,26659] 0 2024-05-06T14:04:17.356 INFO:tasks.workunit.client.1.smithi174.stdout:0/638: rename d0/d1a/d17/c74 to d0/d4/d8/d25/d5c/d4a/da7/cd2 0 2024-05-06T14:04:17.356 INFO:tasks.workunit.client.1.smithi174.stdout:0/639: stat d0/d4/d8/d25 0 2024-05-06T14:04:17.356 INFO:tasks.workunit.client.1.smithi174.stdout:0/640: unlink d0/d3/d5d/d83/fcf 0 2024-05-06T14:04:17.356 INFO:tasks.workunit.client.1.smithi174.stdout:0/641: readlink d0/d4/d8/d25/l6a 0 2024-05-06T14:04:17.356 INFO:tasks.workunit.client.1.smithi174.stdout:0/642: symlink d0/d4/ld3 0 2024-05-06T14:04:17.387 INFO:tasks.workunit.client.1.smithi174.stdout:1/612: fsync d11/d57/f96 0 2024-05-06T14:04:17.388 INFO:tasks.workunit.client.1.smithi174.stdout:4/691: fsync d1/d1f/dd6/d6e/d50/db0/fd7 0 2024-05-06T14:04:17.388 INFO:tasks.workunit.client.1.smithi174.stdout:4/692: write d1/d9/d15/d35/fa3 [1424750,66097] 0 2024-05-06T14:04:17.397 INFO:tasks.workunit.client.1.smithi174.stdout:6/799: dwrite d0/d25/d52/d2c/d105/d4b/ffe [815104,73728] 0 2024-05-06T14:04:17.397 INFO:tasks.workunit.client.1.smithi174.stdout:4/693: readlink d1/d9/d15/l44 0 2024-05-06T14:04:17.397 INFO:tasks.workunit.client.1.smithi174.stdout:0/643: dwrite d0/d4/d8/d25/d5c/f4c [454656,16384] 0 2024-05-06T14:04:17.398 INFO:tasks.workunit.client.1.smithi174.stdout:1/613: write d11/d57/d98/daf/db2/fb7 [620056,58287] 0 2024-05-06T14:04:17.398 INFO:tasks.workunit.client.1.smithi174.stdout:0/644: truncate d0/d3/f29 2021952 0 2024-05-06T14:04:17.398 INFO:tasks.workunit.client.1.smithi174.stdout:4/694: rename d1/d48/d5a/d61/d68/dec/ff4 to d1/ff6 0 2024-05-06T14:04:17.398 INFO:tasks.workunit.client.1.smithi174.stdout:1/614: rename d11/d1f/d27/d32/d84/d8c/d94/db0/c93 to d11/d41/cdb 0 2024-05-06T14:04:17.398 INFO:tasks.workunit.client.1.smithi174.stdout:4/695: link d1/d1f/dd6/d6e/d50/db0/fd7 d1/d1f/dd6/d6e/d50/db0/ff7 0 2024-05-06T14:04:17.398 INFO:tasks.workunit.client.1.smithi174.stdout:4/696: dread - d1/d48/d5a/faf zero size 2024-05-06T14:04:17.398 INFO:tasks.workunit.client.1.smithi174.stdout:6/800: truncate d0/d25/d52/d2c/d105/da9/ff0 1324722 0 2024-05-06T14:04:17.398 INFO:tasks.workunit.client.1.smithi174.stdout:1/615: mkdir d11/d1f/d27/d32/d84/ddc 0 2024-05-06T14:04:17.399 INFO:tasks.workunit.client.1.smithi174.stdout:1/616: rmdir d11/d1f/d55 39 2024-05-06T14:04:17.399 INFO:tasks.workunit.client.1.smithi174.stdout:6/801: symlink d0/d25/d52/d2c/l108 0 2024-05-06T14:04:17.399 INFO:tasks.workunit.client.1.smithi174.stdout:6/802: creat d0/d25/d52/d2c/d105/da9/f109 x:0 0 0 2024-05-06T14:04:17.399 INFO:tasks.workunit.client.1.smithi174.stdout:1/617: mkdir d11/d1f/d27/d2d/ddd 0 2024-05-06T14:04:17.399 INFO:tasks.workunit.client.1.smithi174.stdout:6/803: mknod d0/d25/d52/d2c/c10a 0 2024-05-06T14:04:17.399 INFO:tasks.workunit.client.1.smithi174.stdout:6/804: unlink d0/fd2 0 2024-05-06T14:04:17.399 INFO:tasks.workunit.client.1.smithi174.stdout:1/618: write d11/d1f/d27/d32/d84/f9a [191357,130272] 0 2024-05-06T14:04:17.399 INFO:tasks.workunit.client.1.smithi174.stdout:1/619: truncate d11/d57/d83/f97 815293 0 2024-05-06T14:04:17.399 INFO:tasks.workunit.client.1.smithi174.stdout:1/620: dread - d11/d1f/fc4 zero size 2024-05-06T14:04:17.400 INFO:tasks.workunit.client.1.smithi174.stdout:1/621: dread d11/d1f/d27/d2d/f43 [12288,86016] 0 2024-05-06T14:04:17.492 INFO:tasks.workunit.client.1.smithi174.stdout:0/645: dwrite d0/d4/d8/d25/d5c/d4a/f60 [372736,20480] 0 2024-05-06T14:04:17.492 INFO:tasks.workunit.client.1.smithi174.stdout:0/646: readlink d0/d4/d8/d25/d5c/la6 0 2024-05-06T14:04:17.493 INFO:tasks.workunit.client.1.smithi174.stdout:0/647: chown d0/d1a/f1b 52 1 2024-05-06T14:04:17.494 INFO:tasks.workunit.client.1.smithi174.stdout:4/697: dwrite d1/d9/f18 [1560576,57344] 0 2024-05-06T14:04:17.495 INFO:tasks.workunit.client.1.smithi174.stdout:4/698: write d1/d1f/d27/d2c/d45/dc1/fae [164217,35573] 0 2024-05-06T14:04:17.495 INFO:tasks.workunit.client.1.smithi174.stdout:4/699: rename d1/d1f/d27/d2c/ddd to d1/d1f/d27/d2c/d45/df8 0 2024-05-06T14:04:17.495 INFO:tasks.workunit.client.1.smithi174.stdout:4/700: mknod d1/d48/d5a/d61/d68/cf9 0 2024-05-06T14:04:17.495 INFO:tasks.workunit.client.1.smithi174.stdout:4/701: rename d1/l14 to d1/d1f/d27/d2c/d45/lfa 0 2024-05-06T14:04:17.495 INFO:tasks.workunit.client.1.smithi174.stdout:4/702: write d1/d48/d5a/d61/f63 [1573394,23936] 0 2024-05-06T14:04:17.495 INFO:tasks.workunit.client.1.smithi174.stdout:4/703: rename d1/d2e/f46 to d1/d48/d5a/d5f/ffb 0 2024-05-06T14:04:17.495 INFO:tasks.workunit.client.1.smithi174.stdout:4/704: truncate d1/d9/d15/f21 435823 0 2024-05-06T14:04:17.495 INFO:tasks.workunit.client.1.smithi174.stdout:1/622: dwrite d11/d57/d98/daf/db2/fb7 [372736,90112] 0 2024-05-06T14:04:17.496 INFO:tasks.workunit.client.1.smithi174.stdout:1/623: dread - d11/d41/d4a/fa2 zero size 2024-05-06T14:04:17.496 INFO:tasks.workunit.client.1.smithi174.stdout:1/624: dread d11/d57/d98/daf/f87 [225280,114688] 0 2024-05-06T14:04:17.496 INFO:tasks.workunit.client.1.smithi174.stdout:1/625: symlink d11/d41/dc9/lde 0 2024-05-06T14:04:17.496 INFO:tasks.workunit.client.1.smithi174.stdout:1/626: stat d11/d57/d98/daf 0 2024-05-06T14:04:17.496 INFO:tasks.workunit.client.1.smithi174.stdout:1/627: mknod d11/d41/d4a/d5e/cdf 0 2024-05-06T14:04:17.507 INFO:tasks.workunit.client.1.smithi174.stdout:0/648: dread d0/d1a/f1b [1171456,40960] 0 2024-05-06T14:04:17.511 INFO:tasks.workunit.client.1.smithi174.stdout:6/805: dread d0/f8a [282624,86016] 0 2024-05-06T14:04:17.511 INFO:tasks.workunit.client.1.smithi174.stdout:6/806: readlink d0/d25/d52/d2c/d105/d85/lb5 0 2024-05-06T14:04:17.537 INFO:tasks.workunit.client.1.smithi174.stdout:8/794: fsync d4/d15/d20/d3e/d79/f7d 0 2024-05-06T14:04:17.537 INFO:tasks.workunit.client.1.smithi174.stdout:6/807: fsync d0/df/f24 0 2024-05-06T14:04:17.537 INFO:tasks.workunit.client.1.smithi174.stdout:4/705: dread d1/d1f/d27/f38 [933888,73728] 0 2024-05-06T14:04:17.538 INFO:tasks.workunit.client.1.smithi174.stdout:8/795: dwrite d4/de/d23/f25 [4222976,61440] 0 2024-05-06T14:04:17.538 INFO:tasks.workunit.client.1.smithi174.stdout:8/796: dread d4/d15/fd2 [847872,61440] 0 2024-05-06T14:04:17.540 INFO:tasks.workunit.client.1.smithi174.stdout:1/628: dwrite d11/d41/d4a/fa2 [159744,12288] 0 2024-05-06T14:04:17.540 INFO:tasks.workunit.client.1.smithi174.stdout:0/649: dwrite d0/d3/d5d/d83/fbc [425984,110592] 0 2024-05-06T14:04:17.540 INFO:tasks.workunit.client.1.smithi174.stdout:8/797: symlink d4/de/d24/l108 0 2024-05-06T14:04:17.540 INFO:tasks.workunit.client.1.smithi174.stdout:4/706: mkdir d1/d1f/d27/d2c/d45/dfc 0 2024-05-06T14:04:17.540 INFO:tasks.workunit.client.1.smithi174.stdout:6/808: creat d0/d93/f10b x:0 0 0 2024-05-06T14:04:17.540 INFO:tasks.workunit.client.1.smithi174.stdout:0/650: rename d0/d3/f8c to d0/d4/d8/d25/fd4 0 2024-05-06T14:04:17.541 INFO:tasks.workunit.client.1.smithi174.stdout:6/809: truncate d0/df/d3c/f8b 431534 0 2024-05-06T14:04:17.541 INFO:tasks.workunit.client.1.smithi174.stdout:6/810: creat d0/d25/d52/d2c/d105/d85/ddf/f10c x:0 0 0 2024-05-06T14:04:17.570 INFO:tasks.workunit.client.1.smithi174.stdout:4/707: fsync d1/d9/d15/d41/f83 0 2024-05-06T14:04:17.570 INFO:tasks.workunit.client.1.smithi174.stdout:4/708: write d1/d9/d15/d98/d56/f78 [159183,16670] 0 2024-05-06T14:04:17.571 INFO:tasks.workunit.client.1.smithi174.stdout:8/798: dwrite d4/de/f72 [303104,20480] 0 2024-05-06T14:04:17.571 INFO:tasks.workunit.client.1.smithi174.stdout:8/799: creat d4/de/d24/d5e/d85/f109 x:0 0 0 2024-05-06T14:04:17.574 INFO:tasks.workunit.client.1.smithi174.stdout:1/629: dwrite d11/d1f/d27/f45 [917504,20480] 0 2024-05-06T14:04:17.574 INFO:tasks.workunit.client.1.smithi174.stdout:1/630: read d11/d41/d4a/f56 [1263921,75474] 0 2024-05-06T14:04:17.574 INFO:tasks.workunit.client.1.smithi174.stdout:1/631: mknod d11/d1f/d27/d32/d84/d8c/ce0 0 2024-05-06T14:04:17.574 INFO:tasks.workunit.client.1.smithi174.stdout:0/651: dwrite d0/fc3 [258048,94208] 0 2024-05-06T14:04:17.575 INFO:tasks.workunit.client.1.smithi174.stdout:0/652: rename d0/d3/d5d to d0/d4/d8/d25/d5c/d44/dd5 0 2024-05-06T14:04:17.575 INFO:tasks.workunit.client.1.smithi174.stdout:6/811: dwrite d0/df/f20 [1122304,16384] 0 2024-05-06T14:04:17.575 INFO:tasks.workunit.client.1.smithi174.stdout:0/653: rename d0/d4/d80/c85 to d0/d4/d80/d93/cd6 0 2024-05-06T14:04:17.575 INFO:tasks.workunit.client.1.smithi174.stdout:4/709: dwrite d1/d1f/dd6/f7b [724992,4096] 0 2024-05-06T14:04:17.575 INFO:tasks.workunit.client.1.smithi174.stdout:6/812: truncate d0/d25/d52/d4c/fab 1639755 0 2024-05-06T14:04:17.575 INFO:tasks.workunit.client.1.smithi174.stdout:4/710: mkdir d1/d1f/d27/d2c/d45/dfd 0 2024-05-06T14:04:17.575 INFO:tasks.workunit.client.1.smithi174.stdout:0/654: write d0/d3/f8d [991691,93798] 0 2024-05-06T14:04:17.575 INFO:tasks.workunit.client.1.smithi174.stdout:4/711: mkdir d1/d1f/d27/d2c/d45/df8/dfe 0 2024-05-06T14:04:17.575 INFO:tasks.workunit.client.1.smithi174.stdout:0/655: mkdir d0/d4/d8/d25/d5c/d44/dd7 0 2024-05-06T14:04:17.576 INFO:tasks.workunit.client.1.smithi174.stdout:0/656: creat d0/d3/dad/fd8 x:0 0 0 2024-05-06T14:04:17.576 INFO:tasks.workunit.client.1.smithi174.stdout:0/657: chown d0/d1a/d17/d2e/fa3 95837 1 2024-05-06T14:04:17.576 INFO:tasks.workunit.client.1.smithi174.stdout:0/658: creat d0/d4/d8/d25/d5c/d44/db9/fd9 x:0 0 0 2024-05-06T14:04:17.576 INFO:tasks.workunit.client.1.smithi174.stdout:4/712: write d1/d9/d15/d35/fef [437243,76916] 0 2024-05-06T14:04:17.576 INFO:tasks.workunit.client.1.smithi174.stdout:0/659: dread d0/d36/d45/fc5 [782336,24576] 0 2024-05-06T14:04:17.576 INFO:tasks.workunit.client.1.smithi174.stdout:0/660: readlink d0/d4/d80/lb3 0 2024-05-06T14:04:17.576 INFO:tasks.workunit.client.1.smithi174.stdout:0/661: truncate d0/d4/d8/d25/d5c/fc2 844476 0 2024-05-06T14:04:17.576 INFO:tasks.workunit.client.1.smithi174.stdout:0/662: write d0/d36/f9b [1309901,16809] 0 2024-05-06T14:04:17.577 INFO:tasks.workunit.client.1.smithi174.stdout:0/663: truncate d0/d4/d8/d25/d5c/d44/f69 914760 0 2024-05-06T14:04:17.650 INFO:tasks.workunit.client.1.smithi174.stdout:1/632: fdatasync d11/d1f/f7f 0 2024-05-06T14:04:17.659 INFO:tasks.workunit.client.1.smithi174.stdout:4/713: dwrite d1/d9/f42 [950272,65536] 0 2024-05-06T14:04:17.659 INFO:tasks.workunit.client.1.smithi174.stdout:6/813: dwrite d0/d25/d52/da6/fe9 [200704,12288] 0 2024-05-06T14:04:17.659 INFO:tasks.workunit.client.1.smithi174.stdout:6/814: mkdir d0/d25/d52/dba/d10d 0 2024-05-06T14:04:17.660 INFO:tasks.workunit.client.1.smithi174.stdout:6/815: truncate d0/d25/d52/d3b/f53 925779 0 2024-05-06T14:04:17.660 INFO:tasks.workunit.client.1.smithi174.stdout:1/633: dwrite d11/d41/d4a/f81 [479232,24576] 0 2024-05-06T14:04:17.660 INFO:tasks.workunit.client.1.smithi174.stdout:1/634: dread - d11/d1f/d27/d32/d84/d8c/d94/db0/fb9 zero size 2024-05-06T14:04:17.660 INFO:tasks.workunit.client.1.smithi174.stdout:1/635: link d11/d41/d4a/f56 d11/d1f/d27/d32/d84/ddc/fe1 0 2024-05-06T14:04:17.660 INFO:tasks.workunit.client.1.smithi174.stdout:1/636: chown d11/d1f/d27/d32/d92/cbf 724109 1 2024-05-06T14:04:17.748 INFO:tasks.workunit.client.1.smithi174.stdout:4/714: dread d1/d9/f23 [1163264,122880] 0 2024-05-06T14:04:17.748 INFO:tasks.workunit.client.1.smithi174.stdout:4/715: creat d1/d9/d15/d74/d86/dc2/fff x:0 0 0 2024-05-06T14:04:17.752 INFO:tasks.workunit.client.1.smithi174.stdout:4/716: readlink d1/d48/d5a/d61/d68/l6c 0 2024-05-06T14:04:17.752 INFO:tasks.workunit.client.1.smithi174.stdout:4/717: creat d1/d9/d15/d92/f100 x:0 0 0 2024-05-06T14:04:17.753 INFO:tasks.workunit.client.1.smithi174.stdout:6/816: truncate d0/f3a 3361590 0 2024-05-06T14:04:17.753 INFO:tasks.workunit.client.1.smithi174.stdout:6/817: chown d0/d25/d52/l38 5 1 2024-05-06T14:04:17.753 INFO:tasks.workunit.client.1.smithi174.stdout:4/718: write d1/d9/f8e [3244360,129783] 0 2024-05-06T14:04:17.753 INFO:tasks.workunit.client.1.smithi174.stdout:4/719: readlink d1/d1f/dd6/d6e/d50/d95/ldc 0 2024-05-06T14:04:17.753 INFO:tasks.workunit.client.1.smithi174.stdout:4/720: creat d1/d1f/dd6/d6e/f101 x:0 0 0 2024-05-06T14:04:17.753 INFO:tasks.workunit.client.1.smithi174.stdout:4/721: dread d1/d9/d15/f21 [409600,40960] 0 2024-05-06T14:04:17.753 INFO:tasks.workunit.client.1.smithi174.stdout:4/722: dread - d1/d1f/d27/d2c/fc6 zero size 2024-05-06T14:04:17.753 INFO:tasks.workunit.client.1.smithi174.stdout:4/723: dread - d1/d48/d5a/d61/fda zero size 2024-05-06T14:04:17.754 INFO:tasks.workunit.client.1.smithi174.stdout:4/724: chown d1/d1f/ldb 5215501 1 2024-05-06T14:04:17.754 INFO:tasks.workunit.client.1.smithi174.stdout:4/725: write d1/d9/d15/d41/fe9 [1002684,72658] 0 2024-05-06T14:04:17.754 INFO:tasks.workunit.client.1.smithi174.stdout:4/726: dread d1/d2e/f6a [540672,8192] 0 2024-05-06T14:04:17.754 INFO:tasks.workunit.client.1.smithi174.stdout:4/727: stat d1/d2e/f33 0 2024-05-06T14:04:17.754 INFO:tasks.workunit.client.1.smithi174.stdout:4/728: symlink d1/d1f/d27/l102 0 2024-05-06T14:04:17.754 INFO:tasks.workunit.client.1.smithi174.stdout:4/729: mknod d1/d2e/c103 0 2024-05-06T14:04:17.754 INFO:tasks.workunit.client.1.smithi174.stdout:1/637: dwrite d11/d1f/d27/d32/f59 [2002944,122880] 0 2024-05-06T14:04:17.754 INFO:tasks.workunit.client.1.smithi174.stdout:4/730: unlink d1/l2a 0 2024-05-06T14:04:17.755 INFO:tasks.workunit.client.1.smithi174.stdout:4/731: stat d1/d1f/d27/d2c/c43 0 2024-05-06T14:04:17.755 INFO:tasks.workunit.client.1.smithi174.stdout:4/732: truncate d1/ff6 136861 0 2024-05-06T14:04:17.755 INFO:tasks.workunit.client.1.smithi174.stdout:4/733: write d1/d48/d5a/d5f/f8b [704890,72826] 0 2024-05-06T14:04:17.755 INFO:tasks.workunit.client.1.smithi174.stdout:4/734: write d1/d9/d15/d41/fe9 [1485066,55529] 0 2024-05-06T14:04:17.755 INFO:tasks.workunit.client.1.smithi174.stdout:4/735: creat d1/d48/d5a/f104 x:0 0 0 2024-05-06T14:04:17.828 INFO:tasks.workunit.client.1.smithi174.stdout:1/638: fdatasync d11/d1f/fa7 0 2024-05-06T14:04:17.828 INFO:tasks.workunit.client.1.smithi174.stdout:6/818: fdatasync d0/d25/fdc 0 2024-05-06T14:04:17.828 INFO:tasks.workunit.client.1.smithi174.stdout:6/819: truncate d0/d25/f51 3688191 0 2024-05-06T14:04:17.828 INFO:tasks.workunit.client.1.smithi174.stdout:6/820: write d0/d25/f51 [4365759,127665] 0 2024-05-06T14:04:17.829 INFO:tasks.workunit.client.1.smithi174.stdout:6/821: creat d0/d25/d35/de3/dfb/f10e x:0 0 0 2024-05-06T14:04:17.829 INFO:tasks.workunit.client.1.smithi174.stdout:6/822: chown d0/d25/d52/d2c/d6f/f72 981 1 2024-05-06T14:04:17.829 INFO:tasks.workunit.client.1.smithi174.stdout:6/823: write d0/d25/d52/d2c/fa8 [2689927,93174] 0 2024-05-06T14:04:17.829 INFO:tasks.workunit.client.1.smithi174.stdout:6/824: getdents d0/d25/d52/d3b 0 2024-05-06T14:04:17.829 INFO:tasks.workunit.client.1.smithi174.stdout:6/825: truncate d0/d25/d52/d2c/d6f/fef 757542 0 2024-05-06T14:04:17.829 INFO:tasks.workunit.client.1.smithi174.stdout:4/736: dwrite d1/d9/d15/d41/f83 [1024000,106496] 0 2024-05-06T14:04:17.829 INFO:tasks.workunit.client.1.smithi174.stdout:4/737: stat d1/d9/f2d 0 2024-05-06T14:04:17.829 INFO:tasks.workunit.client.1.smithi174.stdout:4/738: readlink d1/d1f/d27/l102 0 2024-05-06T14:04:17.830 INFO:tasks.workunit.client.1.smithi174.stdout:4/739: mknod d1/d1f/dd6/d6e/c105 0 2024-05-06T14:04:17.830 INFO:tasks.workunit.client.1.smithi174.stdout:4/740: read d1/d1f/f62 [55488,119238] 0 2024-05-06T14:04:17.830 INFO:tasks.workunit.client.1.smithi174.stdout:4/741: rmdir d1/d9/d15/d98/d56 39 2024-05-06T14:04:17.830 INFO:tasks.workunit.client.1.smithi174.stdout:4/742: write d1/d9/d15/f4e [782801,81197] 0 2024-05-06T14:04:17.830 INFO:tasks.workunit.client.1.smithi174.stdout:4/743: chown d1/d1f/d27/l102 318163288 1 2024-05-06T14:04:17.830 INFO:tasks.workunit.client.1.smithi174.stdout:4/744: rename d1/d1f/d27/d2c/d45/dfd to d1/d106 0 2024-05-06T14:04:17.830 INFO:tasks.workunit.client.1.smithi174.stdout:4/745: creat d1/d9/d15/d35/dd9/f107 x:0 0 0 2024-05-06T14:04:17.830 INFO:tasks.workunit.client.1.smithi174.stdout:4/746: dread d1/d9/f18 [2183168,49152] 0 2024-05-06T14:04:17.831 INFO:tasks.workunit.client.1.smithi174.stdout:6/826: mkdir d0/d25/d52/d80/d10f 0 2024-05-06T14:04:17.831 INFO:tasks.workunit.client.1.smithi174.stdout:6/827: chown d0/d25/d52/d2c/d105/cd7 10 1 2024-05-06T14:04:17.831 INFO:tasks.workunit.client.1.smithi174.stdout:6/828: chown d0/d25/d52/d3b/c8f 115402994 1 2024-05-06T14:04:17.833 INFO:tasks.workunit.client.1.smithi174.stdout:4/747: dread d1/d9/d15/d98/d56/f78 [593920,122880] 0 2024-05-06T14:04:17.833 INFO:tasks.workunit.client.1.smithi174.stdout:4/748: write d1/d1f/d27/d2c/d45/fe0 [567796,103595] 0 2024-05-06T14:04:17.833 INFO:tasks.workunit.client.1.smithi174.stdout:4/749: symlink d1/d9/d15/dc7/l108 0 2024-05-06T14:04:17.834 INFO:tasks.workunit.client.1.smithi174.stdout:4/750: creat d1/d106/f109 x:0 0 0 2024-05-06T14:04:17.834 INFO:tasks.workunit.client.1.smithi174.stdout:4/751: readlink d1/d1f/dd6/d6e/ld8 0 2024-05-06T14:04:17.834 INFO:tasks.workunit.client.1.smithi174.stdout:4/752: stat d1/d48/d5a/faf 0 2024-05-06T14:04:17.834 INFO:tasks.workunit.client.1.smithi174.stdout:4/753: creat d1/d1f/d27/d2c/d45/f10a x:0 0 0 2024-05-06T14:04:17.834 INFO:tasks.workunit.client.1.smithi174.stdout:4/754: truncate d1/d2e/f6a 715258 0 2024-05-06T14:04:17.834 INFO:tasks.workunit.client.1.smithi174.stdout:1/639: creat d11/d1f/d27/d2d/fe2 x:0 0 0 2024-05-06T14:04:17.834 INFO:tasks.workunit.client.1.smithi174.stdout:6/829: dwrite d0/d25/d35/f87 [2355200,32768] 0 2024-05-06T14:04:17.834 INFO:tasks.workunit.client.1.smithi174.stdout:6/830: creat d0/d25/d52/d2c/d105/f110 x:0 0 0 2024-05-06T14:04:17.834 INFO:tasks.workunit.client.1.smithi174.stdout:6/831: mknod d0/d25/d52/d3b/c111 0 2024-05-06T14:04:17.836 INFO:tasks.workunit.client.1.smithi174.stdout:4/755: dwrite d1/fd [790528,4096] 0 2024-05-06T14:04:17.836 INFO:tasks.workunit.client.1.smithi174.stdout:4/756: symlink d1/d9/d8d/l10b 0 2024-05-06T14:04:17.836 INFO:tasks.workunit.client.1.smithi174.stdout:1/640: creat d11/d1f/d27/d32/d84/d8c/d94/db0/fe3 x:0 0 0 2024-05-06T14:04:17.836 INFO:tasks.workunit.client.1.smithi174.stdout:1/641: chown d11/d57/d98 152343 1 2024-05-06T14:04:17.837 INFO:tasks.workunit.client.1.smithi174.stdout:1/642: rename d11/d41/dc9/d6c/fb8 to d11/d1f/d27/d32/d84/d8c/d94/db0/fe4 0 2024-05-06T14:04:17.837 INFO:tasks.workunit.client.1.smithi174.stdout:1/643: chown d11/d57/d98/daf 27922675 1 2024-05-06T14:04:17.837 INFO:tasks.workunit.client.1.smithi174.stdout:1/644: truncate d11/d57/fb4 1191170 0 2024-05-06T14:04:17.884 INFO:tasks.workunit.client.1.smithi174.stdout:4/757: fsync d1/d1f/d27/f7a 0 2024-05-06T14:04:17.884 INFO:tasks.workunit.client.1.smithi174.stdout:4/758: dread d1/d2e/f40 [126976,36864] 0 2024-05-06T14:04:17.884 INFO:tasks.workunit.client.1.smithi174.stdout:4/759: dread - d1/d1f/d27/d84/fd2 zero size 2024-05-06T14:04:17.884 INFO:tasks.workunit.client.1.smithi174.stdout:4/760: dread - d1/d1f/dd6/d6e/d50/d95/fee zero size 2024-05-06T14:04:17.885 INFO:tasks.workunit.client.1.smithi174.stdout:4/761: write d1/d48/d5a/d61/fa8 [608055,57323] 0 2024-05-06T14:04:17.888 INFO:tasks.workunit.client.1.smithi174.stdout:4/762: creat d1/d106/f10c x:0 0 0 2024-05-06T14:04:17.888 INFO:tasks.workunit.client.1.smithi174.stdout:6/832: dwrite d0/d25/d52/d2c/d105/da9/f109 [364544,61440] 0 2024-05-06T14:04:17.938 INFO:tasks.workunit.client.1.smithi174.stdout:6/833: fsync d0/d25/d52/d2c/d105/da9/db3/fc8 0 2024-05-06T14:04:17.957 INFO:tasks.workunit.client.1.smithi174.stdout:6/834: dread d0/d25/d52/d2c/f37 [1863680,65536] 0 2024-05-06T14:04:17.957 INFO:tasks.workunit.client.1.smithi174.stdout:6/835: creat d0/d25/d52/d2c/d5f/f112 x:0 0 0 2024-05-06T14:04:17.957 INFO:tasks.workunit.client.1.smithi174.stdout:6/836: truncate d0/d25/fdc 620433 0 2024-05-06T14:04:17.957 INFO:tasks.workunit.client.1.smithi174.stdout:6/837: link d0/d25/d52/d2c/d6f/la2 d0/df/d3c/l113 0 2024-05-06T14:04:17.957 INFO:tasks.workunit.client.1.smithi174.stdout:6/838: creat d0/d25/d35/de3/f114 x:0 0 0 2024-05-06T14:04:17.957 INFO:tasks.workunit.client.1.smithi174.stdout:6/839: write d0/d25/d52/d2c/fa8 [1808626,81495] 0 2024-05-06T14:04:17.957 INFO:tasks.workunit.client.1.smithi174.stdout:6/840: mknod d0/d25/d52/d2c/d6f/dc3/c115 0 2024-05-06T14:04:18.010 INFO:tasks.workunit.client.1.smithi174.stdout:4/763: fsync d1/d9/d15/d35/fa5 0 2024-05-06T14:04:18.010 INFO:tasks.workunit.client.1.smithi174.stdout:4/764: read d1/d9/d15/d74/fb7 [1617613,126352] 0 2024-05-06T14:04:18.010 INFO:tasks.workunit.client.1.smithi174.stdout:4/765: link d1/d9/d15/d98/f1c d1/d9/f10d 0 2024-05-06T14:04:18.010 INFO:tasks.workunit.client.1.smithi174.stdout:6/841: fsync d0/d25/f30 0 2024-05-06T14:04:18.011 INFO:tasks.workunit.client.1.smithi174.stdout:6/842: readlink d0/d25/d52/d2c/d5f/daa/ld5 0 2024-05-06T14:04:18.011 INFO:tasks.workunit.client.1.smithi174.stdout:6/843: mknod d0/d25/d35/de3/dfb/c116 0 2024-05-06T14:04:18.011 INFO:tasks.workunit.client.1.smithi174.stdout:6/844: dread - d0/d25/d52/d2c/d5f/f112 zero size 2024-05-06T14:04:18.011 INFO:tasks.workunit.client.1.smithi174.stdout:6/845: getdents d0/d25/d52/d2c/d5f 0 2024-05-06T14:04:18.011 INFO:tasks.workunit.client.1.smithi174.stdout:6/846: mkdir d0/d25/d52/d2c/d105/d117 0 2024-05-06T14:04:18.011 INFO:tasks.workunit.client.1.smithi174.stdout:6/847: truncate d0/d25/d35/fa4 1732327 0 2024-05-06T14:04:18.011 INFO:tasks.workunit.client.1.smithi174.stdout:6/848: chown d0/d25/d52/d2c/d105/d56/c8d 119244 1 2024-05-06T14:04:18.012 INFO:tasks.workunit.client.1.smithi174.stdout:6/849: mknod d0/d25/d52/da6/c118 0 2024-05-06T14:04:18.019 INFO:tasks.workunit.client.1.smithi174.stdout:6/850: dwrite d0/d93/fe2 [663552,118784] 0 2024-05-06T14:04:18.022 INFO:tasks.workunit.client.1.smithi174.stdout:4/766: dread d1/d9/fe [1695744,77824] 0 2024-05-06T14:04:18.022 INFO:tasks.workunit.client.1.smithi174.stdout:4/767: stat d1/d48/d5a 0 2024-05-06T14:04:18.022 INFO:tasks.workunit.client.1.smithi174.stdout:4/768: dread d1/d9/f22 [1564672,73728] 0 2024-05-06T14:04:18.023 INFO:tasks.workunit.client.1.smithi174.stdout:4/769: stat d1/d48/d5a/d61/d68/l6c 0 2024-05-06T14:04:18.023 INFO:tasks.workunit.client.1.smithi174.stdout:4/770: mkdir d1/d1f/dd6/d6e/d10e 0 2024-05-06T14:04:18.023 INFO:tasks.workunit.client.1.smithi174.stdout:4/771: creat d1/d9/d15/d41/f10f x:0 0 0 2024-05-06T14:04:18.023 INFO:tasks.workunit.client.1.smithi174.stdout:4/772: rename d1/d1f/ce3 to d1/c110 0 2024-05-06T14:04:18.023 INFO:tasks.workunit.client.1.smithi174.stdout:4/773: creat d1/f111 x:0 0 0 2024-05-06T14:04:18.023 INFO:tasks.workunit.client.1.smithi174.stdout:4/774: dread - d1/d1f/dd6/d6e/fb5 zero size 2024-05-06T14:04:18.023 INFO:tasks.workunit.client.1.smithi174.stdout:4/775: creat d1/d1f/d27/d2c/f112 x:0 0 0 2024-05-06T14:04:18.023 INFO:tasks.workunit.client.1.smithi174.stdout:4/776: readlink d1/d9/d8d/l10b 0 2024-05-06T14:04:18.024 INFO:tasks.workunit.client.1.smithi174.stdout:4/777: readlink d1/d1f/ld4 0 2024-05-06T14:04:18.024 INFO:tasks.workunit.client.1.smithi174.stdout:4/778: readlink d1/d2e/l4b 0 2024-05-06T14:04:18.024 INFO:tasks.workunit.client.1.smithi174.stdout:4/779: write d1/d1f/dd6/d6e/d50/f57 [1698837,75866] 0 2024-05-06T14:04:18.024 INFO:tasks.workunit.client.1.smithi174.stdout:4/780: write d1/f5 [207013,47332] 0 2024-05-06T14:04:18.024 INFO:tasks.workunit.client.1.smithi174.stdout:4/781: stat d1/d1f/dd6/d6e/fb5 0 2024-05-06T14:04:18.024 INFO:tasks.workunit.client.1.smithi174.stdout:4/782: dread d1/d9/d15/d92/fca [1253376,69632] 0 2024-05-06T14:04:18.024 INFO:tasks.workunit.client.1.smithi174.stdout:4/783: chown d1/d1f/d89/ld0 14448289 1 2024-05-06T14:04:18.029 INFO:tasks.workunit.client.1.smithi174.stdout:6/851: dwrite d0/df/f20 [2510848,110592] 0 2024-05-06T14:04:18.029 INFO:tasks.workunit.client.1.smithi174.stdout:6/852: getdents d0/d25/d52/d2c/d6f 0 2024-05-06T14:04:18.029 INFO:tasks.workunit.client.1.smithi174.stdout:6/853: write d0/d25/d52/dba/fd3 [775235,46441] 0 2024-05-06T14:04:18.029 INFO:tasks.workunit.client.1.smithi174.stdout:4/784: dwrite d1/d9/d15/f6d [1736704,32768] 0 2024-05-06T14:04:18.029 INFO:tasks.workunit.client.1.smithi174.stdout:4/785: truncate d1/d106/f10c 751554 0 2024-05-06T14:04:18.029 INFO:tasks.workunit.client.1.smithi174.stdout:4/786: dread d1/d1f/dd6/d6e/d50/f60 [2740224,81920] 0 2024-05-06T14:04:18.030 INFO:tasks.workunit.client.1.smithi174.stdout:9/634: sync 2024-05-06T14:04:18.030 INFO:tasks.workunit.client.1.smithi174.stdout:2/641: sync 2024-05-06T14:04:18.030 INFO:tasks.workunit.client.1.smithi174.stdout:8/800: sync 2024-05-06T14:04:18.030 INFO:tasks.workunit.client.1.smithi174.stdout:5/802: sync 2024-05-06T14:04:18.030 INFO:tasks.workunit.client.1.smithi174.stdout:7/551: sync 2024-05-06T14:04:18.030 INFO:tasks.workunit.client.1.smithi174.stdout:3/615: sync 2024-05-06T14:04:18.030 INFO:tasks.workunit.client.1.smithi174.stdout:8/801: link d4/de/d24/d5e/d85/lc2 d4/d15/d64/dfd/l10a 0 2024-05-06T14:04:18.030 INFO:tasks.workunit.client.1.smithi174.stdout:2/642: mknod d0/d24/d84/cc8 0 2024-05-06T14:04:18.031 INFO:tasks.workunit.client.1.smithi174.stdout:5/803: dread d1/d6/df/f30 [344064,73728] 0 2024-05-06T14:04:18.031 INFO:tasks.workunit.client.1.smithi174.stdout:7/552: symlink d0/d3a/lbe 0 2024-05-06T14:04:18.031 INFO:tasks.workunit.client.1.smithi174.stdout:5/804: rename d1/d6/df/d35/d81/d60/d82/fd6 to d1/d6/f10b 0 2024-05-06T14:04:18.031 INFO:tasks.workunit.client.1.smithi174.stdout:5/805: read - d1/d6/d7/d8e/f103 zero size 2024-05-06T14:04:18.031 INFO:tasks.workunit.client.1.smithi174.stdout:7/553: creat d0/d1d/da4/d61/d19/d24/d47/d64/fbf x:0 0 0 2024-05-06T14:04:18.031 INFO:tasks.workunit.client.1.smithi174.stdout:5/806: dread d1/d6/df/d35/d81/d60/db0/de/f26 [741376,114688] 0 2024-05-06T14:04:18.031 INFO:tasks.workunit.client.1.smithi174.stdout:5/807: rename d1/l50 to d1/d6/d7/da1/d9a/da5/l10c 0 2024-05-06T14:04:18.031 INFO:tasks.workunit.client.1.smithi174.stdout:7/554: mkdir d0/d1d/da4/d61/d19/d39/dc0 0 2024-05-06T14:04:18.031 INFO:tasks.workunit.client.1.smithi174.stdout:5/808: dread d1/d6/df/d35/d81/d60/db0/f3c [688128,94208] 0 2024-05-06T14:04:18.032 INFO:tasks.workunit.client.1.smithi174.stdout:7/555: creat d0/d1d/da4/d61/d19/d24/d6f/fc1 x:0 0 0 2024-05-06T14:04:18.032 INFO:tasks.workunit.client.1.smithi174.stdout:7/556: creat d0/d1d/da4/d61/d19/d39/fc2 x:0 0 0 2024-05-06T14:04:18.032 INFO:tasks.workunit.client.1.smithi174.stdout:5/809: write d1/d6/d7/d36/f2c [1976323,49942] 0 2024-05-06T14:04:18.032 INFO:tasks.workunit.client.1.smithi174.stdout:7/557: rename d0/d1d/da4/d61/d19/d24/d14/d52/f20 to d0/d1d/da4/fc3 0 2024-05-06T14:04:18.032 INFO:tasks.workunit.client.1.smithi174.stdout:5/810: dread d1/d6/d7/d8e/f101 [233472,122880] 0 2024-05-06T14:04:18.032 INFO:tasks.workunit.client.1.smithi174.stdout:5/811: creat d1/d6/df/d35/d81/f10d x:0 0 0 2024-05-06T14:04:18.032 INFO:tasks.workunit.client.1.smithi174.stdout:7/558: creat d0/d3a/fc4 x:0 0 0 2024-05-06T14:04:18.032 INFO:tasks.workunit.client.1.smithi174.stdout:5/812: truncate d1/d6/d7/d36/f7f 696592 0 2024-05-06T14:04:18.032 INFO:tasks.workunit.client.1.smithi174.stdout:5/813: creat d1/d6/df/d35/d81/d60/db0/d41/f10e x:0 0 0 2024-05-06T14:04:18.033 INFO:tasks.workunit.client.1.smithi174.stdout:5/814: write d1/d6/d7/d36/d53/fd5 [343838,114543] 0 2024-05-06T14:04:18.033 INFO:tasks.workunit.client.1.smithi174.stdout:5/815: rmdir d1/d6/d7/d36/d53/d59/df7 0 2024-05-06T14:04:18.033 INFO:tasks.workunit.client.1.smithi174.stdout:5/816: link d1/d6/df/d35/d81/daf/feb d1/d6/df/d35/d81/f10f 0 2024-05-06T14:04:18.033 INFO:tasks.workunit.client.1.smithi174.stdout:5/817: dread d1/d6/df/d35/d81/f4b [139264,8192] 0 2024-05-06T14:04:18.033 INFO:tasks.workunit.client.1.smithi174.stdout:5/818: creat d1/d6/df/d35/d81/d60/db0/de/f110 x:0 0 0 2024-05-06T14:04:18.033 INFO:tasks.workunit.client.1.smithi174.stdout:5/819: write d1/d6/d7/d36/d53/ffb [112344,130511] 0 2024-05-06T14:04:18.033 INFO:tasks.workunit.client.1.smithi174.stdout:5/820: truncate d1/d6/d7/f44 1736975 0 2024-05-06T14:04:18.033 INFO:tasks.workunit.client.1.smithi174.stdout:5/821: stat d1/d6/df/d35/d8b/d9f/df8 0 2024-05-06T14:04:18.034 INFO:tasks.workunit.client.1.smithi174.stdout:5/822: chown d1/d6/d7/l78 33313702 1 2024-05-06T14:04:18.034 INFO:tasks.workunit.client.1.smithi174.stdout:5/823: dread - d1/d6/df/f67 zero size 2024-05-06T14:04:18.034 INFO:tasks.workunit.client.1.smithi174.stdout:5/824: creat d1/d6/d7/d3e/f111 x:0 0 0 2024-05-06T14:04:18.034 INFO:tasks.workunit.client.1.smithi174.stdout:5/825: link d1/d6/d7/c46 d1/d6/d7/d8e/c112 0 2024-05-06T14:04:18.034 INFO:tasks.workunit.client.1.smithi174.stdout:5/826: creat d1/d6/d7/da1/f113 x:0 0 0 2024-05-06T14:04:18.034 INFO:tasks.workunit.client.1.smithi174.stdout:5/827: write d1/d6/df/d35/d8b/d9f/fa9 [1691084,113798] 0 2024-05-06T14:04:18.034 INFO:tasks.workunit.client.1.smithi174.stdout:5/828: chown d1/d6/df/d35/d81/f1b 45 1 2024-05-06T14:04:18.034 INFO:tasks.workunit.client.1.smithi174.stdout:5/829: mknod d1/d6/d7/da1/dd8/de7/c114 0 2024-05-06T14:04:18.134 INFO:tasks.workunit.client.1.smithi174.stdout:7/559: dwrite d0/d1d/da4/d61/d19/d39/f78 [1830912,94208] 0 2024-05-06T14:04:18.134 INFO:tasks.workunit.client.1.smithi174.stdout:3/616: dwrite df/f44 [1036288,49152] 0 2024-05-06T14:04:18.134 INFO:tasks.workunit.client.1.smithi174.stdout:3/617: write df/d2d/d4d/f68 [161481,43218] 0 2024-05-06T14:04:18.134 INFO:tasks.workunit.client.1.smithi174.stdout:3/618: chown df/d2d/d4e/d81 55957 1 2024-05-06T14:04:18.134 INFO:tasks.workunit.client.1.smithi174.stdout:3/619: readlink l3 0 2024-05-06T14:04:18.134 INFO:tasks.workunit.client.1.smithi174.stdout:3/620: write df/d2d/f6c [495662,111924] 0 2024-05-06T14:04:18.135 INFO:tasks.workunit.client.1.smithi174.stdout:8/802: dwrite d4/de/d23/d3c/fbb [1196032,81920] 0 2024-05-06T14:04:18.135 INFO:tasks.workunit.client.1.smithi174.stdout:3/621: creat df/d2d/d87/fc4 x:0 0 0 2024-05-06T14:04:18.135 INFO:tasks.workunit.client.1.smithi174.stdout:8/803: symlink d4/d15/d66/l10b 0 2024-05-06T14:04:18.135 INFO:tasks.workunit.client.1.smithi174.stdout:3/622: rename df/d2d/l50 to df/d2d/d4e/db6/db9/lc5 0 2024-05-06T14:04:18.135 INFO:tasks.workunit.client.1.smithi174.stdout:3/623: dread df/d10/d1b/d7e/d5a/f73 [262144,73728] 0 2024-05-06T14:04:18.135 INFO:tasks.workunit.client.1.smithi174.stdout:3/624: mknod df/d2d/d4e/cc6 0 2024-05-06T14:04:18.135 INFO:tasks.workunit.client.1.smithi174.stdout:8/804: write d4/d15/d20/f5f [24607,107205] 0 2024-05-06T14:04:18.177 INFO:tasks.workunit.client.1.smithi174.stdout:4/787: fsync d1/d48/d5a/d5f/ffb 0 2024-05-06T14:04:18.177 INFO:tasks.workunit.client.1.smithi174.stdout:2/643: fsync d0/da/d3f/d67/f80 0 2024-05-06T14:04:18.177 INFO:tasks.workunit.client.1.smithi174.stdout:5/830: fdatasync d1/d6/d7/d36/d53/d59/d61/f7e 0 2024-05-06T14:04:18.177 INFO:tasks.workunit.client.1.smithi174.stdout:4/788: rmdir d1/d9/d15/d74/d86/dc2 39 2024-05-06T14:04:18.177 INFO:tasks.workunit.client.1.smithi174.stdout:2/644: read - d0/d24/fb5 zero size 2024-05-06T14:04:18.178 INFO:tasks.workunit.client.1.smithi174.stdout:4/789: creat d1/d1f/dd6/d6e/d50/f113 x:0 0 0 2024-05-06T14:04:18.178 INFO:tasks.workunit.client.1.smithi174.stdout:5/831: symlink d1/d6/df/d35/d81/d8d/l115 0 2024-05-06T14:04:18.178 INFO:tasks.workunit.client.1.smithi174.stdout:5/832: dread - d1/d6/d7/da1/f88 zero size 2024-05-06T14:04:18.178 INFO:tasks.workunit.client.1.smithi174.stdout:4/790: creat d1/d9/d15/d35/dd9/d6b/ddf/f114 x:0 0 0 2024-05-06T14:04:18.178 INFO:tasks.workunit.client.1.smithi174.stdout:8/805: fsync d4/d15/d20/d3e/d79/dcc/fed 0 2024-05-06T14:04:18.178 INFO:tasks.workunit.client.1.smithi174.stdout:8/806: chown d4/de/d23/d3c/db2/da6 5683392 1 2024-05-06T14:04:18.178 INFO:tasks.workunit.client.1.smithi174.stdout:5/833: mkdir d1/d6/df/de2/d116 0 2024-05-06T14:04:18.178 INFO:tasks.workunit.client.1.smithi174.stdout:8/807: dread - d4/de/d23/d41/d56/de6/ff8 zero size 2024-05-06T14:04:18.179 INFO:tasks.workunit.client.1.smithi174.stdout:2/645: write d0/d1/d2/d4/d6/f7a [1715837,128795] 0 2024-05-06T14:04:18.179 INFO:tasks.workunit.client.1.smithi174.stdout:2/646: chown d0/da/d3f/d67/f80 15 1 2024-05-06T14:04:18.185 INFO:tasks.workunit.client.1.smithi174.stdout:7/560: dwrite d0/f6 [1683456,106496] 0 2024-05-06T14:04:18.185 INFO:tasks.workunit.client.1.smithi174.stdout:4/791: rename d1/d1f/d27/d2c/fc6 to d1/d1f/dd6/d6e/d50/d95/f115 0 2024-05-06T14:04:18.186 INFO:tasks.workunit.client.1.smithi174.stdout:2/647: symlink d0/d1/d2/d4/d6/lc9 0 2024-05-06T14:04:18.186 INFO:tasks.workunit.client.1.smithi174.stdout:8/808: creat d4/f10c x:0 0 0 2024-05-06T14:04:18.186 INFO:tasks.workunit.client.1.smithi174.stdout:5/834: rename d1/d6/df/d35/d81/d60/d82/cb6 to d1/d6/d7/d36/d53/d59/d61/d69/dd4/c117 0 2024-05-06T14:04:18.186 INFO:tasks.workunit.client.1.smithi174.stdout:7/561: dread d0/d3a/fb2 [2244608,4096] 0 2024-05-06T14:04:18.186 INFO:tasks.workunit.client.1.smithi174.stdout:7/562: chown d0/d1d/da4/d61/lac 1216054 1 2024-05-06T14:04:18.186 INFO:tasks.workunit.client.1.smithi174.stdout:5/835: creat d1/d6/d7/d36/d53/d59/d61/d69/f118 x:0 0 0 2024-05-06T14:04:18.186 INFO:tasks.workunit.client.1.smithi174.stdout:4/792: write d1/d1f/d27/d2c/d45/df8/fe7 [447788,36660] 0 2024-05-06T14:04:18.187 INFO:tasks.workunit.client.1.smithi174.stdout:7/563: mknod d0/d1d/da4/d61/d19/d24/d47/d70/cc5 0 2024-05-06T14:04:18.187 INFO:tasks.workunit.client.1.smithi174.stdout:4/793: mknod d1/d9/d15/d35/dd9/c116 0 2024-05-06T14:04:18.187 INFO:tasks.workunit.client.1.smithi174.stdout:5/836: write d1/d6/d7/d36/d53/d59/d61/d69/f91 [804656,44894] 0 2024-05-06T14:04:18.187 INFO:tasks.workunit.client.1.smithi174.stdout:4/794: dread d1/d2e/f6a [335872,24576] 0 2024-05-06T14:04:18.189 INFO:tasks.workunit.client.1.smithi174.stdout:5/837: chown d1/d6/df/d35/d81/d60/db0/f25 230704974 1 2024-05-06T14:04:18.189 INFO:tasks.workunit.client.1.smithi174.stdout:5/838: link d1/d6/d7/d36/fc8 d1/d6/d7/f119 0 2024-05-06T14:04:18.189 INFO:tasks.workunit.client.1.smithi174.stdout:4/795: mkdir d1/d1f/d117 0 2024-05-06T14:04:18.190 INFO:tasks.workunit.client.1.smithi174.stdout:5/839: mkdir d1/d6/df/d35/d81/d60/db0/de/d11a 0 2024-05-06T14:04:18.190 INFO:tasks.workunit.client.1.smithi174.stdout:5/840: rename d1/d6/d7/d36/d53/d59/d61/d69/dc3/dd1 to d1/d6/d7/d11b 0 2024-05-06T14:04:18.190 INFO:tasks.workunit.client.1.smithi174.stdout:4/796: symlink d1/d1f/d27/d2c/d45/l118 0 2024-05-06T14:04:18.190 INFO:tasks.workunit.client.1.smithi174.stdout:7/564: write d0/d1d/da4/d61/fb [2130652,125932] 0 2024-05-06T14:04:18.190 INFO:tasks.workunit.client.1.smithi174.stdout:4/797: rename d1/d1f/cea to d1/d48/d5a/d61/d68/c119 0 2024-05-06T14:04:18.190 INFO:tasks.workunit.client.1.smithi174.stdout:7/565: mkdir d0/d1d/da4/d61/d19/d24/d47/dc6 0 2024-05-06T14:04:18.191 INFO:tasks.workunit.client.1.smithi174.stdout:7/566: chown d0/d1d/da4/d61 16753678 1 2024-05-06T14:04:18.191 INFO:tasks.workunit.client.1.smithi174.stdout:4/798: symlink d1/d9/d15/d92/l11a 0 2024-05-06T14:04:18.191 INFO:tasks.workunit.client.1.smithi174.stdout:7/567: dread - d0/d3a/fc4 zero size 2024-05-06T14:04:18.191 INFO:tasks.workunit.client.1.smithi174.stdout:7/568: readlink d0/d1d/da4/d61/d19/d24/d14/l1f 0 2024-05-06T14:04:18.191 INFO:tasks.workunit.client.1.smithi174.stdout:4/799: dread d1/f31 [204800,98304] 0 2024-05-06T14:04:18.191 INFO:tasks.workunit.client.1.smithi174.stdout:7/569: mknod d0/d1d/da4/d61/d19/d39/d90/cc7 0 2024-05-06T14:04:18.191 INFO:tasks.workunit.client.1.smithi174.stdout:7/570: truncate d0/d1d/da4/d61/d19/f1c 360652 0 2024-05-06T14:04:18.191 INFO:tasks.workunit.client.1.smithi174.stdout:0/664: sync 2024-05-06T14:04:18.192 INFO:tasks.workunit.client.1.smithi174.stdout:1/645: sync 2024-05-06T14:04:18.192 INFO:tasks.workunit.client.1.smithi174.stdout:1/646: rename d11/d1f/d27/d2d/d9c/fc8 to d11/d1f/d27/d32/d84/fe5 0 2024-05-06T14:04:18.192 INFO:tasks.workunit.client.1.smithi174.stdout:0/665: symlink d0/d4/d8/d25/d5c/d44/dd7/lda 0 2024-05-06T14:04:18.192 INFO:tasks.workunit.client.1.smithi174.stdout:0/666: mkdir d0/d4/d8/d25/d5c/ddb 0 2024-05-06T14:04:18.192 INFO:tasks.workunit.client.1.smithi174.stdout:1/647: write d11/d41/f5c [560485,58483] 0 2024-05-06T14:04:18.192 INFO:tasks.workunit.client.1.smithi174.stdout:0/667: dread d0/d4/d8/d25/f6f [1847296,73728] 0 2024-05-06T14:04:18.192 INFO:tasks.workunit.client.1.smithi174.stdout:1/648: creat d11/d1f/d27/d32/d84/ddc/fe6 x:0 0 0 2024-05-06T14:04:18.192 INFO:tasks.workunit.client.1.smithi174.stdout:0/668: read d0/d1a/d17/d2e/f5f [93619,32055] 0 2024-05-06T14:04:18.193 INFO:tasks.workunit.client.1.smithi174.stdout:0/669: dread d0/d4/d8/d25/d5c/d44/dd5/f43 [925696,4096] 0 2024-05-06T14:04:18.290 INFO:tasks.workunit.client.1.smithi174.stdout:8/809: fsync d4/de/d23/d41/d56/de6/ff8 0 2024-05-06T14:04:18.291 INFO:tasks.workunit.client.1.smithi174.stdout:8/810: mknod d4/d15/d20/d3e/d79/d94/c10d 0 2024-05-06T14:04:18.291 INFO:tasks.workunit.client.1.smithi174.stdout:0/670: fsync d0/d1a/f1b 0 2024-05-06T14:04:18.292 INFO:tasks.workunit.client.1.smithi174.stdout:4/800: dwrite d1/d1f/d27/d2c/f112 [376832,4096] 0 2024-05-06T14:04:18.293 INFO:tasks.workunit.client.1.smithi174.stdout:4/801: mknod d1/d1f/d27/d2c/d45/dfc/c11b 0 2024-05-06T14:04:18.293 INFO:tasks.workunit.client.1.smithi174.stdout:8/811: dwrite d4/de/f17 [49152,73728] 0 2024-05-06T14:04:18.360 INFO:tasks.workunit.client.1.smithi174.stdout:4/802: dwrite d1/d1f/dd6/d6e/d50/f113 [831488,69632] 0 2024-05-06T14:04:18.361 INFO:tasks.workunit.client.1.smithi174.stdout:4/803: creat d1/d48/d5a/d61/d68/dec/f11c x:0 0 0 2024-05-06T14:04:18.361 INFO:tasks.workunit.client.1.smithi174.stdout:4/804: symlink d1/d9/d15/l11d 0 2024-05-06T14:04:18.362 INFO:tasks.workunit.client.1.smithi174.stdout:8/812: write d4/d53/f69 [478106,56119] 0 2024-05-06T14:04:18.362 INFO:tasks.workunit.client.1.smithi174.stdout:8/813: read d4/d15/fd2 [748442,114774] 0 2024-05-06T14:04:18.362 INFO:tasks.workunit.client.1.smithi174.stdout:8/814: stat d4/de/d23/d3c/db2/da6/dad/de9/fea 0 2024-05-06T14:04:18.363 INFO:tasks.workunit.client.1.smithi174.stdout:8/815: dread d4/d15/d20/f44 [729088,36864] 0 2024-05-06T14:04:18.371 INFO:tasks.workunit.client.1.smithi174.stdout:4/805: dread d1/d1f/f54 [106496,122880] 0 2024-05-06T14:04:18.371 INFO:tasks.workunit.client.1.smithi174.stdout:4/806: creat d1/d1f/d27/d2c/d45/dc3/f11e x:0 0 0 2024-05-06T14:04:18.371 INFO:tasks.workunit.client.1.smithi174.stdout:4/807: rename d1/d9/d15/l44 to d1/d2e/l11f 0 2024-05-06T14:04:18.428 INFO:tasks.workunit.client.1.smithi174.stdout:9/635: sync 2024-05-06T14:04:18.428 INFO:tasks.workunit.client.1.smithi174.stdout:6/854: sync 2024-05-06T14:04:18.429 INFO:tasks.workunit.client.1.smithi174.stdout:6/855: write d0/d25/d52/d2c/d6f/f99 [1971511,5541] 0 2024-05-06T14:04:18.429 INFO:tasks.workunit.client.1.smithi174.stdout:4/808: dwrite d1/d1f/d27/d2c/f112 [1134592,110592] 0 2024-05-06T14:04:18.429 INFO:tasks.workunit.client.1.smithi174.stdout:4/809: creat d1/d2e/f120 x:0 0 0 2024-05-06T14:04:18.429 INFO:tasks.workunit.client.1.smithi174.stdout:6/856: write d0/f26 [810937,25464] 0 2024-05-06T14:04:18.429 INFO:tasks.workunit.client.1.smithi174.stdout:4/810: dread - d1/d9/d15/d41/f10f zero size 2024-05-06T14:04:18.429 INFO:tasks.workunit.client.1.smithi174.stdout:4/811: dread - d1/d9/d15/d35/dd9/d6b/ddf/f114 zero size 2024-05-06T14:04:18.429 INFO:tasks.workunit.client.1.smithi174.stdout:6/857: link d0/d25/d52/d4c/l64 d0/l119 0 2024-05-06T14:04:18.430 INFO:tasks.workunit.client.1.smithi174.stdout:6/858: rename d0/d25/c58 to d0/d25/d52/d2c/d105/d56/c11a 0 2024-05-06T14:04:18.430 INFO:tasks.workunit.client.1.smithi174.stdout:4/812: mkdir d1/d1f/d27/d2c/d45/df8/dfe/d121 0 2024-05-06T14:04:18.430 INFO:tasks.workunit.client.1.smithi174.stdout:4/813: stat d1/d9/d15/d41/cd3 0 2024-05-06T14:04:18.430 INFO:tasks.workunit.client.1.smithi174.stdout:4/814: dread d1/d2e/f33 [192512,65536] 0 2024-05-06T14:04:18.430 INFO:tasks.workunit.client.1.smithi174.stdout:4/815: rmdir d1/d1f/d27/d2c/d45 39 2024-05-06T14:04:18.430 INFO:tasks.workunit.client.1.smithi174.stdout:4/816: readlink d1/d48/d5a/d61/d68/l7e 0 2024-05-06T14:04:18.430 INFO:tasks.workunit.client.1.smithi174.stdout:4/817: dread d1/d48/d5a/d5f/f8a [667648,49152] 0 2024-05-06T14:04:18.431 INFO:tasks.workunit.client.1.smithi174.stdout:6/859: write d0/d25/d52/dba/ff7 [614708,82849] 0 2024-05-06T14:04:18.431 INFO:tasks.workunit.client.1.smithi174.stdout:4/818: read d1/d106/f10c [296816,58789] 0 2024-05-06T14:04:18.431 INFO:tasks.workunit.client.1.smithi174.stdout:6/860: mkdir d0/d25/d52/d80/d10f/d11b 0 2024-05-06T14:04:18.431 INFO:tasks.workunit.client.1.smithi174.stdout:6/861: mkdir d0/d25/d52/d2c/d105/da9/d11c 0 2024-05-06T14:04:18.464 INFO:tasks.workunit.client.1.smithi174.stdout:6/862: dwrite d0/d25/d52/d2c/d105/da9/db3/f104 [1658880,69632] 0 2024-05-06T14:04:18.464 INFO:tasks.workunit.client.1.smithi174.stdout:4/819: dwrite d1/d48/d5a/d5f/ffb [802816,126976] 0 2024-05-06T14:04:18.465 INFO:tasks.workunit.client.1.smithi174.stdout:6/863: creat d0/d25/d52/d2c/d6f/dfa/f11d x:0 0 0 2024-05-06T14:04:18.465 INFO:tasks.workunit.client.1.smithi174.stdout:6/864: symlink d0/d25/d52/dba/d10d/l11e 0 2024-05-06T14:04:18.467 INFO:tasks.workunit.client.1.smithi174.stdout:6/865: dwrite d0/d25/d52/d2c/d5f/ff8 [794624,73728] 0 2024-05-06T14:04:18.467 INFO:tasks.workunit.client.1.smithi174.stdout:6/866: mknod d0/d25/d52/d2c/d105/dcf/c11f 0 2024-05-06T14:04:18.467 INFO:tasks.workunit.client.1.smithi174.stdout:4/820: dwrite d1/d1f/d27/d2c/d45/fe0 [696320,81920] 0 2024-05-06T14:04:18.467 INFO:tasks.workunit.client.1.smithi174.stdout:4/821: dread d1/d1f/d27/d2c/f112 [12288,73728] 0 2024-05-06T14:04:18.468 INFO:tasks.workunit.client.1.smithi174.stdout:4/822: stat d1/d9/d8d/l10b 0 2024-05-06T14:04:18.577 INFO:tasks.workunit.client.1.smithi174.stdout:6/867: dwrite d0/d25/d52/ffc [970752,16384] 0 2024-05-06T14:04:18.577 INFO:tasks.workunit.client.1.smithi174.stdout:6/868: write d0/d25/d52/d2c/d5f/fd4 [249411,17102] 0 2024-05-06T14:04:18.577 INFO:tasks.workunit.client.1.smithi174.stdout:6/869: truncate d0/f7c 201517 0 2024-05-06T14:04:18.577 INFO:tasks.workunit.client.1.smithi174.stdout:6/870: creat d0/d25/d52/d2c/f120 x:0 0 0 2024-05-06T14:04:18.578 INFO:tasks.workunit.client.1.smithi174.stdout:6/871: mkdir d0/d25/d52/d2c/d105/d121 0 2024-05-06T14:04:18.578 INFO:tasks.workunit.client.1.smithi174.stdout:6/872: mkdir d0/d25/d35/d122 0 2024-05-06T14:04:18.579 INFO:tasks.workunit.client.1.smithi174.stdout:6/873: mkdir d0/d25/d35/de3/d123 0 2024-05-06T14:04:18.580 INFO:tasks.workunit.client.1.smithi174.stdout:6/874: dread d0/d25/d52/d2c/d6f/f99 [397312,94208] 0 2024-05-06T14:04:18.580 INFO:tasks.workunit.client.1.smithi174.stdout:6/875: mkdir d0/d25/d52/d2c/d105/dcf/d124 0 2024-05-06T14:04:18.580 INFO:tasks.workunit.client.1.smithi174.stdout:6/876: write d0/d25/d52/d2c/d5f/daa/fac [19125,55365] 0 2024-05-06T14:04:18.580 INFO:tasks.workunit.client.1.smithi174.stdout:6/877: stat d0/d25/d52/l4a 0 2024-05-06T14:04:18.580 INFO:tasks.workunit.client.1.smithi174.stdout:6/878: read - d0/d93/f10b zero size 2024-05-06T14:04:18.589 INFO:tasks.workunit.client.1.smithi174.stdout:4/823: read d1/d9/d15/d98/f51 [553960,67837] 0 2024-05-06T14:04:18.627 INFO:tasks.workunit.client.1.smithi174.stdout:4/824: fdatasync d1/d1f/d27/d2c/d45/df8/fe7 0 2024-05-06T14:04:18.630 INFO:tasks.workunit.client.1.smithi174.stdout:6/879: dwrite d0/d25/f51 [1646592,53248] 0 2024-05-06T14:04:18.630 INFO:tasks.workunit.client.1.smithi174.stdout:6/880: mknod d0/d25/d52/d80/d10f/d11b/c125 0 2024-05-06T14:04:18.632 INFO:tasks.workunit.client.1.smithi174.stdout:4/825: read d1/d1f/d27/d2c/f112 [1232070,29559] 0 2024-05-06T14:04:18.632 INFO:tasks.workunit.client.1.smithi174.stdout:4/826: mkdir d1/d1f/d27/d84/d122 0 2024-05-06T14:04:18.633 INFO:tasks.workunit.client.1.smithi174.stdout:4/827: dwrite d1/f31 [249856,106496] 0 2024-05-06T14:04:18.634 INFO:tasks.workunit.client.1.smithi174.stdout:4/828: rmdir d1/d48/d7f 0 2024-05-06T14:04:18.706 INFO:tasks.workunit.client.1.smithi174.stdout:4/829: creat d1/d48/d5a/d61/d68/dec/f123 x:0 0 0 2024-05-06T14:04:18.707 INFO:tasks.workunit.client.1.smithi174.stdout:4/830: creat d1/d1f/dd6/d6e/d50/f124 x:0 0 0 2024-05-06T14:04:18.707 INFO:tasks.workunit.client.1.smithi174.stdout:4/831: mknod d1/d1f/dd6/c125 0 2024-05-06T14:04:18.707 INFO:tasks.workunit.client.1.smithi174.stdout:4/832: symlink d1/d48/d5a/d61/l126 0 2024-05-06T14:04:18.707 INFO:tasks.workunit.client.1.smithi174.stdout:2/648: sync 2024-05-06T14:04:18.707 INFO:tasks.workunit.client.1.smithi174.stdout:4/833: chown d1/d9/d15/f4e 69 1 2024-05-06T14:04:18.707 INFO:tasks.workunit.client.1.smithi174.stdout:1/649: sync 2024-05-06T14:04:18.707 INFO:tasks.workunit.client.1.smithi174.stdout:0/671: sync 2024-05-06T14:04:18.707 INFO:tasks.workunit.client.1.smithi174.stdout:7/571: sync 2024-05-06T14:04:18.708 INFO:tasks.workunit.client.1.smithi174.stdout:3/625: sync 2024-05-06T14:04:18.708 INFO:tasks.workunit.client.1.smithi174.stdout:2/649: truncate d0/d1/d2/f54 2062318 0 2024-05-06T14:04:18.708 INFO:tasks.workunit.client.1.smithi174.stdout:1/650: rmdir d11/d57/d98/daf/d9b 39 2024-05-06T14:04:18.708 INFO:tasks.workunit.client.1.smithi174.stdout:4/834: rename d1/d9/d15/f47 to d1/d1f/d27/d2c/d45/f127 0 2024-05-06T14:04:18.708 INFO:tasks.workunit.client.1.smithi174.stdout:1/651: read - d11/d57/f9e zero size 2024-05-06T14:04:18.708 INFO:tasks.workunit.client.1.smithi174.stdout:5/841: sync 2024-05-06T14:04:18.708 INFO:tasks.workunit.client.1.smithi174.stdout:1/652: rmdir d11/d1f/d27/d2d 39 2024-05-06T14:04:18.708 INFO:tasks.workunit.client.1.smithi174.stdout:7/572: read d0/d1d/da4/d61/d19/f32 [196108,25486] 0 2024-05-06T14:04:18.709 INFO:tasks.workunit.client.1.smithi174.stdout:0/672: symlink d0/d4/d8/dce/ldc 0 2024-05-06T14:04:18.709 INFO:tasks.workunit.client.1.smithi174.stdout:1/653: rename d11/d41/dc9/lb1 to d11/d57/d98/daf/db2/le7 0 2024-05-06T14:04:18.709 INFO:tasks.workunit.client.1.smithi174.stdout:7/573: mkdir d0/d1d/da4/d61/d28/db1/dc8 0 2024-05-06T14:04:18.709 INFO:tasks.workunit.client.1.smithi174.stdout:3/626: write df/f44 [1024136,108051] 0 2024-05-06T14:04:18.709 INFO:tasks.workunit.client.1.smithi174.stdout:3/627: mknod df/d10/d1b/cc7 0 2024-05-06T14:04:18.709 INFO:tasks.workunit.client.1.smithi174.stdout:3/628: getdents df/d2d/d5b 0 2024-05-06T14:04:18.724 INFO:tasks.workunit.client.1.smithi174.stdout:1/654: fdatasync d11/d1f/d27/d32/d84/d8c/fa4 0 2024-05-06T14:04:18.725 INFO:tasks.workunit.client.1.smithi174.stdout:7/574: fdatasync d0/d1d/da4/d61/fb9 0 2024-05-06T14:04:18.725 INFO:tasks.workunit.client.1.smithi174.stdout:7/575: rmdir d0/d1d/da4/d61/d28/d59 39 2024-05-06T14:04:18.725 INFO:tasks.workunit.client.1.smithi174.stdout:7/576: chown d0/d1d/da4/d61/d28/db1/cb3 352359173 1 2024-05-06T14:04:18.725 INFO:tasks.workunit.client.1.smithi174.stdout:6/881: fsync d0/d25/d52/d2c/d6f/dfa/f11d 0 2024-05-06T14:04:18.735 INFO:tasks.workunit.client.1.smithi174.stdout:4/835: dwrite d1/d1f/dd6/d6e/d50/f5c [1183744,69632] 0 2024-05-06T14:04:18.736 INFO:tasks.workunit.client.1.smithi174.stdout:5/842: dwrite d1/d6/d7/da1/f88 [991232,81920] 0 2024-05-06T14:04:18.736 INFO:tasks.workunit.client.1.smithi174.stdout:3/629: dwrite df/d10/d1b/f65 [512000,12288] 0 2024-05-06T14:04:18.736 INFO:tasks.workunit.client.1.smithi174.stdout:0/673: dwrite d0/d1a/d17/fe [2703360,81920] 0 2024-05-06T14:04:18.736 INFO:tasks.workunit.client.1.smithi174.stdout:1/655: rmdir d11/d1f/d27/d32/d92/dc0 0 2024-05-06T14:04:18.736 INFO:tasks.workunit.client.1.smithi174.stdout:0/674: chown d0/d4/d8/d25/d5c/f87 28470542 1 2024-05-06T14:04:18.736 INFO:tasks.workunit.client.1.smithi174.stdout:1/656: link l2 d11/d57/d98/le8 0 2024-05-06T14:04:18.736 INFO:tasks.workunit.client.1.smithi174.stdout:3/630: symlink df/d10/da2/lc8 0 2024-05-06T14:04:18.736 INFO:tasks.workunit.client.1.smithi174.stdout:3/631: rename df/d10/d1b/l40 to df/d10/da2/lc9 0 2024-05-06T14:04:18.737 INFO:tasks.workunit.client.1.smithi174.stdout:1/657: write d11/d1f/d27/f5d [25079,40366] 0 2024-05-06T14:04:18.737 INFO:tasks.workunit.client.1.smithi174.stdout:3/632: chown df/c45 33885 1 2024-05-06T14:04:18.737 INFO:tasks.workunit.client.1.smithi174.stdout:4/836: write d1/d9/d15/f21 [751996,59141] 0 2024-05-06T14:04:18.737 INFO:tasks.workunit.client.1.smithi174.stdout:4/837: creat d1/d1f/dd6/d6e/f128 x:0 0 0 2024-05-06T14:04:18.737 INFO:tasks.workunit.client.1.smithi174.stdout:4/838: stat d1/d9 0 2024-05-06T14:04:18.737 INFO:tasks.workunit.client.1.smithi174.stdout:4/839: chown d1/d48/d5a 48 1 2024-05-06T14:04:18.737 INFO:tasks.workunit.client.1.smithi174.stdout:4/840: rename d1/d48/d5a/d5f/ccc to d1/d9/d15/d74/d86/d8f/c129 0 2024-05-06T14:04:18.737 INFO:tasks.workunit.client.1.smithi174.stdout:3/633: write df/d10/f3f [1107876,121948] 0 2024-05-06T14:04:18.738 INFO:tasks.workunit.client.1.smithi174.stdout:4/841: creat d1/f12a x:0 0 0 2024-05-06T14:04:18.738 INFO:tasks.workunit.client.1.smithi174.stdout:3/634: dread df/d10/d1b/f76 [950272,4096] 0 2024-05-06T14:04:18.738 INFO:tasks.workunit.client.1.smithi174.stdout:4/842: rename d1/d1f/dd6/d6e/la2 to d1/d1f/d27/d2c/d45/dc3/l12b 0 2024-05-06T14:04:18.738 INFO:tasks.workunit.client.1.smithi174.stdout:3/635: creat df/d2d/d4e/db6/db9/fca x:0 0 0 2024-05-06T14:04:18.738 INFO:tasks.workunit.client.1.smithi174.stdout:3/636: chown df/d10/d1b/d7e/l70 19126624 1 2024-05-06T14:04:18.738 INFO:tasks.workunit.client.1.smithi174.stdout:3/637: dread df/d2d/d4d/faf [45056,40960] 0 2024-05-06T14:04:18.738 INFO:tasks.workunit.client.1.smithi174.stdout:3/638: mkdir df/d10/dcb 0 2024-05-06T14:04:18.738 INFO:tasks.workunit.client.1.smithi174.stdout:2/650: dread d0/da/f1d [282624,53248] 0 2024-05-06T14:04:18.738 INFO:tasks.workunit.client.1.smithi174.stdout:2/651: creat d0/d1/d2/d2a/fca x:0 0 0 2024-05-06T14:04:18.739 INFO:tasks.workunit.client.1.smithi174.stdout:0/675: creat d0/d1a/d17/d2e/d58/fdd x:0 0 0 2024-05-06T14:04:18.739 INFO:tasks.workunit.client.1.smithi174.stdout:0/676: chown d0/d36/d3f/d7a/f9c 67008488 1 2024-05-06T14:04:18.739 INFO:tasks.workunit.client.1.smithi174.stdout:0/677: mkdir d0/d4/d8/d25/d5c/dde 0 2024-05-06T14:04:18.739 INFO:tasks.workunit.client.1.smithi174.stdout:0/678: mknod d0/d4/d8/d25/d5c/d44/dd5/d83/cdf 0 2024-05-06T14:04:18.739 INFO:tasks.workunit.client.1.smithi174.stdout:0/679: truncate d0/fc3 234425 0 2024-05-06T14:04:18.739 INFO:tasks.workunit.client.1.smithi174.stdout:0/680: rmdir d0/d16 39 2024-05-06T14:04:18.739 INFO:tasks.workunit.client.1.smithi174.stdout:0/681: readlink d0/d4/ld3 0 2024-05-06T14:04:18.739 INFO:tasks.workunit.client.1.smithi174.stdout:3/639: truncate df/d10/da2/fae 918913 0 2024-05-06T14:04:18.739 INFO:tasks.workunit.client.1.smithi174.stdout:0/682: mkdir d0/d4/d8/d25/d5c/d4a/da7/de0 0 2024-05-06T14:04:18.740 INFO:tasks.workunit.client.1.smithi174.stdout:0/683: mknod d0/d36/d3f/ce1 0 2024-05-06T14:04:18.740 INFO:tasks.workunit.client.1.smithi174.stdout:3/640: write df/d10/f52 [346591,95257] 0 2024-05-06T14:04:18.740 INFO:tasks.workunit.client.1.smithi174.stdout:3/641: chown df/f9e 3278998 1 2024-05-06T14:04:18.740 INFO:tasks.workunit.client.1.smithi174.stdout:3/642: getdents df/dbc 0 2024-05-06T14:04:18.740 INFO:tasks.workunit.client.1.smithi174.stdout:3/643: unlink df/d10/d1b/f24 0 2024-05-06T14:04:18.740 INFO:tasks.workunit.client.1.smithi174.stdout:3/644: creat df/d10/d1b/d59/fcc x:0 0 0 2024-05-06T14:04:18.740 INFO:tasks.workunit.client.1.smithi174.stdout:3/645: chown df/d10/d1b/d7e 58 1 2024-05-06T14:04:18.740 INFO:tasks.workunit.client.1.smithi174.stdout:3/646: getdents df/d10/d1b/d59 0 2024-05-06T14:04:18.740 INFO:tasks.workunit.client.1.smithi174.stdout:3/647: symlink df/d10/d1b/d7e/lcd 0 2024-05-06T14:04:18.741 INFO:tasks.workunit.client.1.smithi174.stdout:3/648: creat df/d2d/d5b/fce x:0 0 0 2024-05-06T14:04:18.741 INFO:tasks.workunit.client.1.smithi174.stdout:7/577: dwrite d0/d3a/f6a [753664,126976] 0 2024-05-06T14:04:18.741 INFO:tasks.workunit.client.1.smithi174.stdout:5/843: dwrite d1/d6/d7/d36/d53/d59/fff [942080,69632] 0 2024-05-06T14:04:18.741 INFO:tasks.workunit.client.1.smithi174.stdout:5/844: chown d1/d6/df/d35/l5a 71 1 2024-05-06T14:04:18.741 INFO:tasks.workunit.client.1.smithi174.stdout:5/845: rmdir d1/d6/d7/da1/dfc 39 2024-05-06T14:04:18.741 INFO:tasks.workunit.client.1.smithi174.stdout:5/846: mknod d1/d6/df/d35/d81/d60/db0/de/dbd/c11c 0 2024-05-06T14:04:18.741 INFO:tasks.workunit.client.1.smithi174.stdout:5/847: rmdir d1/d6/d7/da1/dd8 39 2024-05-06T14:04:18.741 INFO:tasks.workunit.client.1.smithi174.stdout:5/848: dread d1/d6/d7/da1/f88 [847872,106496] 0 2024-05-06T14:04:18.742 INFO:tasks.workunit.client.1.smithi174.stdout:5/849: write d1/d6/df/d35/d81/d1e/f8c [11257,28683] 0 2024-05-06T14:04:18.742 INFO:tasks.workunit.client.1.smithi174.stdout:4/843: dwrite d1/d1f/d27/d2c/d45/fe0 [983040,49152] 0 2024-05-06T14:04:18.742 INFO:tasks.workunit.client.1.smithi174.stdout:4/844: dread - d1/fac zero size 2024-05-06T14:04:18.742 INFO:tasks.workunit.client.1.smithi174.stdout:5/850: link d1/d6/df/d35/d81/f4b d1/f11d 0 2024-05-06T14:04:18.742 INFO:tasks.workunit.client.1.smithi174.stdout:5/851: dread - d1/d6/df/d35/d81/d60/db0/de/f110 zero size 2024-05-06T14:04:18.742 INFO:tasks.workunit.client.1.smithi174.stdout:5/852: creat d1/d6/df/d35/d81/d1e/f11e x:0 0 0 2024-05-06T14:04:18.742 INFO:tasks.workunit.client.1.smithi174.stdout:4/845: symlink d1/d1f/d27/l12c 0 2024-05-06T14:04:18.742 INFO:tasks.workunit.client.1.smithi174.stdout:5/853: creat d1/ddf/f11f x:0 0 0 2024-05-06T14:04:18.742 INFO:tasks.workunit.client.1.smithi174.stdout:5/854: stat d1/d6/d7/d36/d53 0 2024-05-06T14:04:18.743 INFO:tasks.workunit.client.1.smithi174.stdout:5/855: chown d1/d6/df/d35/d81/d60/db0 9997 1 2024-05-06T14:04:18.743 INFO:tasks.workunit.client.1.smithi174.stdout:5/856: rename d1/d6/df/d35/d81/d8d/fe4 to d1/d6/d7/d36/d53/f120 0 2024-05-06T14:04:18.743 INFO:tasks.workunit.client.1.smithi174.stdout:5/857: creat d1/d6/d7/d11b/f121 x:0 0 0 2024-05-06T14:04:18.743 INFO:tasks.workunit.client.1.smithi174.stdout:5/858: chown d1/d6/df 60635 1 2024-05-06T14:04:18.743 INFO:tasks.workunit.client.1.smithi174.stdout:5/859: dread d1/d6/f34 [94208,61440] 0 2024-05-06T14:04:18.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:18.795+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 msgr2=0x7f7190006620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:18.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:18.795+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 0x7f7190006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:04:18.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:18.795+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:18.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:18.795+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:04:18.803 INFO:tasks.workunit.client.1.smithi174.stdout:9/636: sync 2024-05-06T14:04:18.804 INFO:tasks.workunit.client.1.smithi174.stdout:8/816: sync 2024-05-06T14:04:18.804 INFO:tasks.workunit.client.1.smithi174.stdout:9/637: symlink dc/d27/d6d/ld5 0 2024-05-06T14:04:18.804 INFO:tasks.workunit.client.1.smithi174.stdout:8/817: symlink d4/de/d23/d3c/db2/da6/l10e 0 2024-05-06T14:04:18.804 INFO:tasks.workunit.client.1.smithi174.stdout:9/638: link dc/d17/d3a/dcb/daf/d43/d8e/lae dc/d17/d3a/dcb/daf/d43/d8e/ld6 0 2024-05-06T14:04:18.804 INFO:tasks.workunit.client.1.smithi174.stdout:9/639: mkdir dc/d27/d6d/dd7 0 2024-05-06T14:04:18.804 INFO:tasks.workunit.client.1.smithi174.stdout:8/818: write d4/de/d24/d5e/fd7 [1016998,67888] 0 2024-05-06T14:04:18.804 INFO:tasks.workunit.client.1.smithi174.stdout:9/640: dread dc/d27/d63/f74 [573440,57344] 0 2024-05-06T14:04:18.805 INFO:tasks.workunit.client.1.smithi174.stdout:8/819: rename d4 to d4/d15/d66/d10f 22 2024-05-06T14:04:18.805 INFO:tasks.workunit.client.1.smithi174.stdout:9/641: truncate dc/d1c/f56 756563 0 2024-05-06T14:04:18.805 INFO:tasks.workunit.client.1.smithi174.stdout:8/820: getdents d4/de/d23/d3c/db2/da6/dad/d107 0 2024-05-06T14:04:18.805 INFO:tasks.workunit.client.1.smithi174.stdout:9/642: creat dc/d9b/dd4/fd8 x:0 0 0 2024-05-06T14:04:18.805 INFO:tasks.workunit.client.1.smithi174.stdout:8/821: creat d4/de/d23/d41/d56/f110 x:0 0 0 2024-05-06T14:04:18.805 INFO:tasks.workunit.client.1.smithi174.stdout:9/643: link dc/f36 dc/d27/dc9/fd9 0 2024-05-06T14:04:18.805 INFO:tasks.workunit.client.1.smithi174.stdout:9/644: write dc/f76 [451566,91477] 0 2024-05-06T14:04:18.806 INFO:tasks.workunit.client.1.smithi174.stdout:9/645: mknod dc/d17/d3a/dcb/daf/d43/d8e/dd2/cda 0 2024-05-06T14:04:18.806 INFO:tasks.workunit.client.1.smithi174.stdout:9/646: symlink dc/d27/d6d/dd7/ldb 0 2024-05-06T14:04:18.806 INFO:tasks.workunit.client.1.smithi174.stdout:8/822: unlink d4/de/f13 0 2024-05-06T14:04:18.806 INFO:tasks.workunit.client.1.smithi174.stdout:8/823: chown d4/de/d24/d5e/d85/d91/lc5 3036518 1 2024-05-06T14:04:18.806 INFO:tasks.workunit.client.1.smithi174.stdout:8/824: creat d4/d15/d20/d3e/d79/d94/f111 x:0 0 0 2024-05-06T14:04:18.806 INFO:tasks.workunit.client.1.smithi174.stdout:8/825: chown d4/d15/d20/d3e/d79/d94/lc8 922938 1 2024-05-06T14:04:18.806 INFO:tasks.workunit.client.1.smithi174.stdout:9/647: write dc/d17/d3a/dcb/daf/fb5 [1663631,76538] 0 2024-05-06T14:04:18.808 INFO:tasks.workunit.client.1.smithi174.stdout:5/860: dread d1/d6/df/d35/d81/f10f [61440,118784] 0 2024-05-06T14:04:18.808 INFO:tasks.workunit.client.1.smithi174.stdout:5/861: symlink d1/d6/df/d35/d81/d60/db0/de/dbd/df1/l122 0 2024-05-06T14:04:18.808 INFO:tasks.workunit.client.1.smithi174.stdout:5/862: write d1/d6/d7/d11b/f121 [25075,65364] 0 2024-05-06T14:04:18.808 INFO:tasks.workunit.client.1.smithi174.stdout:5/863: mknod d1/d6/df/d35/d81/c123 0 2024-05-06T14:04:18.808 INFO:tasks.workunit.client.1.smithi174.stdout:5/864: stat d1/d6/df/d35/f3d 0 2024-05-06T14:04:18.808 INFO:tasks.workunit.client.1.smithi174.stdout:5/865: symlink d1/d6/d7/da1/dd8/l124 0 2024-05-06T14:04:18.809 INFO:tasks.workunit.client.1.smithi174.stdout:5/866: unlink d1/d6/d7/da1/l86 0 2024-05-06T14:04:18.828 INFO:tasks.workunit.client.1.smithi174.stdout:6/882: fsync d0/d25/d35/fa4 0 2024-05-06T14:04:18.828 INFO:tasks.workunit.client.1.smithi174.stdout:1/658: fdatasync d11/d1f/d27/d32/d84/d8c/fa4 0 2024-05-06T14:04:18.828 INFO:tasks.workunit.client.1.smithi174.stdout:3/649: fsync df/d10/d1b/f22 0 2024-05-06T14:04:18.828 INFO:tasks.workunit.client.1.smithi174.stdout:2/652: fsync d0/d1/f8e 0 2024-05-06T14:04:18.828 INFO:tasks.workunit.client.1.smithi174.stdout:0/684: fdatasync d0/d4/d8/d25/f63 0 2024-05-06T14:04:18.828 INFO:tasks.workunit.client.1.smithi174.stdout:1/659: dread - d11/d1f/d27/d2d/fa6 zero size 2024-05-06T14:04:18.829 INFO:tasks.workunit.client.1.smithi174.stdout:7/578: fsync d0/d1d/da4/d61/f16 0 2024-05-06T14:04:18.829 INFO:tasks.workunit.client.1.smithi174.stdout:4/846: fsync d1/d9/d15/d92/fca 0 2024-05-06T14:04:18.829 INFO:tasks.workunit.client.1.smithi174.stdout:4/847: dread d1/d9/f2d [876544,12288] 0 2024-05-06T14:04:18.829 INFO:tasks.workunit.client.1.smithi174.stdout:0/685: symlink d0/le2 0 2024-05-06T14:04:18.829 INFO:tasks.workunit.client.1.smithi174.stdout:0/686: mknod d0/d4/d8/d25/d5c/d4a/da7/de0/ce3 0 2024-05-06T14:04:18.829 INFO:tasks.workunit.client.1.smithi174.stdout:6/883: write d0/d25/d52/d2c/f63 [792990,128991] 0 2024-05-06T14:04:18.829 INFO:tasks.workunit.client.1.smithi174.stdout:0/687: rename d0/d4/ld3 to d0/d4/d8/d25/d5c/d44/db9/le4 0 2024-05-06T14:04:18.829 INFO:tasks.workunit.client.1.smithi174.stdout:2/653: write d0/d1/d2/d4/d18/fa0 [716563,103711] 0 2024-05-06T14:04:18.830 INFO:tasks.workunit.client.1.smithi174.stdout:2/654: getdents d0/d1/d2/d4/d6/d3c/dc7 0 2024-05-06T14:04:18.830 INFO:tasks.workunit.client.1.smithi174.stdout:2/655: getdents d0/d24/d77/d93 0 2024-05-06T14:04:18.830 INFO:tasks.workunit.client.1.smithi174.stdout:2/656: creat d0/d1/fcb x:0 0 0 2024-05-06T14:04:18.830 INFO:tasks.workunit.client.1.smithi174.stdout:2/657: rmdir d0/d1/d2/d2a 39 2024-05-06T14:04:18.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/688: write d0/d36/d45/f4d [953811,116694] 0 2024-05-06T14:04:18.830 INFO:tasks.workunit.client.1.smithi174.stdout:2/658: stat d0/d1/d2/d4/d6/d3c/dc7 0 2024-05-06T14:04:18.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/689: chown d0/d4/d8/d25/d5c/d4a/da7/de0 0 1 2024-05-06T14:04:18.830 INFO:tasks.workunit.client.1.smithi174.stdout:2/659: truncate d0/d1/d2/d2a/fca 997012 0 2024-05-06T14:04:18.831 INFO:tasks.workunit.client.1.smithi174.stdout:2/660: readlink d0/d1/d2/d4/d6/l79 0 2024-05-06T14:04:18.831 INFO:tasks.workunit.client.1.smithi174.stdout:0/690: dread d0/d4/d8/d25/d5c/f4c [327680,57344] 0 2024-05-06T14:04:18.831 INFO:tasks.workunit.client.1.smithi174.stdout:2/661: link d0/d1/d2/d4/f22 d0/d1/d2/d4/d6/d3c/fcc 0 2024-05-06T14:04:18.831 INFO:tasks.workunit.client.1.smithi174.stdout:0/691: mknod d0/d16/ce5 0 2024-05-06T14:04:18.831 INFO:tasks.workunit.client.1.smithi174.stdout:0/692: chown d0/d4/d8/d25/d5c/d44/dd5/d38/c55 0 1 2024-05-06T14:04:18.831 INFO:tasks.workunit.client.1.smithi174.stdout:0/693: creat d0/d4/d8/d25/d5c/d4a/da7/dcb/fe6 x:0 0 0 2024-05-06T14:04:18.831 INFO:tasks.workunit.client.1.smithi174.stdout:0/694: unlink d0/d4/d80/lb3 0 2024-05-06T14:04:18.831 INFO:tasks.workunit.client.1.smithi174.stdout:0/695: link d0/d1a/f6c d0/d4/d8/d25/d5c/ddb/fe7 0 2024-05-06T14:04:18.831 INFO:tasks.workunit.client.1.smithi174.stdout:0/696: symlink d0/d16/le8 0 2024-05-06T14:04:18.832 INFO:tasks.workunit.client.1.smithi174.stdout:0/697: truncate d0/d4/d8/d25/fd4 947025 0 2024-05-06T14:04:18.832 INFO:tasks.workunit.client.1.smithi174.stdout:0/698: rmdir d0/d36/d3f 39 2024-05-06T14:04:18.832 INFO:tasks.workunit.client.1.smithi174.stdout:3/650: dwrite df/d10/f19 [749568,4096] 0 2024-05-06T14:04:18.832 INFO:tasks.workunit.client.1.smithi174.stdout:3/651: rename df/d2d/d5b/fce to df/d10/d1b/fcf 0 2024-05-06T14:04:18.845 INFO:tasks.workunit.client.1.smithi174.stdout:7/579: fsync d0/d1d/da4/d61/d19/d39/f78 0 2024-05-06T14:04:18.845 INFO:tasks.workunit.client.1.smithi174.stdout:7/580: creat d0/d1d/da4/d61/fc9 x:0 0 0 2024-05-06T14:04:18.848 INFO:tasks.workunit.client.1.smithi174.stdout:1/660: dwrite d11/d1f/d27/d2d/fd0 [1048576,106496] 0 2024-05-06T14:04:18.848 INFO:tasks.workunit.client.1.smithi174.stdout:1/661: read d11/d41/f66 [1929469,5832] 0 2024-05-06T14:04:18.849 INFO:tasks.workunit.client.1.smithi174.stdout:4/848: dwrite d1/f12a [708608,16384] 0 2024-05-06T14:04:18.849 INFO:tasks.workunit.client.1.smithi174.stdout:4/849: creat d1/d1f/d27/d2c/d45/dc3/f12d x:0 0 0 2024-05-06T14:04:18.849 INFO:tasks.workunit.client.1.smithi174.stdout:4/850: creat d1/d9/d15/f12e x:0 0 0 2024-05-06T14:04:18.849 INFO:tasks.workunit.client.1.smithi174.stdout:6/884: dwrite d0/d25/d52/d2c/f63 [1437696,77824] 0 2024-05-06T14:04:18.849 INFO:tasks.workunit.client.1.smithi174.stdout:6/885: mkdir d0/d25/d52/d2c/d105/d85/ddf/ded/d126 0 2024-05-06T14:04:18.850 INFO:tasks.workunit.client.1.smithi174.stdout:1/662: dwrite d11/d1f/d27/d32/f50 [1921024,65536] 0 2024-05-06T14:04:18.850 INFO:tasks.workunit.client.1.smithi174.stdout:4/851: dwrite d1/d9/d15/d41/f10f [266240,45056] 0 2024-05-06T14:04:18.851 INFO:tasks.workunit.client.1.smithi174.stdout:6/886: dwrite d0/d25/d52/d2c/f37 [2527232,126976] 0 2024-05-06T14:04:18.914 INFO:tasks.workunit.client.1.smithi174.stdout:7/581: fdatasync d0/d1d/da4/f4b 0 2024-05-06T14:04:18.915 INFO:tasks.workunit.client.1.smithi174.stdout:0/699: fdatasync d0/d4/d8/d25/d5c/fc2 0 2024-05-06T14:04:18.921 INFO:tasks.workunit.client.1.smithi174.stdout:1/663: creat d11/d1f/d27/d32/d84/d8c/d94/fe9 x:0 0 0 2024-05-06T14:04:18.921 INFO:tasks.workunit.client.1.smithi174.stdout:0/700: mknod d0/d16/ce9 0 2024-05-06T14:04:18.921 INFO:tasks.workunit.client.1.smithi174.stdout:4/852: truncate d1/d2e/f40 1454778 0 2024-05-06T14:04:18.921 INFO:tasks.workunit.client.1.smithi174.stdout:7/582: symlink d0/d1d/da4/d61/d28/d37/lca 0 2024-05-06T14:04:18.921 INFO:tasks.workunit.client.1.smithi174.stdout:4/853: rmdir d1/d9/d15/d74 39 2024-05-06T14:04:18.921 INFO:tasks.workunit.client.1.smithi174.stdout:1/664: mkdir d11/d57/d77/dea 0 2024-05-06T14:04:18.922 INFO:tasks.workunit.client.1.smithi174.stdout:1/665: dread - d11/d1f/d27/d32/d84/d8c/d94/fe9 zero size 2024-05-06T14:04:18.922 INFO:tasks.workunit.client.1.smithi174.stdout:6/887: write d0/d25/d52/d2c/d105/da9/db3/f104 [1511426,110574] 0 2024-05-06T14:04:18.922 INFO:tasks.workunit.client.1.smithi174.stdout:6/888: chown d0/d25/d35/de3/f114 1407 1 2024-05-06T14:04:18.922 INFO:tasks.workunit.client.1.smithi174.stdout:6/889: creat d0/d25/d52/d2c/d5f/daa/f127 x:0 0 0 2024-05-06T14:04:18.922 INFO:tasks.workunit.client.1.smithi174.stdout:7/583: creat d0/d1d/da4/d61/d28/db1/dc8/fcb x:0 0 0 2024-05-06T14:04:18.922 INFO:tasks.workunit.client.1.smithi174.stdout:6/890: symlink d0/d25/d52/d2c/d105/da9/d11c/l128 0 2024-05-06T14:04:18.987 INFO:tasks.workunit.client.1.smithi174.stdout:0/701: fdatasync d0/d16/f8f 0 2024-05-06T14:04:18.987 INFO:tasks.workunit.client.1.smithi174.stdout:0/702: creat d0/d4/d8/fea x:0 0 0 2024-05-06T14:04:18.987 INFO:tasks.workunit.client.1.smithi174.stdout:4/854: fsync d1/d1f/d27/d84/fd2 0 2024-05-06T14:04:18.987 INFO:tasks.workunit.client.1.smithi174.stdout:4/855: readlink d1/d9/lbc 0 2024-05-06T14:04:18.987 INFO:tasks.workunit.client.1.smithi174.stdout:4/856: mknod d1/d9/d8d/c12f 0 2024-05-06T14:04:18.987 INFO:tasks.workunit.client.1.smithi174.stdout:4/857: dread - d1/d1f/d27/d2c/d45/dc3/f12d zero size 2024-05-06T14:04:18.987 INFO:tasks.workunit.client.1.smithi174.stdout:4/858: symlink d1/d9/d15/d35/dd9/d6b/ddf/l130 0 2024-05-06T14:04:18.988 INFO:tasks.workunit.client.1.smithi174.stdout:4/859: creat d1/d1f/d27/d2c/d45/df8/dfe/d121/f131 x:0 0 0 2024-05-06T14:04:18.988 INFO:tasks.workunit.client.1.smithi174.stdout:4/860: dread d1/d9/d15/f6d [2084864,57344] 0 2024-05-06T14:04:18.988 INFO:tasks.workunit.client.1.smithi174.stdout:4/861: write d1/d1f/d89/ff2 [447910,113832] 0 2024-05-06T14:04:18.988 INFO:tasks.workunit.client.1.smithi174.stdout:4/862: write d1/d48/d5a/f104 [871752,61689] 0 2024-05-06T14:04:18.988 INFO:tasks.workunit.client.1.smithi174.stdout:4/863: rmdir d1 39 2024-05-06T14:04:18.988 INFO:tasks.workunit.client.1.smithi174.stdout:4/864: link d1/d1f/d27/d2c/d45/df8/fe7 d1/d48/d5a/f132 0 2024-05-06T14:04:18.988 INFO:tasks.workunit.client.1.smithi174.stdout:4/865: creat d1/d1f/dd6/d6e/d10e/f133 x:0 0 0 2024-05-06T14:04:18.988 INFO:tasks.workunit.client.1.smithi174.stdout:4/866: truncate d1/d1f/d27/d2c/d45/dc3/f11e 871998 0 2024-05-06T14:04:18.989 INFO:tasks.workunit.client.1.smithi174.stdout:4/867: symlink d1/d9/d15/d74/d86/l134 0 2024-05-06T14:04:18.989 INFO:tasks.workunit.client.1.smithi174.stdout:4/868: mknod d1/d1f/d27/d84/c135 0 2024-05-06T14:04:18.989 INFO:tasks.workunit.client.1.smithi174.stdout:4/869: link d1/d9/d15/d98/d56/c9f d1/d48/d5a/d61/d68/c136 0 2024-05-06T14:04:18.989 INFO:tasks.workunit.client.1.smithi174.stdout:4/870: mkdir d1/d48/d5a/d137 0 2024-05-06T14:04:18.989 INFO:tasks.workunit.client.1.smithi174.stdout:4/871: read - d1/d9/d15/d35/dd9/d6b/ddf/f114 zero size 2024-05-06T14:04:18.989 INFO:tasks.workunit.client.1.smithi174.stdout:0/703: dwrite d0/d36/f3b [421888,61440] 0 2024-05-06T14:04:18.989 INFO:tasks.workunit.client.1.smithi174.stdout:0/704: symlink d0/d4/d8/d25/d5c/d4a/da7/leb 0 2024-05-06T14:04:18.989 INFO:tasks.workunit.client.1.smithi174.stdout:0/705: chown d0/d4/d8/d25/l6a 1394 1 2024-05-06T14:04:18.990 INFO:tasks.workunit.client.1.smithi174.stdout:0/706: unlink d0/d4/d8/l65 0 2024-05-06T14:04:18.990 INFO:tasks.workunit.client.1.smithi174.stdout:0/707: write d0/d4/d8/d25/d5c/d4a/da7/dcb/fe6 [971575,87677] 0 2024-05-06T14:04:18.990 INFO:tasks.workunit.client.1.smithi174.stdout:0/708: creat d0/d4/d8/d25/d5c/d44/dd5/fec x:0 0 0 2024-05-06T14:04:18.994 INFO:tasks.workunit.client.1.smithi174.stdout:1/666: dread d11/d1f/d27/d32/d84/ddc/fe1 [618496,36864] 0 2024-05-06T14:04:18.995 INFO:tasks.workunit.client.1.smithi174.stdout:1/667: truncate d11/d1f/d27/f45 470370 0 2024-05-06T14:04:18.995 INFO:tasks.workunit.client.1.smithi174.stdout:1/668: readlink d11/d57/d83/ld7 0 2024-05-06T14:04:18.995 INFO:tasks.workunit.client.1.smithi174.stdout:1/669: getdents d11/d1f/d27/d2d/ddd 0 2024-05-06T14:04:18.999 INFO:tasks.workunit.client.1.smithi174.stdout:7/584: write d0/d1d/da4/d61/f16 [4790072,130203] 0 2024-05-06T14:04:18.999 INFO:tasks.workunit.client.1.smithi174.stdout:7/585: rmdir d0/d1d/da4/d61/d19/d24/d89 39 2024-05-06T14:04:18.999 INFO:tasks.workunit.client.1.smithi174.stdout:7/586: symlink d0/d1d/da4/d61/d28/lcc 0 2024-05-06T14:04:19.000 INFO:tasks.workunit.client.1.smithi174.stdout:7/587: symlink d0/d1d/da4/d61/d19/d24/d14/d52/lcd 0 2024-05-06T14:04:19.000 INFO:tasks.workunit.client.1.smithi174.stdout:7/588: creat d0/d1d/d9c/fce x:0 0 0 2024-05-06T14:04:19.000 INFO:tasks.workunit.client.1.smithi174.stdout:7/589: truncate d0/d1d/da4/d61/d19/d24/f3c 98406 0 2024-05-06T14:04:19.029 INFO:tasks.workunit.client.1.smithi174.stdout:4/872: fdatasync d1/d9/d15/d74/d86/fc4 0 2024-05-06T14:04:19.029 INFO:tasks.workunit.client.1.smithi174.stdout:4/873: symlink d1/d1f/dd6/d6e/d10e/l138 0 2024-05-06T14:04:19.029 INFO:tasks.workunit.client.1.smithi174.stdout:3/652: fsync df/d10/da2/fae 0 2024-05-06T14:04:19.030 INFO:tasks.workunit.client.1.smithi174.stdout:7/590: fdatasync d0/d1d/da4/d61/d28/d37/f60 0 2024-05-06T14:04:19.030 INFO:tasks.workunit.client.1.smithi174.stdout:0/709: fdatasync d0/d3/dad/fd8 0 2024-05-06T14:04:19.030 INFO:tasks.workunit.client.1.smithi174.stdout:4/874: write d1/d1f/d27/d2c/d45/df8/fe7 [1476571,56349] 0 2024-05-06T14:04:19.030 INFO:tasks.workunit.client.1.smithi174.stdout:3/653: mknod df/dbc/cd0 0 2024-05-06T14:04:19.030 INFO:tasks.workunit.client.1.smithi174.stdout:7/591: rmdir d0/d1d/da4/d61/d19/d39/dc0 0 2024-05-06T14:04:19.030 INFO:tasks.workunit.client.1.smithi174.stdout:4/875: write d1/d9/f16 [2199925,49520] 0 2024-05-06T14:04:19.030 INFO:tasks.workunit.client.1.smithi174.stdout:4/876: read d1/d9/f16 [3047029,122299] 0 2024-05-06T14:04:19.030 INFO:tasks.workunit.client.1.smithi174.stdout:3/654: write df/d10/d1b/d7e/d57/f80 [895202,109205] 0 2024-05-06T14:04:19.031 INFO:tasks.workunit.client.1.smithi174.stdout:3/655: mknod df/d10/d1b/d7e/d5a/cd1 0 2024-05-06T14:04:19.031 INFO:tasks.workunit.client.1.smithi174.stdout:0/710: dwrite d0/d4/d8/d25/d5c/f87 [909312,102400] 0 2024-05-06T14:04:19.048 INFO:tasks.workunit.client.1.smithi174.stdout:7/592: fdatasync d0/d1d/da4/d61/f38 0 2024-05-06T14:04:19.048 INFO:tasks.workunit.client.1.smithi174.stdout:7/593: truncate d0/f2e 2131437 0 2024-05-06T14:04:19.048 INFO:tasks.workunit.client.1.smithi174.stdout:7/594: write d0/d1d/da4/d61/d19/f32 [188111,6053] 0 2024-05-06T14:04:19.050 INFO:tasks.workunit.client.1.smithi174.stdout:4/877: symlink d1/d48/d5a/d137/l139 0 2024-05-06T14:04:19.050 INFO:tasks.workunit.client.1.smithi174.stdout:1/670: dwrite d11/d1f/d27/f2b [262144,49152] 0 2024-05-06T14:04:19.051 INFO:tasks.workunit.client.1.smithi174.stdout:3/656: symlink df/d2d/ld2 0 2024-05-06T14:04:19.051 INFO:tasks.workunit.client.1.smithi174.stdout:4/878: mknod d1/d48/d5a/d61/d68/dec/c13a 0 2024-05-06T14:04:19.051 INFO:tasks.workunit.client.1.smithi174.stdout:7/595: write d0/f34 [128115,58261] 0 2024-05-06T14:04:19.051 INFO:tasks.workunit.client.1.smithi174.stdout:7/596: chown d0/d1d/da4/d61/d19/d24/d47/d70/d67/l9d 9019 1 2024-05-06T14:04:19.051 INFO:tasks.workunit.client.1.smithi174.stdout:1/671: creat d11/d1f/d27/d32/d92/feb x:0 0 0 2024-05-06T14:04:19.051 INFO:tasks.workunit.client.1.smithi174.stdout:1/672: dread d11/d41/d4a/f81 [262144,106496] 0 2024-05-06T14:04:19.051 INFO:tasks.workunit.client.1.smithi174.stdout:3/657: write df/d2d/f86 [1134574,66879] 0 2024-05-06T14:04:19.052 INFO:tasks.workunit.client.1.smithi174.stdout:7/597: mkdir d0/d1d/da4/d61/d28/d59/da1/dcf 0 2024-05-06T14:04:19.052 INFO:tasks.workunit.client.1.smithi174.stdout:3/658: truncate df/d10/f3f 1804894 0 2024-05-06T14:04:19.052 INFO:tasks.workunit.client.1.smithi174.stdout:0/711: dwrite d0/f24 [1650688,118784] 0 2024-05-06T14:04:19.052 INFO:tasks.workunit.client.1.smithi174.stdout:0/712: truncate d0/d1a/f1b 1454872 0 2024-05-06T14:04:19.052 INFO:tasks.workunit.client.1.smithi174.stdout:0/713: read d0/d16/f8f [405221,36201] 0 2024-05-06T14:04:19.052 INFO:tasks.workunit.client.1.smithi174.stdout:0/714: mknod d0/d36/d45/ced 0 2024-05-06T14:04:19.052 INFO:tasks.workunit.client.1.smithi174.stdout:0/715: truncate d0/d3/dad/fd8 31598 0 2024-05-06T14:04:19.081 INFO:tasks.workunit.client.1.smithi174.stdout:4/879: dwrite d1/d9/f10d [1273856,81920] 0 2024-05-06T14:04:19.081 INFO:tasks.workunit.client.1.smithi174.stdout:4/880: rename d1/d1f/d27/d2c/d45/dc1/c9a to d1/d1f/dd6/d6e/c13b 0 2024-05-06T14:04:19.083 INFO:tasks.workunit.client.1.smithi174.stdout:7/598: dwrite d0/f8e [32768,53248] 0 2024-05-06T14:04:19.083 INFO:tasks.workunit.client.1.smithi174.stdout:1/673: dwrite d11/d1f/d27/d32/f6b [1372160,73728] 0 2024-05-06T14:04:19.083 INFO:tasks.workunit.client.1.smithi174.stdout:3/659: dwrite df/d10/d1b/d59/f89 [20480,126976] 0 2024-05-06T14:04:19.125 INFO:tasks.workunit.client.1.smithi174.stdout:4/881: fdatasync d1/d1f/dd6/d6e/d50/f124 0 2024-05-06T14:04:19.126 INFO:tasks.workunit.client.1.smithi174.stdout:6/891: fsync d0/d25/d52/d2c/f63 0 2024-05-06T14:04:19.131 INFO:tasks.workunit.client.1.smithi174.stdout:4/882: rename d1/d9/d15/d35/fef to d1/d9/d15/d35/f13c 0 2024-05-06T14:04:19.131 INFO:tasks.workunit.client.1.smithi174.stdout:4/883: write d1/d9/d15/d92/f100 [84244,80848] 0 2024-05-06T14:04:19.132 INFO:tasks.workunit.client.1.smithi174.stdout:7/599: dwrite d0/d1d/da4/d61/d28/f6e [323584,65536] 0 2024-05-06T14:04:19.132 INFO:tasks.workunit.client.1.smithi174.stdout:7/600: mknod d0/d1d/da4/d61/d28/db1/cd0 0 2024-05-06T14:04:19.132 INFO:tasks.workunit.client.1.smithi174.stdout:7/601: rmdir d0/d1d/da4/d61/d19/d24/d47/d64 39 2024-05-06T14:04:19.132 INFO:tasks.workunit.client.1.smithi174.stdout:7/602: dread - d0/d1d/da4/d61/d28/d37/f4e zero size 2024-05-06T14:04:19.132 INFO:tasks.workunit.client.1.smithi174.stdout:7/603: getdents d0/d1d/da4/d61/d19/d39 0 2024-05-06T14:04:19.132 INFO:tasks.workunit.client.1.smithi174.stdout:7/604: unlink d0/d1d/da4/d61/d19/f31 0 2024-05-06T14:04:19.132 INFO:tasks.workunit.client.1.smithi174.stdout:6/892: dwrite d0/d25/d35/f9b [937984,53248] 0 2024-05-06T14:04:19.132 INFO:tasks.workunit.client.1.smithi174.stdout:6/893: rmdir d0/d25/d52 39 2024-05-06T14:04:19.133 INFO:tasks.workunit.client.1.smithi174.stdout:4/884: dwrite d1/d1f/d27/d2c/d45/dc3/f12d [561152,4096] 0 2024-05-06T14:04:19.133 INFO:tasks.workunit.client.1.smithi174.stdout:6/894: dread - d0/d25/d52/d2c/d6f/fbc zero size 2024-05-06T14:04:19.142 INFO:tasks.workunit.client.1.smithi174.stdout:3/660: dread df/d10/d1b/d7e/f75 [86016,40960] 0 2024-05-06T14:04:19.142 INFO:tasks.workunit.client.1.smithi174.stdout:3/661: stat df/d2d/d4d/da5 0 2024-05-06T14:04:19.177 INFO:tasks.workunit.client.1.smithi174.stdout:1/674: fsync d11/d1f/d27/d32/f50 0 2024-05-06T14:04:19.177 INFO:tasks.workunit.client.1.smithi174.stdout:1/675: mknod d11/d57/d98/daf/d9b/cec 0 2024-05-06T14:04:19.178 INFO:tasks.workunit.client.1.smithi174.stdout:1/676: rmdir d11/d41/dc9 39 2024-05-06T14:04:19.178 INFO:tasks.workunit.client.1.smithi174.stdout:1/677: rename d11/d1f/d55 to d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/ded 0 2024-05-06T14:04:19.180 INFO:tasks.workunit.client.1.smithi174.stdout:3/662: dwrite df/d10/f2f [192512,86016] 0 2024-05-06T14:04:19.180 INFO:tasks.workunit.client.1.smithi174.stdout:6/895: dread d0/d25/d52/d2c/f63 [634880,122880] 0 2024-05-06T14:04:19.180 INFO:tasks.workunit.client.1.smithi174.stdout:6/896: write d0/d25/d35/f9e [952616,47552] 0 2024-05-06T14:04:19.181 INFO:tasks.workunit.client.1.smithi174.stdout:4/885: creat d1/d9/d15/d92/f13d x:0 0 0 2024-05-06T14:04:19.182 INFO:tasks.workunit.client.1.smithi174.stdout:3/663: symlink df/d2d/d4e/db6/db8/ld3 0 2024-05-06T14:04:19.182 INFO:tasks.workunit.client.1.smithi174.stdout:1/678: mkdir d11/d1f/d27/d32/d84/d8c/dee 0 2024-05-06T14:04:19.182 INFO:tasks.workunit.client.1.smithi174.stdout:4/886: stat d1/d9/d15/d98/f28 0 2024-05-06T14:04:19.182 INFO:tasks.workunit.client.1.smithi174.stdout:1/679: stat d11/d1f/fa7 0 2024-05-06T14:04:19.182 INFO:tasks.workunit.client.1.smithi174.stdout:4/887: chown d1/d48/d5a/f104 0 1 2024-05-06T14:04:19.182 INFO:tasks.workunit.client.1.smithi174.stdout:6/897: creat d0/d25/d52/d3b/f129 x:0 0 0 2024-05-06T14:04:19.183 INFO:tasks.workunit.client.1.smithi174.stdout:1/680: creat d11/d41/dc9/fef x:0 0 0 2024-05-06T14:04:19.183 INFO:tasks.workunit.client.1.smithi174.stdout:3/664: truncate df/d2d/d5b/f71 624040 0 2024-05-06T14:04:19.183 INFO:tasks.workunit.client.1.smithi174.stdout:4/888: creat d1/d9/d15/d74/f13e x:0 0 0 2024-05-06T14:04:19.183 INFO:tasks.workunit.client.1.smithi174.stdout:3/665: symlink df/d10/da2/ld4 0 2024-05-06T14:04:19.183 INFO:tasks.workunit.client.1.smithi174.stdout:4/889: truncate d1/d48/d5a/d61/fa8 620415 0 2024-05-06T14:04:19.183 INFO:tasks.workunit.client.1.smithi174.stdout:6/898: write d0/d25/d35/f4d [400717,127347] 0 2024-05-06T14:04:19.183 INFO:tasks.workunit.client.1.smithi174.stdout:6/899: dread d0/d25/d52/da6/fe9 [860160,73728] 0 2024-05-06T14:04:19.186 INFO:tasks.workunit.client.1.smithi174.stdout:3/666: dwrite df/d10/d1b/d7e/d57/f95 [425984,122880] 0 2024-05-06T14:04:19.186 INFO:tasks.workunit.client.1.smithi174.stdout:3/667: read - df/d10/d1b/d59/fcc zero size 2024-05-06T14:04:19.186 INFO:tasks.workunit.client.1.smithi174.stdout:3/668: symlink df/d2d/d4d/da5/ld5 0 2024-05-06T14:04:19.186 INFO:tasks.workunit.client.1.smithi174.stdout:3/669: readlink df/d2d/d4e/l67 0 2024-05-06T14:04:19.186 INFO:tasks.workunit.client.1.smithi174.stdout:6/900: dwrite d0/d25/d52/d2c/d6f/f71 [1032192,81920] 0 2024-05-06T14:04:19.187 INFO:tasks.workunit.client.1.smithi174.stdout:6/901: chown d0/d25/d52/d2c/d6f/dfa 23047 1 2024-05-06T14:04:19.187 INFO:tasks.workunit.client.1.smithi174.stdout:6/902: chown d0 3939614 1 2024-05-06T14:04:19.187 INFO:tasks.workunit.client.1.smithi174.stdout:6/903: chown d0/d25/d35/fa4 251412 1 2024-05-06T14:04:19.187 INFO:tasks.workunit.client.1.smithi174.stdout:6/904: write d0/d25/d52/d2c/d105/da9/db3/fd8 [1593879,83000] 0 2024-05-06T14:04:19.187 INFO:tasks.workunit.client.1.smithi174.stdout:6/905: getdents d0/d25/d52/d2c/d105/dcf/d124 0 2024-05-06T14:04:19.187 INFO:tasks.workunit.client.1.smithi174.stdout:4/890: dwrite d1/d1f/d27/d2c/d45/f127 [1355776,126976] 0 2024-05-06T14:04:19.187 INFO:tasks.workunit.client.1.smithi174.stdout:4/891: rmdir d1/d48/d5a/d61/d68/dec 39 2024-05-06T14:04:19.187 INFO:tasks.workunit.client.1.smithi174.stdout:4/892: mkdir d1/d1f/d117/d13f 0 2024-05-06T14:04:19.188 INFO:tasks.workunit.client.1.smithi174.stdout:4/893: dread - d1/d106/f109 zero size 2024-05-06T14:04:19.188 INFO:tasks.workunit.client.1.smithi174.stdout:4/894: mkdir d1/d48/d5a/d61/d140 0 2024-05-06T14:04:19.188 INFO:tasks.workunit.client.1.smithi174.stdout:4/895: mknod d1/d1f/d117/c141 0 2024-05-06T14:04:19.188 INFO:tasks.workunit.client.1.smithi174.stdout:4/896: unlink d1/d9/d15/d92/fca 0 2024-05-06T14:04:19.188 INFO:tasks.workunit.client.1.smithi174.stdout:4/897: write d1/d9/d15/d74/d86/dc2/fff [267429,81296] 0 2024-05-06T14:04:19.188 INFO:tasks.workunit.client.1.smithi174.stdout:4/898: chown d1/d9/f2d 16195599 1 2024-05-06T14:04:19.188 INFO:tasks.workunit.client.1.smithi174.stdout:4/899: creat d1/d9/d15/d35/dd9/d6b/f142 x:0 0 0 2024-05-06T14:04:19.188 INFO:tasks.workunit.client.1.smithi174.stdout:1/681: dread d11/d1f/d27/d2d/f31 [356352,32768] 0 2024-05-06T14:04:19.188 INFO:tasks.workunit.client.1.smithi174.stdout:1/682: read d11/d57/d98/daf/fa1 [149445,54039] 0 2024-05-06T14:04:19.189 INFO:tasks.workunit.client.1.smithi174.stdout:1/683: creat d11/d1f/d27/d2d/d9c/ff0 x:0 0 0 2024-05-06T14:04:19.189 INFO:tasks.workunit.client.1.smithi174.stdout:1/684: write d11/d1f/d27/d2d/f31 [1483439,124953] 0 2024-05-06T14:04:19.268 INFO:tasks.workunit.client.1.smithi174.stdout:1/685: dwrite d11/d1f/d27/d2d/fa6 [839680,65536] 0 2024-05-06T14:04:19.268 INFO:tasks.workunit.client.1.smithi174.stdout:1/686: creat d11/d1f/d27/d32/d92/dbc/ff1 x:0 0 0 2024-05-06T14:04:19.268 INFO:tasks.workunit.client.1.smithi174.stdout:1/687: link d11/d1f/d27/d32/d84/f9a d11/d1f/d27/d32/d84/ddc/ff2 0 2024-05-06T14:04:19.268 INFO:tasks.workunit.client.1.smithi174.stdout:1/688: write d11/d1f/d27/d32/d84/f9a [517623,68088] 0 2024-05-06T14:04:19.305 INFO:tasks.workunit.client.1.smithi174.stdout:4/900: fsync d1/d1f/d27/fcb 0 2024-05-06T14:04:19.305 INFO:tasks.workunit.client.1.smithi174.stdout:4/901: rmdir d1/d1f/d27/d2c/d45/dc1 39 2024-05-06T14:04:19.305 INFO:tasks.workunit.client.1.smithi174.stdout:6/906: fdatasync d0/d25/d52/d2c/f6a 0 2024-05-06T14:04:19.305 INFO:tasks.workunit.client.1.smithi174.stdout:4/902: rmdir d1/d9/d15/d35/dd9/d6b/ddf 39 2024-05-06T14:04:19.307 INFO:tasks.workunit.client.1.smithi174.stdout:6/907: rmdir d0/d25/d52/d2c/d105/d117 0 2024-05-06T14:04:19.318 INFO:tasks.workunit.client.1.smithi174.stdout:1/689: write d11/d1f/d27/d2d/f3a [599088,18941] 0 2024-05-06T14:04:19.391 INFO:tasks.workunit.client.1.smithi174.stdout:4/903: fdatasync d1/d48/d5a/d5f/ffb 0 2024-05-06T14:04:19.392 INFO:tasks.workunit.client.1.smithi174.stdout:4/904: chown d1/d2e 134 1 2024-05-06T14:04:19.392 INFO:tasks.workunit.client.1.smithi174.stdout:6/908: fsync d0/d25/d52/d2c/d6f/f99 0 2024-05-06T14:04:19.400 INFO:tasks.workunit.client.1.smithi174.stdout:1/690: mkdir d11/d1f/d27/d32/d84/df3 0 2024-05-06T14:04:19.400 INFO:tasks.workunit.client.1.smithi174.stdout:6/909: getdents d0/d25/d52/d2c/d105/d4b 0 2024-05-06T14:04:19.400 INFO:tasks.workunit.client.1.smithi174.stdout:1/691: unlink d11/d41/dc9/lde 0 2024-05-06T14:04:19.401 INFO:tasks.workunit.client.1.smithi174.stdout:4/905: mkdir d1/d9/d15/d74/d86/dc2/d143 0 2024-05-06T14:04:19.401 INFO:tasks.workunit.client.1.smithi174.stdout:6/910: rmdir d0/d25/d52/d2c/d105/da9/d11c 39 2024-05-06T14:04:19.401 INFO:tasks.workunit.client.1.smithi174.stdout:1/692: readlink d11/d41/dc9/d6c/l7e 0 2024-05-06T14:04:19.401 INFO:tasks.workunit.client.1.smithi174.stdout:1/693: mknod d11/d1f/d27/d32/d84/d8c/d94/db0/cf4 0 2024-05-06T14:04:19.401 INFO:tasks.workunit.client.1.smithi174.stdout:4/906: creat d1/f144 x:0 0 0 2024-05-06T14:04:19.401 INFO:tasks.workunit.client.1.smithi174.stdout:6/911: mknod d0/df/c12a 0 2024-05-06T14:04:19.401 INFO:tasks.workunit.client.1.smithi174.stdout:4/907: dread d1/d9/d15/d41/f49 [241664,49152] 0 2024-05-06T14:04:19.402 INFO:tasks.workunit.client.1.smithi174.stdout:1/694: symlink d11/d41/dc9/lf5 0 2024-05-06T14:04:19.402 INFO:tasks.workunit.client.1.smithi174.stdout:1/695: chown d11/d1f/d27/d2d/f52 112 1 2024-05-06T14:04:19.402 INFO:tasks.workunit.client.1.smithi174.stdout:1/696: link d11/d1f/d27/d32/d92/dbc/ff1 d11/d57/ff6 0 2024-05-06T14:04:19.402 INFO:tasks.workunit.client.1.smithi174.stdout:1/697: write d11/d57/d98/daf/db2/fb7 [150520,25052] 0 2024-05-06T14:04:19.402 INFO:tasks.workunit.client.1.smithi174.stdout:1/698: symlink d11/d41/d4a/d5e/lf7 0 2024-05-06T14:04:19.402 INFO:tasks.workunit.client.1.smithi174.stdout:1/699: getdents d11/d1f/d27 0 2024-05-06T14:04:19.402 INFO:tasks.workunit.client.1.smithi174.stdout:1/700: truncate d11/d1f/d27/f45 959192 0 2024-05-06T14:04:19.404 INFO:tasks.workunit.client.1.smithi174.stdout:4/908: dwrite d1/fc [1044480,118784] 0 2024-05-06T14:04:19.405 INFO:tasks.workunit.client.1.smithi174.stdout:4/909: write d1/d9/f22 [2668916,6394] 0 2024-05-06T14:04:19.405 INFO:tasks.workunit.client.1.smithi174.stdout:4/910: truncate d1/d48/d5a/d61/d68/dec/f123 39535 0 2024-05-06T14:04:19.405 INFO:tasks.workunit.client.1.smithi174.stdout:4/911: dread d1/d9/d15/d41/fe9 [1245184,20480] 0 2024-05-06T14:04:19.405 INFO:tasks.workunit.client.1.smithi174.stdout:4/912: stat d1/d48/d5a/d61/d68/l6c 0 2024-05-06T14:04:19.405 INFO:tasks.workunit.client.1.smithi174.stdout:4/913: read - d1/d1f/dd6/d6e/d10e/f133 zero size 2024-05-06T14:04:19.405 INFO:tasks.workunit.client.1.smithi174.stdout:4/914: dread d1/d2e/f40 [1376256,77824] 0 2024-05-06T14:04:19.405 INFO:tasks.workunit.client.1.smithi174.stdout:1/701: dwrite d11/d1f/d27/d32/d84/d8c/d94/db0/fe3 [622592,32768] 0 2024-05-06T14:04:19.405 INFO:tasks.workunit.client.1.smithi174.stdout:4/915: creat d1/d9/d15/d74/d86/f145 x:0 0 0 2024-05-06T14:04:19.406 INFO:tasks.workunit.client.1.smithi174.stdout:4/916: stat d1/d1f/dd6 0 2024-05-06T14:04:19.406 INFO:tasks.workunit.client.1.smithi174.stdout:1/702: dread d11/d57/f69 [532480,90112] 0 2024-05-06T14:04:19.406 INFO:tasks.workunit.client.1.smithi174.stdout:4/917: rename d1/d48/d5a/d5f/c94 to d1/d9/d15/d35/dd9/c146 0 2024-05-06T14:04:19.406 INFO:tasks.workunit.client.1.smithi174.stdout:4/918: dread - d1/d2e/f120 zero size 2024-05-06T14:04:19.406 INFO:tasks.workunit.client.1.smithi174.stdout:4/919: creat d1/d9/d15/d74/d86/dc2/f147 x:0 0 0 2024-05-06T14:04:19.406 INFO:tasks.workunit.client.1.smithi174.stdout:4/920: write d1/d48/d5a/d61/d68/dec/f11c [330520,98342] 0 2024-05-06T14:04:19.406 INFO:tasks.workunit.client.1.smithi174.stdout:4/921: chown d1/d9/d15/d92 5 1 2024-05-06T14:04:19.406 INFO:tasks.workunit.client.1.smithi174.stdout:4/922: rmdir d1/d1f/d27/d84/d122 0 2024-05-06T14:04:19.407 INFO:tasks.workunit.client.1.smithi174.stdout:4/923: creat d1/d9/d8d/f148 x:0 0 0 2024-05-06T14:04:19.407 INFO:tasks.workunit.client.1.smithi174.stdout:4/924: getdents d1/d9/d15/d41 0 2024-05-06T14:04:19.407 INFO:tasks.workunit.client.1.smithi174.stdout:4/925: chown d1/d48/d5a/d5f 49046670 1 2024-05-06T14:04:19.407 INFO:tasks.workunit.client.1.smithi174.stdout:4/926: write d1/d48/d5a/d5f/ffb [1545057,120846] 0 2024-05-06T14:04:19.474 INFO:tasks.workunit.client.1.smithi174.stdout:4/927: dwrite d1/d1f/d27/d84/f96 [176128,81920] 0 2024-05-06T14:04:19.474 INFO:tasks.workunit.client.1.smithi174.stdout:4/928: chown d1/d106/f109 0 1 2024-05-06T14:04:19.474 INFO:tasks.workunit.client.1.smithi174.stdout:4/929: truncate d1/d9/d15/d35/dd9/f107 791469 0 2024-05-06T14:04:19.474 INFO:tasks.workunit.client.1.smithi174.stdout:4/930: write d1/d9/d15/f21 [332148,72677] 0 2024-05-06T14:04:19.504 INFO:tasks.workunit.client.1.smithi174.stdout:7/605: fsync d0/d1d/da4/d61/d28/f4d 0 2024-05-06T14:04:19.504 INFO:tasks.workunit.client.1.smithi174.stdout:7/606: stat d0/d1d/da4/d61/d19/f5b 0 2024-05-06T14:04:19.504 INFO:tasks.workunit.client.1.smithi174.stdout:1/703: fdatasync d11/d57/fb4 0 2024-05-06T14:04:19.505 INFO:tasks.workunit.client.1.smithi174.stdout:1/704: unlink d11/d1f/l25 0 2024-05-06T14:04:19.505 INFO:tasks.workunit.client.1.smithi174.stdout:1/705: rename d11/d41/c4d to d11/d1f/d27/d32/d84/cf8 0 2024-05-06T14:04:19.505 INFO:tasks.workunit.client.1.smithi174.stdout:1/706: read d11/d1f/f89 [1038413,9890] 0 2024-05-06T14:04:19.505 INFO:tasks.workunit.client.1.smithi174.stdout:1/707: creat d11/d57/d98/ff9 x:0 0 0 2024-05-06T14:04:19.505 INFO:tasks.workunit.client.1.smithi174.stdout:1/708: read d11/f5a [20080,23233] 0 2024-05-06T14:04:19.507 INFO:tasks.workunit.client.1.smithi174.stdout:4/931: unlink d1/d48/d5a/d61/d68/dec/f123 0 2024-05-06T14:04:19.507 INFO:tasks.workunit.client.1.smithi174.stdout:4/932: getdents d1/d1f/dd6/d6e 0 2024-05-06T14:04:19.556 INFO:tasks.workunit.client.1.smithi174.stdout:7/607: fdatasync d0/d1d/da4/d61/d19/d24/d47/f7a 0 2024-05-06T14:04:19.562 INFO:tasks.workunit.client.1.smithi174.stdout:4/933: creat d1/d48/d5a/d137/f149 x:0 0 0 2024-05-06T14:04:19.562 INFO:tasks.workunit.client.1.smithi174.stdout:1/709: dwrite d11/d1f/d27/d32/d84/d8c/d94/db0/fe4 [200704,114688] 0 2024-05-06T14:04:19.562 INFO:tasks.workunit.client.1.smithi174.stdout:4/934: unlink d1/d1f/d27/d84/f96 0 2024-05-06T14:04:19.562 INFO:tasks.workunit.client.1.smithi174.stdout:1/710: creat d11/d1f/d27/d32/d84/ffa x:0 0 0 2024-05-06T14:04:19.562 INFO:tasks.workunit.client.1.smithi174.stdout:4/935: write d1/d9/d15/d74/d86/dc2/fff [2619,38006] 0 2024-05-06T14:04:19.563 INFO:tasks.workunit.client.1.smithi174.stdout:4/936: creat d1/d9/d15/d41/f14a x:0 0 0 2024-05-06T14:04:19.563 INFO:tasks.workunit.client.1.smithi174.stdout:4/937: creat d1/d1f/d27/d2c/d45/dc1/f14b x:0 0 0 2024-05-06T14:04:19.563 INFO:tasks.workunit.client.1.smithi174.stdout:7/608: dwrite d0/d1d/da4/d61/d19/f7d [1437696,69632] 0 2024-05-06T14:04:19.563 INFO:tasks.workunit.client.1.smithi174.stdout:7/609: dread d0/d1d/da4/d61/d28/d37/f60 [495616,69632] 0 2024-05-06T14:04:19.563 INFO:tasks.workunit.client.1.smithi174.stdout:7/610: symlink d0/d1d/da4/d61/d28/ld1 0 2024-05-06T14:04:19.632 INFO:tasks.workunit.client.1.smithi174.stdout:1/711: dwrite d11/d57/d98/ff9 [843776,36864] 0 2024-05-06T14:04:19.638 INFO:tasks.workunit.client.1.smithi174.stdout:9/648: sync 2024-05-06T14:04:19.638 INFO:tasks.workunit.client.1.smithi174.stdout:5/867: sync 2024-05-06T14:04:19.638 INFO:tasks.workunit.client.1.smithi174.stdout:2/662: sync 2024-05-06T14:04:19.639 INFO:tasks.workunit.client.1.smithi174.stdout:8/826: sync 2024-05-06T14:04:19.639 INFO:tasks.workunit.client.1.smithi174.stdout:2/663: readlink d0/d1/d2/d4/l39 0 2024-05-06T14:04:19.639 INFO:tasks.workunit.client.1.smithi174.stdout:9/649: mknod dc/d27/d51/da5/cdc 0 2024-05-06T14:04:19.639 INFO:tasks.workunit.client.1.smithi174.stdout:8/827: rename d4/de/d23/d3c/db2/da6/dad/d107 to d4/de/d24/d46/d63/db7/d112 0 2024-05-06T14:04:19.639 INFO:tasks.workunit.client.1.smithi174.stdout:9/650: creat dc/d27/d6d/dd7/fdd x:0 0 0 2024-05-06T14:04:19.639 INFO:tasks.workunit.client.1.smithi174.stdout:2/664: rename d0/d1/d2/d2a/f5c to d0/d1/d2/d4/d6/fcd 0 2024-05-06T14:04:19.639 INFO:tasks.workunit.client.1.smithi174.stdout:8/828: mknod d4/de/d23/d41/dce/c113 0 2024-05-06T14:04:19.639 INFO:tasks.workunit.client.1.smithi174.stdout:9/651: chown dc/de/f62 15881268 1 2024-05-06T14:04:19.639 INFO:tasks.workunit.client.1.smithi174.stdout:8/829: read d4/d15/d20/d3e/d79/fb1 [576627,26077] 0 2024-05-06T14:04:19.640 INFO:tasks.workunit.client.1.smithi174.stdout:8/830: chown d4/d48/cba 0 1 2024-05-06T14:04:19.640 INFO:tasks.workunit.client.1.smithi174.stdout:5/868: write d1/d6/df/d35/d81/d60/db0/d41/f10e [773496,88877] 0 2024-05-06T14:04:19.640 INFO:tasks.workunit.client.1.smithi174.stdout:8/831: unlink d4/de/d23/d3c/db2/da6/dad/de9/fea 0 2024-05-06T14:04:19.640 INFO:tasks.workunit.client.1.smithi174.stdout:8/832: write d4/f35 [1360106,47778] 0 2024-05-06T14:04:19.640 INFO:tasks.workunit.client.1.smithi174.stdout:8/833: creat d4/de/d24/d46/d63/db7/f114 x:0 0 0 2024-05-06T14:04:19.640 INFO:tasks.workunit.client.1.smithi174.stdout:8/834: rename d4/de/d24/d46/d63/db7/c106 to d4/d15/d64/dfd/c115 0 2024-05-06T14:04:19.640 INFO:tasks.workunit.client.1.smithi174.stdout:4/938: dwrite d1/d9/d15/dc7/fc9 [565248,4096] 0 2024-05-06T14:04:19.640 INFO:tasks.workunit.client.1.smithi174.stdout:4/939: creat d1/d48/d5a/d61/d140/f14c x:0 0 0 2024-05-06T14:04:19.640 INFO:tasks.workunit.client.1.smithi174.stdout:7/611: dwrite d0/d3a/f6a [2011136,114688] 0 2024-05-06T14:04:19.641 INFO:tasks.workunit.client.1.smithi174.stdout:7/612: link d0/fe d0/d1d/da4/d61/d19/d39/d90/da6/db6/fd2 0 2024-05-06T14:04:19.641 INFO:tasks.workunit.client.1.smithi174.stdout:7/613: readlink d0/d1d/da4/d61/d28/ld1 0 2024-05-06T14:04:19.641 INFO:tasks.workunit.client.1.smithi174.stdout:7/614: dread d0/d1d/da4/d61/d19/d24/f10 [2637824,65536] 0 2024-05-06T14:04:19.641 INFO:tasks.workunit.client.1.smithi174.stdout:7/615: mknod d0/d1d/da4/d61/d19/d24/d47/d70/d67/cd3 0 2024-05-06T14:04:19.641 INFO:tasks.workunit.client.1.smithi174.stdout:7/616: unlink d0/d1d/da4/d61/d28/d59/c36 0 2024-05-06T14:04:19.641 INFO:tasks.workunit.client.1.smithi174.stdout:1/712: dwrite d11/d1f/d27/d32/d84/ffa [524288,69632] 0 2024-05-06T14:04:19.641 INFO:tasks.workunit.client.1.smithi174.stdout:1/713: unlink d11/d1f/l46 0 2024-05-06T14:04:19.641 INFO:tasks.workunit.client.1.smithi174.stdout:1/714: chown d11/d1f/d27/d32/d92/fac 0 1 2024-05-06T14:04:19.642 INFO:tasks.workunit.client.1.smithi174.stdout:1/715: truncate d11/f24 524711 0 2024-05-06T14:04:19.642 INFO:tasks.workunit.client.1.smithi174.stdout:1/716: dread - d11/d1f/d27/d32/d84/ddc/fe6 zero size 2024-05-06T14:04:19.642 INFO:tasks.workunit.client.1.smithi174.stdout:1/717: unlink d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/ded/l6d 0 2024-05-06T14:04:19.705 INFO:tasks.workunit.client.1.smithi174.stdout:8/835: fdatasync d4/de/d23/d3c/fdb 0 2024-05-06T14:04:19.705 INFO:tasks.workunit.client.1.smithi174.stdout:4/940: fdatasync d1/d9/d15/d35/dd9/d6b/ddf/f114 0 2024-05-06T14:04:19.706 INFO:tasks.workunit.client.1.smithi174.stdout:4/941: rmdir d1/d1f 39 2024-05-06T14:04:19.706 INFO:tasks.workunit.client.1.smithi174.stdout:5/869: dwrite d1/d6/d7/d36/d53/d59/d61/d69/f118 [966656,49152] 0 2024-05-06T14:04:19.706 INFO:tasks.workunit.client.1.smithi174.stdout:5/870: unlink d1/d6/df/d35/d81/fd9 0 2024-05-06T14:04:19.706 INFO:tasks.workunit.client.1.smithi174.stdout:5/871: write d1/d6/d7/d36/d53/f98 [120982,23902] 0 2024-05-06T14:04:19.706 INFO:tasks.workunit.client.1.smithi174.stdout:5/872: chown d1/d6/df/d35/d81/f107 10706096 1 2024-05-06T14:04:19.706 INFO:tasks.workunit.client.1.smithi174.stdout:5/873: link d1/d6/d7/f44 d1/d6/d7/da1/dd8/f125 0 2024-05-06T14:04:19.706 INFO:tasks.workunit.client.1.smithi174.stdout:5/874: dread d1/d6/d7/da1/f88 [294912,49152] 0 2024-05-06T14:04:19.706 INFO:tasks.workunit.client.1.smithi174.stdout:5/875: mknod d1/d6/df/de2/c126 0 2024-05-06T14:04:19.707 INFO:tasks.workunit.client.1.smithi174.stdout:5/876: dread - d1/fdb zero size 2024-05-06T14:04:19.707 INFO:tasks.workunit.client.1.smithi174.stdout:5/877: link d1/d6/d7/d36/d53/fd5 d1/d6/df/d35/d81/daf/de5/f127 0 2024-05-06T14:04:19.707 INFO:tasks.workunit.client.1.smithi174.stdout:9/652: dwrite dc/f3d [73728,20480] 0 2024-05-06T14:04:19.707 INFO:tasks.workunit.client.1.smithi174.stdout:9/653: creat dc/d17/d3a/dcb/daf/fde x:0 0 0 2024-05-06T14:04:19.708 INFO:tasks.workunit.client.1.smithi174.stdout:2/665: dwrite d0/d1/d2/d4/d18/f64 [253952,77824] 0 2024-05-06T14:04:19.711 INFO:tasks.workunit.client.1.smithi174.stdout:7/617: dwrite d0/d1d/da4/d61/d19/d24/d47/f7a [24576,77824] 0 2024-05-06T14:04:19.711 INFO:tasks.workunit.client.1.smithi174.stdout:7/618: chown d0/d1d/da4/d61/d28/d37/f4e 317195801 1 2024-05-06T14:04:19.711 INFO:tasks.workunit.client.1.smithi174.stdout:7/619: rename d0/d1d/da4/d61/d19/d24/d14/d52/lcd to d0/d1d/da4/d61/d28/ld4 0 2024-05-06T14:04:19.711 INFO:tasks.workunit.client.1.smithi174.stdout:7/620: chown d0/d1d/da4/d61/d28/d37/lca 768153 1 2024-05-06T14:04:19.711 INFO:tasks.workunit.client.1.smithi174.stdout:7/621: dread - d0/d1d/da4/d61/fb9 zero size 2024-05-06T14:04:19.718 INFO:tasks.workunit.client.1.smithi174.stdout:1/718: dread d11/d41/f66 [778240,61440] 0 2024-05-06T14:04:19.788 INFO:tasks.workunit.client.1.smithi174.stdout:8/836: fdatasync d4/de/d23/d3c/db2/da6/fd9 0 2024-05-06T14:04:19.791 INFO:tasks.workunit.client.1.smithi174.stdout:4/942: dwrite d1/d1f/f62 [872448,69632] 0 2024-05-06T14:04:19.791 INFO:tasks.workunit.client.1.smithi174.stdout:9/654: dwrite dc/d17/d3a/dcb/f69 [692224,8192] 0 2024-05-06T14:04:19.791 INFO:tasks.workunit.client.1.smithi174.stdout:2/666: dwrite d0/db/d15/f6f [65536,4096] 0 2024-05-06T14:04:19.791 INFO:tasks.workunit.client.1.smithi174.stdout:8/837: symlink d4/de/d23/l116 0 2024-05-06T14:04:19.791 INFO:tasks.workunit.client.1.smithi174.stdout:9/655: write dc/d27/d63/f9a [838570,24597] 0 2024-05-06T14:04:19.791 INFO:tasks.workunit.client.1.smithi174.stdout:9/656: dread dc/f42 [507904,114688] 0 2024-05-06T14:04:19.791 INFO:tasks.workunit.client.1.smithi174.stdout:9/657: dread dc/d17/d3a/dcb/daf/fb5 [1638400,12288] 0 2024-05-06T14:04:19.806 INFO:tasks.workunit.client.1.smithi174.stdout:7/622: dread d0/f8e [65536,106496] 0 2024-05-06T14:04:19.806 INFO:tasks.workunit.client.1.smithi174.stdout:7/623: write d0/d1d/da4/d61/d28/d37/f60 [1218632,98393] 0 2024-05-06T14:04:19.831 INFO:tasks.workunit.client.1.smithi174.stdout:4/943: fsync d1/d2e/f6a 0 2024-05-06T14:04:19.831 INFO:tasks.workunit.client.1.smithi174.stdout:8/838: fsync d4/de/d23/fb9 0 2024-05-06T14:04:19.831 INFO:tasks.workunit.client.1.smithi174.stdout:4/944: write d1/d48/d5a/d61/fda [797619,124831] 0 2024-05-06T14:04:19.831 INFO:tasks.workunit.client.1.smithi174.stdout:4/945: creat d1/d9/d15/d41/f14d x:0 0 0 2024-05-06T14:04:19.837 INFO:tasks.workunit.client.1.smithi174.stdout:2/667: dwrite d0/da/d3f/d67/fb8 [28672,114688] 0 2024-05-06T14:04:19.837 INFO:tasks.workunit.client.1.smithi174.stdout:2/668: dread d0/d1/f5e [1372160,81920] 0 2024-05-06T14:04:19.837 INFO:tasks.workunit.client.1.smithi174.stdout:2/669: dread d0/d1/d2/d2a/f48 [1064960,65536] 0 2024-05-06T14:04:19.837 INFO:tasks.workunit.client.1.smithi174.stdout:2/670: creat d0/d24/d84/fce x:0 0 0 2024-05-06T14:04:19.837 INFO:tasks.workunit.client.1.smithi174.stdout:1/719: dwrite d11/d57/d98/daf/fa1 [487424,69632] 0 2024-05-06T14:04:19.838 INFO:tasks.workunit.client.1.smithi174.stdout:9/658: dwrite dc/d1c/f56 [1626112,114688] 0 2024-05-06T14:04:19.838 INFO:tasks.workunit.client.1.smithi174.stdout:9/659: chown dc/df/f5a 41811 1 2024-05-06T14:04:19.838 INFO:tasks.workunit.client.1.smithi174.stdout:9/660: read dc/f36 [592242,74404] 0 2024-05-06T14:04:19.838 INFO:tasks.workunit.client.1.smithi174.stdout:9/661: rmdir dc/d17/db8 39 2024-05-06T14:04:19.838 INFO:tasks.workunit.client.1.smithi174.stdout:9/662: mknod dc/d27/dc9/cdf 0 2024-05-06T14:04:19.838 INFO:tasks.workunit.client.1.smithi174.stdout:9/663: write dc/d1c/f5f [787846,116975] 0 2024-05-06T14:04:19.838 INFO:tasks.workunit.client.1.smithi174.stdout:4/946: mkdir d1/d1f/dd6/d6e/d14e 0 2024-05-06T14:04:19.839 INFO:tasks.workunit.client.1.smithi174.stdout:9/664: mkdir dc/d9b/de0 0 2024-05-06T14:04:19.839 INFO:tasks.workunit.client.1.smithi174.stdout:2/671: mkdir d0/da/dcf 0 2024-05-06T14:04:19.839 INFO:tasks.workunit.client.1.smithi174.stdout:4/947: dread - d1/d106/f109 zero size 2024-05-06T14:04:19.839 INFO:tasks.workunit.client.1.smithi174.stdout:4/948: truncate d1/f31 1130629 0 2024-05-06T14:04:19.839 INFO:tasks.workunit.client.1.smithi174.stdout:4/949: chown d1/d1f 55630471 1 2024-05-06T14:04:19.839 INFO:tasks.workunit.client.1.smithi174.stdout:4/950: readlink d1/d2e/l11f 0 2024-05-06T14:04:19.840 INFO:tasks.workunit.client.1.smithi174.stdout:4/951: dread d1/d1f/dd6/d6e/d50/f60 [1466368,20480] 0 2024-05-06T14:04:19.840 INFO:tasks.workunit.client.1.smithi174.stdout:4/952: readlink d1/d48/d5a/d61/la9 0 2024-05-06T14:04:19.840 INFO:tasks.workunit.client.1.smithi174.stdout:4/953: unlink d1/d9/f16 0 2024-05-06T14:04:19.840 INFO:tasks.workunit.client.1.smithi174.stdout:4/954: dread - d1/d48/d5a/d61/d140/f14c zero size 2024-05-06T14:04:19.840 INFO:tasks.workunit.client.1.smithi174.stdout:4/955: write d1/d9/d15/d98/f76 [998145,17634] 0 2024-05-06T14:04:19.840 INFO:tasks.workunit.client.1.smithi174.stdout:4/956: dread d1/d1f/dd6/d6e/d50/db0/ff7 [626688,81920] 0 2024-05-06T14:04:19.840 INFO:tasks.workunit.client.1.smithi174.stdout:4/957: creat d1/d1f/d27/d2c/f14f x:0 0 0 2024-05-06T14:04:19.841 INFO:tasks.workunit.client.1.smithi174.stdout:4/958: truncate d1/d1f/d27/d84/fd2 625523 0 2024-05-06T14:04:19.841 INFO:tasks.workunit.client.1.smithi174.stdout:8/839: dread d4/d15/fab [1388544,73728] 0 2024-05-06T14:04:19.851 INFO:tasks.workunit.client.1.smithi174.stdout:9/665: dread dc/d17/d3a/dcb/daf/d43/f4d [462848,81920] 0 2024-05-06T14:04:19.851 INFO:tasks.workunit.client.1.smithi174.stdout:9/666: write dc/de/f2e [4799969,68286] 0 2024-05-06T14:04:19.852 INFO:tasks.workunit.client.1.smithi174.stdout:9/667: rename dc/de/d6b/f8b to dc/d17/d3a/dcb/daf/d43/d8e/dd2/fe1 0 2024-05-06T14:04:19.852 INFO:tasks.workunit.client.1.smithi174.stdout:9/668: truncate dc/de/d81/da6/fd1 1033696 0 2024-05-06T14:04:19.852 INFO:tasks.workunit.client.1.smithi174.stdout:9/669: symlink dc/d17/d3a/db2/le2 0 2024-05-06T14:04:19.852 INFO:tasks.workunit.client.1.smithi174.stdout:9/670: dread dc/d1c/f38 [466944,94208] 0 2024-05-06T14:04:19.913 INFO:tasks.workunit.client.1.smithi174.stdout:4/959: fsync d1/d9/f10d 0 2024-05-06T14:04:19.913 INFO:tasks.workunit.client.1.smithi174.stdout:1/720: fdatasync d11/d57/fb4 0 2024-05-06T14:04:19.913 INFO:tasks.workunit.client.1.smithi174.stdout:1/721: rmdir d11/d1f/d27/d32 39 2024-05-06T14:04:19.913 INFO:tasks.workunit.client.1.smithi174.stdout:1/722: dread - d11/d41/dc9/fef zero size 2024-05-06T14:04:19.913 INFO:tasks.workunit.client.1.smithi174.stdout:4/960: link d1/d9/d15/d41/cd3 d1/d48/d5a/d61/d68/c150 0 2024-05-06T14:04:19.919 INFO:tasks.workunit.client.1.smithi174.stdout:9/671: dwrite dc/d1c/f56 [290816,12288] 0 2024-05-06T14:04:19.919 INFO:tasks.workunit.client.1.smithi174.stdout:1/723: creat d11/d57/d77/dea/ffb x:0 0 0 2024-05-06T14:04:19.919 INFO:tasks.workunit.client.1.smithi174.stdout:1/724: dread - d11/d1f/d27/d32/d84/d8c/d94/db0/fb9 zero size 2024-05-06T14:04:19.919 INFO:tasks.workunit.client.1.smithi174.stdout:4/961: mkdir d1/d151 0 2024-05-06T14:04:19.920 INFO:tasks.workunit.client.1.smithi174.stdout:1/725: chown d11/d1f/d27/d32/d84/d8c/d94/db0/cc7 26 1 2024-05-06T14:04:19.920 INFO:tasks.workunit.client.1.smithi174.stdout:9/672: rename dc/df/l5d to dc/d27/d6d/le3 0 2024-05-06T14:04:19.920 INFO:tasks.workunit.client.1.smithi174.stdout:4/962: truncate d1/d9/d15/d98/f51 518567 0 2024-05-06T14:04:19.920 INFO:tasks.workunit.client.1.smithi174.stdout:9/673: creat dc/d9b/dd4/fe4 x:0 0 0 2024-05-06T14:04:19.920 INFO:tasks.workunit.client.1.smithi174.stdout:4/963: creat d1/d1f/d89/f152 x:0 0 0 2024-05-06T14:04:19.920 INFO:tasks.workunit.client.1.smithi174.stdout:4/964: creat d1/d9/d15/f153 x:0 0 0 2024-05-06T14:04:19.992 INFO:tasks.workunit.client.1.smithi174.stdout:9/674: link dc/d17/d3a/dcb/daf/d43/d8e/lae dc/de/le5 0 2024-05-06T14:04:19.992 INFO:tasks.workunit.client.1.smithi174.stdout:9/675: link dc/d27/d6d/dd7/ldb dc/d27/d6d/dd7/le6 0 2024-05-06T14:04:19.993 INFO:tasks.workunit.client.1.smithi174.stdout:9/676: creat dc/d27/dc9/fe7 x:0 0 0 2024-05-06T14:04:19.993 INFO:tasks.workunit.client.1.smithi174.stdout:9/677: getdents dc/df 0 2024-05-06T14:04:19.993 INFO:tasks.workunit.client.1.smithi174.stdout:9/678: dread - dc/d17/d3a/dcb/f6a zero size 2024-05-06T14:04:19.993 INFO:tasks.workunit.client.1.smithi174.stdout:9/679: mkdir dc/df/de8 0 2024-05-06T14:04:19.993 INFO:tasks.workunit.client.1.smithi174.stdout:9/680: mknod dc/d27/d6d/dd7/ce9 0 2024-05-06T14:04:19.993 INFO:tasks.workunit.client.1.smithi174.stdout:9/681: write dc/f4e [426937,66176] 0 2024-05-06T14:04:19.993 INFO:tasks.workunit.client.1.smithi174.stdout:9/682: creat dc/d17/fea x:0 0 0 2024-05-06T14:04:20.031 INFO:tasks.workunit.client.1.smithi174.stdout:3/670: sync 2024-05-06T14:04:20.032 INFO:tasks.workunit.client.1.smithi174.stdout:6/912: sync 2024-05-06T14:04:20.032 INFO:tasks.workunit.client.1.smithi174.stdout:5/878: sync 2024-05-06T14:04:20.032 INFO:tasks.workunit.client.1.smithi174.stdout:0/716: sync 2024-05-06T14:04:20.032 INFO:tasks.workunit.client.1.smithi174.stdout:6/913: chown d0/d25/d52/d2c/d5f/c77 249 1 2024-05-06T14:04:20.032 INFO:tasks.workunit.client.1.smithi174.stdout:5/879: getdents d1/d6/df/d35/d81 0 2024-05-06T14:04:20.034 INFO:tasks.workunit.client.1.smithi174.stdout:0/717: mknod d0/d16/cee 0 2024-05-06T14:04:20.034 INFO:tasks.workunit.client.1.smithi174.stdout:3/671: unlink df/d10/l34 0 2024-05-06T14:04:20.034 INFO:tasks.workunit.client.1.smithi174.stdout:5/880: mkdir d1/d6/df/d35/d8b/d9f/df8/d128 0 2024-05-06T14:04:20.034 INFO:tasks.workunit.client.1.smithi174.stdout:0/718: creat d0/d4/d80/d93/fef x:0 0 0 2024-05-06T14:04:20.034 INFO:tasks.workunit.client.1.smithi174.stdout:6/914: mkdir d0/d25/d52/d80/d10f/d12b 0 2024-05-06T14:04:20.034 INFO:tasks.workunit.client.1.smithi174.stdout:6/915: chown d0/d25/d52/d2c/d105/ca0 37 1 2024-05-06T14:04:20.035 INFO:tasks.workunit.client.1.smithi174.stdout:5/881: mkdir d1/d6/df/d35/d129 0 2024-05-06T14:04:20.035 INFO:tasks.workunit.client.1.smithi174.stdout:5/882: mkdir d1/d6/df/d35/d8b/d12a 0 2024-05-06T14:04:20.035 INFO:tasks.workunit.client.1.smithi174.stdout:6/916: write d0/d25/d52/d4c/fab [2131181,41585] 0 2024-05-06T14:04:20.035 INFO:tasks.workunit.client.1.smithi174.stdout:5/883: unlink d1/d6/df/d35/d81/d60/d82/ff5 0 2024-05-06T14:04:20.035 INFO:tasks.workunit.client.1.smithi174.stdout:6/917: read - d0/d25/d52/d2c/f6a zero size 2024-05-06T14:04:20.035 INFO:tasks.workunit.client.1.smithi174.stdout:5/884: stat d1/d6/df/d35/d81/d60/db0/de/dbd/df1/l122 0 2024-05-06T14:04:20.035 INFO:tasks.workunit.client.1.smithi174.stdout:5/885: write d1/d6/d7/d36/d53/d59/d61/d69/f91 [3538,18477] 0 2024-05-06T14:04:20.117 INFO:tasks.workunit.client.1.smithi174.stdout:6/918: dwrite d0/d93/fe2 [724992,8192] 0 2024-05-06T14:04:20.117 INFO:tasks.workunit.client.1.smithi174.stdout:0/719: dwrite d0/d1a/d17/f2a [856064,32768] 0 2024-05-06T14:04:20.117 INFO:tasks.workunit.client.1.smithi174.stdout:0/720: mknod d0/d4/d8/dce/cf0 0 2024-05-06T14:04:20.140 INFO:tasks.workunit.client.1.smithi174.stdout:5/886: fdatasync d1/d6/d7/d36/d53/fd5 0 2024-05-06T14:04:20.140 INFO:tasks.workunit.client.1.smithi174.stdout:5/887: symlink d1/d6/d7/da1/d9a/l12b 0 2024-05-06T14:04:20.141 INFO:tasks.workunit.client.1.smithi174.stdout:9/683: fdatasync dc/d1c/f5f 0 2024-05-06T14:04:20.141 INFO:tasks.workunit.client.1.smithi174.stdout:5/888: chown d1/d6/d7/da1/dd8/de7/c114 328 1 2024-05-06T14:04:20.141 INFO:tasks.workunit.client.1.smithi174.stdout:5/889: dread - d1/d6/d7/f87 zero size 2024-05-06T14:04:20.141 INFO:tasks.workunit.client.1.smithi174.stdout:5/890: dread d1/d6/df/d35/d81/d1e/fe1 [241664,90112] 0 2024-05-06T14:04:20.141 INFO:tasks.workunit.client.1.smithi174.stdout:5/891: creat d1/d6/f12c x:0 0 0 2024-05-06T14:04:20.141 INFO:tasks.workunit.client.1.smithi174.stdout:0/721: fdatasync d0/d16/f8f 0 2024-05-06T14:04:20.141 INFO:tasks.workunit.client.1.smithi174.stdout:0/722: chown d0/d1a/d17/fd0 1 1 2024-05-06T14:04:20.141 INFO:tasks.workunit.client.1.smithi174.stdout:0/723: dread d0/d36/d45/f89 [118784,90112] 0 2024-05-06T14:04:20.141 INFO:tasks.workunit.client.1.smithi174.stdout:9/684: fsync dc/d27/f2a 0 2024-05-06T14:04:20.142 INFO:tasks.workunit.client.1.smithi174.stdout:9/685: read dc/d17/d4c/f72 [256667,99958] 0 2024-05-06T14:04:20.144 INFO:tasks.workunit.client.1.smithi174.stdout:6/919: dwrite d0/d25/d52/d2c/f120 [397312,102400] 0 2024-05-06T14:04:20.144 INFO:tasks.workunit.client.1.smithi174.stdout:0/724: truncate d0/d4/d8/d25/fd4 204236 0 2024-05-06T14:04:20.144 INFO:tasks.workunit.client.1.smithi174.stdout:5/892: symlink d1/d6/df/d35/d81/d60/l12d 0 2024-05-06T14:04:20.144 INFO:tasks.workunit.client.1.smithi174.stdout:5/893: dread - d1/ddf/f11f zero size 2024-05-06T14:04:20.144 INFO:tasks.workunit.client.1.smithi174.stdout:6/920: mknod d0/d25/d52/d2c/d76/c12c 0 2024-05-06T14:04:20.144 INFO:tasks.workunit.client.1.smithi174.stdout:0/725: symlink d0/d4/d8/d25/d5c/d4a/lf1 0 2024-05-06T14:04:20.144 INFO:tasks.workunit.client.1.smithi174.stdout:0/726: mknod d0/d4/d8/d25/d5c/d44/dd5/d38/dcd/cf2 0 2024-05-06T14:04:20.144 INFO:tasks.workunit.client.1.smithi174.stdout:0/727: write d0/d3/f40 [332066,24509] 0 2024-05-06T14:04:20.145 INFO:tasks.workunit.client.1.smithi174.stdout:0/728: chown d0/d4/d8/d25/d5c/fc2 48854675 1 2024-05-06T14:04:20.145 INFO:tasks.workunit.client.1.smithi174.stdout:0/729: mknod d0/d4/d8/d25/d5c/cf3 0 2024-05-06T14:04:20.145 INFO:tasks.workunit.client.1.smithi174.stdout:0/730: creat d0/d4/d8/d25/d5c/d44/ff4 x:0 0 0 2024-05-06T14:04:20.145 INFO:tasks.workunit.client.1.smithi174.stdout:0/731: mknod d0/d1a/cf5 0 2024-05-06T14:04:20.145 INFO:tasks.workunit.client.1.smithi174.stdout:0/732: write d0/d4/d8/d25/f6f [3008262,129128] 0 2024-05-06T14:04:20.145 INFO:tasks.workunit.client.1.smithi174.stdout:0/733: dread d0/d4/d80/d93/f97 [487424,98304] 0 2024-05-06T14:04:20.145 INFO:tasks.workunit.client.1.smithi174.stdout:0/734: creat d0/d1a/d17/d2e/d58/ff6 x:0 0 0 2024-05-06T14:04:20.146 INFO:tasks.workunit.client.1.smithi174.stdout:9/686: dwrite dc/d27/d63/f9a [749568,98304] 0 2024-05-06T14:04:20.146 INFO:tasks.workunit.client.1.smithi174.stdout:9/687: dread - dc/d17/d3a/db2/fbc zero size 2024-05-06T14:04:20.146 INFO:tasks.workunit.client.1.smithi174.stdout:9/688: creat dc/d1c/feb x:0 0 0 2024-05-06T14:04:20.177 INFO:tasks.workunit.client.1.smithi174.stdout:0/735: dwrite d0/d36/d45/fc5 [147456,73728] 0 2024-05-06T14:04:20.178 INFO:tasks.workunit.client.1.smithi174.stdout:0/736: creat d0/d36/d3f/d7a/ff7 x:0 0 0 2024-05-06T14:04:20.179 INFO:tasks.workunit.client.1.smithi174.stdout:5/894: dwrite d1/d6/f13 [3489792,102400] 0 2024-05-06T14:04:20.179 INFO:tasks.workunit.client.1.smithi174.stdout:5/895: symlink d1/d6/df/d35/d81/l12e 0 2024-05-06T14:04:20.179 INFO:tasks.workunit.client.1.smithi174.stdout:9/689: dwrite dc/d1c/f38 [282624,8192] 0 2024-05-06T14:04:20.179 INFO:tasks.workunit.client.1.smithi174.stdout:5/896: creat d1/d6/d7/da1/dfc/f12f x:0 0 0 2024-05-06T14:04:20.179 INFO:tasks.workunit.client.1.smithi174.stdout:5/897: unlink d1/d6/d7/d36/d53/d59/f7a 0 2024-05-06T14:04:20.180 INFO:tasks.workunit.client.1.smithi174.stdout:9/690: creat dc/d27/d6d/dd7/fec x:0 0 0 2024-05-06T14:04:20.180 INFO:tasks.workunit.client.1.smithi174.stdout:0/737: dwrite d0/d4/d80/f99 [204800,57344] 0 2024-05-06T14:04:20.180 INFO:tasks.workunit.client.1.smithi174.stdout:0/738: chown d0/d3/f8d 9757 1 2024-05-06T14:04:20.180 INFO:tasks.workunit.client.1.smithi174.stdout:0/739: symlink d0/d4/d8/lf8 0 2024-05-06T14:04:20.199 INFO:tasks.workunit.client.1.smithi174.stdout:6/921: fsync d0/d93/f100 0 2024-05-06T14:04:20.199 INFO:tasks.workunit.client.1.smithi174.stdout:6/922: chown d0/d25/d52/d2c/d105/d85/ddf/f10c 53324 1 2024-05-06T14:04:20.199 INFO:tasks.workunit.client.1.smithi174.stdout:6/923: rmdir d0/d25/d35/de3 39 2024-05-06T14:04:20.200 INFO:tasks.workunit.client.1.smithi174.stdout:6/924: write d0/d25/d52/d2c/d105/d85/fb2 [1211195,69041] 0 2024-05-06T14:04:20.202 INFO:tasks.workunit.client.1.smithi174.stdout:5/898: dwrite d1/d6/df/f30 [1150976,77824] 0 2024-05-06T14:04:20.202 INFO:tasks.workunit.client.1.smithi174.stdout:5/899: link d1/d6/df/ce9 d1/d6/d7/da1/dfc/c130 0 2024-05-06T14:04:20.202 INFO:tasks.workunit.client.1.smithi174.stdout:5/900: dread d1/d6/d7/d36/f7f [212992,126976] 0 2024-05-06T14:04:20.204 INFO:tasks.workunit.client.1.smithi174.stdout:5/901: dread d1/d6/df/d35/d81/daf/feb [98304,122880] 0 2024-05-06T14:04:20.280 INFO:tasks.workunit.client.1.smithi174.stdout:0/740: fsync d0/d4/d8/d25/d5c/d44/f91 0 2024-05-06T14:04:20.287 INFO:tasks.workunit.client.1.smithi174.stdout:7/624: sync 2024-05-06T14:04:20.287 INFO:tasks.workunit.client.1.smithi174.stdout:8/840: sync 2024-05-06T14:04:20.287 INFO:tasks.workunit.client.1.smithi174.stdout:2/672: sync 2024-05-06T14:04:20.287 INFO:tasks.workunit.client.1.smithi174.stdout:7/625: link d0/d1d/da4/d61/d19/d39/f8b d0/d1d/da4/d61/d28/d59/da1/dcf/fd5 0 2024-05-06T14:04:20.287 INFO:tasks.workunit.client.1.smithi174.stdout:1/726: sync 2024-05-06T14:04:20.287 INFO:tasks.workunit.client.1.smithi174.stdout:4/965: sync 2024-05-06T14:04:20.288 INFO:tasks.workunit.client.1.smithi174.stdout:3/672: sync 2024-05-06T14:04:20.288 INFO:tasks.workunit.client.1.smithi174.stdout:7/626: write d0/d3a/f6a [1335538,93469] 0 2024-05-06T14:04:20.288 INFO:tasks.workunit.client.1.smithi174.stdout:7/627: dread - d0/d3a/fc4 zero size 2024-05-06T14:04:20.288 INFO:tasks.workunit.client.1.smithi174.stdout:7/628: write d0/d1d/da4/d61/d28/d37/f4e [394222,10591] 0 2024-05-06T14:04:20.288 INFO:tasks.workunit.client.1.smithi174.stdout:6/925: dwrite d0/fc4 [131072,69632] 0 2024-05-06T14:04:20.288 INFO:tasks.workunit.client.1.smithi174.stdout:2/673: truncate d0/da/f3b 298067 0 2024-05-06T14:04:20.337 INFO:tasks.workunit.client.1.smithi174.stdout:3/673: fdatasync df/d10/d1b/d7e/f51 0 2024-05-06T14:04:20.337 INFO:tasks.workunit.client.1.smithi174.stdout:3/674: getdents df/d10/da2 0 2024-05-06T14:04:20.340 INFO:tasks.workunit.client.1.smithi174.stdout:4/966: mknod d1/d48/d5a/d61/d140/c154 0 2024-05-06T14:04:20.340 INFO:tasks.workunit.client.1.smithi174.stdout:0/741: mknod d0/d36/d3f/d7a/cf9 0 2024-05-06T14:04:20.340 INFO:tasks.workunit.client.1.smithi174.stdout:7/629: creat d0/d1d/da4/d61/d19/d39/d90/da6/db6/fd6 x:0 0 0 2024-05-06T14:04:20.340 INFO:tasks.workunit.client.1.smithi174.stdout:0/742: readlink d0/d4/d8/l49 0 2024-05-06T14:04:20.340 INFO:tasks.workunit.client.1.smithi174.stdout:6/926: mknod d0/d25/d52/d2c/d105/d85/ddf/c12d 0 2024-05-06T14:04:20.340 INFO:tasks.workunit.client.1.smithi174.stdout:8/841: mkdir d4/de/d24/d46/d63/d117 0 2024-05-06T14:04:20.341 INFO:tasks.workunit.client.1.smithi174.stdout:8/842: truncate d4/d15/d20/d3e/d79/d94/fff 880127 0 2024-05-06T14:04:20.341 INFO:tasks.workunit.client.1.smithi174.stdout:0/743: rename d0/d4/d8/d25/d5c/c1d to d0/d4/d8/d25/d5c/d44/dd5/cfa 0 2024-05-06T14:04:20.341 INFO:tasks.workunit.client.1.smithi174.stdout:2/674: creat d0/da/d3f/da6/fd0 x:0 0 0 2024-05-06T14:04:20.341 INFO:tasks.workunit.client.1.smithi174.stdout:8/843: readlink d4/de/d24/d5e/d85/lbd 0 2024-05-06T14:04:20.341 INFO:tasks.workunit.client.1.smithi174.stdout:7/630: mkdir d0/d3a/dd7 0 2024-05-06T14:04:20.342 INFO:tasks.workunit.client.1.smithi174.stdout:4/967: mkdir d1/d9/d15/d74/d86/dc2/d143/d155 0 2024-05-06T14:04:20.342 INFO:tasks.workunit.client.1.smithi174.stdout:2/675: chown d0/d16/f85 30307772 1 2024-05-06T14:04:20.342 INFO:tasks.workunit.client.1.smithi174.stdout:3/675: symlink df/d2d/d4e/db6/db9/ld6 0 2024-05-06T14:04:20.342 INFO:tasks.workunit.client.1.smithi174.stdout:2/676: readlink d0/d1/d2/ld 0 2024-05-06T14:04:20.342 INFO:tasks.workunit.client.1.smithi174.stdout:4/968: getdents d1/d9/d15/d92 0 2024-05-06T14:04:20.342 INFO:tasks.workunit.client.1.smithi174.stdout:0/744: mkdir d0/d4/d80/dfb 0 2024-05-06T14:04:20.342 INFO:tasks.workunit.client.1.smithi174.stdout:3/676: link df/d10/d1b/d7e/d57/f95 df/d2d/d4d/da5/fd7 0 2024-05-06T14:04:20.343 INFO:tasks.workunit.client.1.smithi174.stdout:4/969: unlink d1/d9/d15/d35/fa5 0 2024-05-06T14:04:20.343 INFO:tasks.workunit.client.1.smithi174.stdout:2/677: dread d0/d24/d77/d93/f9c [1277952,81920] 0 2024-05-06T14:04:20.343 INFO:tasks.workunit.client.1.smithi174.stdout:3/677: dread - df/d10/d1b/d7e/d5a/f6a zero size 2024-05-06T14:04:20.343 INFO:tasks.workunit.client.1.smithi174.stdout:7/631: truncate d0/d1d/da4/d61/d19/d39/d46/f57 810053 0 2024-05-06T14:04:20.343 INFO:tasks.workunit.client.1.smithi174.stdout:1/727: creat d11/d57/d98/daf/db2/ffc x:0 0 0 2024-05-06T14:04:20.343 INFO:tasks.workunit.client.1.smithi174.stdout:1/728: rmdir d11/d57/d98/daf 39 2024-05-06T14:04:20.343 INFO:tasks.workunit.client.1.smithi174.stdout:7/632: chown d0/d1d/da4/d61/d28/d59/da1/faf 126 1 2024-05-06T14:04:20.344 INFO:tasks.workunit.client.1.smithi174.stdout:3/678: mknod df/d2d/d84/cd8 0 2024-05-06T14:04:20.344 INFO:tasks.workunit.client.1.smithi174.stdout:7/633: creat d0/d3a/fd8 x:0 0 0 2024-05-06T14:04:20.344 INFO:tasks.workunit.client.1.smithi174.stdout:1/729: truncate d11/f24 514043 0 2024-05-06T14:04:20.344 INFO:tasks.workunit.client.1.smithi174.stdout:3/679: readlink df/d2d/d4e/lb2 0 2024-05-06T14:04:20.344 INFO:tasks.workunit.client.1.smithi174.stdout:1/730: readlink l2 0 2024-05-06T14:04:20.344 INFO:tasks.workunit.client.1.smithi174.stdout:2/678: mkdir d0/d1/d2/d4/d18/d2d/dd1 0 2024-05-06T14:04:20.344 INFO:tasks.workunit.client.1.smithi174.stdout:2/679: write d0/d1/f35 [1954286,62255] 0 2024-05-06T14:04:20.344 INFO:tasks.workunit.client.1.smithi174.stdout:2/680: symlink d0/d24/d84/ld2 0 2024-05-06T14:04:20.345 INFO:tasks.workunit.client.1.smithi174.stdout:2/681: write d0/d1/d2/d2a/f48 [2684289,10942] 0 2024-05-06T14:04:20.345 INFO:tasks.workunit.client.1.smithi174.stdout:5/902: dwrite d1/d6/d7/f119 [974848,4096] 0 2024-05-06T14:04:20.345 INFO:tasks.workunit.client.1.smithi174.stdout:5/903: creat d1/d6/df/d35/d81/d60/db0/de/dbd/de0/f131 x:0 0 0 2024-05-06T14:04:20.345 INFO:tasks.workunit.client.1.smithi174.stdout:5/904: dread d1/d6/f34 [28672,4096] 0 2024-05-06T14:04:20.345 INFO:tasks.workunit.client.1.smithi174.stdout:5/905: rename d1/d6/df/d35/d81/d60/db0/de/c6d to d1/d6/df/d35/d81/d60/db0/de/dbd/df1/c132 0 2024-05-06T14:04:20.345 INFO:tasks.workunit.client.1.smithi174.stdout:5/906: write d1/d6/d7/da1/fb8 [349997,79018] 0 2024-05-06T14:04:20.345 INFO:tasks.workunit.client.1.smithi174.stdout:5/907: symlink d1/d6/df/d35/d81/d60/db0/de/dbd/de0/l133 0 2024-05-06T14:04:20.350 INFO:tasks.workunit.client.1.smithi174.stdout:6/927: dwrite d0/d25/d52/d2c/fa8 [995328,65536] 0 2024-05-06T14:04:20.350 INFO:tasks.workunit.client.1.smithi174.stdout:6/928: mknod d0/d25/d52/d4c/c12e 0 2024-05-06T14:04:20.351 INFO:tasks.workunit.client.1.smithi174.stdout:8/844: dwrite d4/d48/f5c [356352,45056] 0 2024-05-06T14:04:20.351 INFO:tasks.workunit.client.1.smithi174.stdout:8/845: read d4/d15/d20/d3e/d79/f7d [502524,62994] 0 2024-05-06T14:04:20.351 INFO:tasks.workunit.client.1.smithi174.stdout:8/846: creat d4/d15/d20/d3e/d79/dbf/f118 x:0 0 0 2024-05-06T14:04:20.351 INFO:tasks.workunit.client.1.smithi174.stdout:8/847: mknod d4/d15/d66/c119 0 2024-05-06T14:04:20.351 INFO:tasks.workunit.client.1.smithi174.stdout:8/848: chown d4/de/l7b 617 1 2024-05-06T14:04:20.351 INFO:tasks.workunit.client.1.smithi174.stdout:8/849: truncate d4/de/d23/d3c/f7f 1921487 0 2024-05-06T14:04:20.352 INFO:tasks.workunit.client.1.smithi174.stdout:8/850: dread d4/d15/d20/d3e/d79/fcf [671744,106496] 0 2024-05-06T14:04:20.352 INFO:tasks.workunit.client.1.smithi174.stdout:8/851: chown d4/de/d23/d41/d56/f110 7 1 2024-05-06T14:04:20.352 INFO:tasks.workunit.client.1.smithi174.stdout:4/970: dwrite d1/d9/d15/f6d [2486272,65536] 0 2024-05-06T14:04:20.352 INFO:tasks.workunit.client.1.smithi174.stdout:8/852: truncate d4/d15/f30 232642 0 2024-05-06T14:04:20.352 INFO:tasks.workunit.client.1.smithi174.stdout:8/853: mkdir d4/de/d23/d41/d56/dc0/d11a 0 2024-05-06T14:04:20.352 INFO:tasks.workunit.client.1.smithi174.stdout:8/854: truncate d4/d15/fab 731961 0 2024-05-06T14:04:20.353 INFO:tasks.workunit.client.1.smithi174.stdout:8/855: chown d4/de/d24/d46/d63/c8d 90 1 2024-05-06T14:04:20.353 INFO:tasks.workunit.client.1.smithi174.stdout:8/856: chown d4/d15/d20/d3e/d79/f7d 113 1 2024-05-06T14:04:20.353 INFO:tasks.workunit.client.1.smithi174.stdout:8/857: symlink d4/d15/d66/l11b 0 2024-05-06T14:04:20.353 INFO:tasks.workunit.client.1.smithi174.stdout:0/745: dwrite d0/d4/d8/d25/d5c/d44/f46 [262144,57344] 0 2024-05-06T14:04:20.353 INFO:tasks.workunit.client.1.smithi174.stdout:0/746: rename d0/d1a/d17/d2e/d58 to d0/d3/dfc 0 2024-05-06T14:04:20.353 INFO:tasks.workunit.client.1.smithi174.stdout:0/747: stat d0/d4/d8/d25/d5c/d44/dd5/c6d 0 2024-05-06T14:04:20.353 INFO:tasks.workunit.client.1.smithi174.stdout:0/748: link d0/f68 d0/d1a/d17/ffd 0 2024-05-06T14:04:20.354 INFO:tasks.workunit.client.1.smithi174.stdout:0/749: link d0/d4/d8/d25/d5c/d44/l50 d0/d36/d45/lfe 0 2024-05-06T14:04:20.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/731: dwrite d11/d1f/d27/d2d/fa6 [507904,102400] 0 2024-05-06T14:04:20.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/732: mkdir d11/d1f/d27/dfd 0 2024-05-06T14:04:20.354 INFO:tasks.workunit.client.1.smithi174.stdout:1/733: stat d11/d1f/f89 0 2024-05-06T14:04:20.354 INFO:tasks.workunit.client.1.smithi174.stdout:5/908: dwrite d1/d6/d7/d36/d53/ffb [913408,114688] 0 2024-05-06T14:04:20.354 INFO:tasks.workunit.client.1.smithi174.stdout:5/909: mkdir d1/d6/d7/d36/d53/d59/d61/d69/dc3/d134 0 2024-05-06T14:04:20.354 INFO:tasks.workunit.client.1.smithi174.stdout:5/910: getdents d1/d6/d7/da1/d9a 0 2024-05-06T14:04:20.355 INFO:tasks.workunit.client.1.smithi174.stdout:5/911: creat d1/d6/df/d35/d81/d60/f135 x:0 0 0 2024-05-06T14:04:20.355 INFO:tasks.workunit.client.1.smithi174.stdout:5/912: mkdir d1/ddf/d136 0 2024-05-06T14:04:20.355 INFO:tasks.workunit.client.1.smithi174.stdout:5/913: write d1/d6/d7/f87 [79265,54994] 0 2024-05-06T14:04:20.355 INFO:tasks.workunit.client.1.smithi174.stdout:5/914: stat d1/d6/d7/d3e 0 2024-05-06T14:04:20.355 INFO:tasks.workunit.client.1.smithi174.stdout:5/915: write d1/d6/df/d35/f3d [570219,74743] 0 2024-05-06T14:04:20.356 INFO:tasks.workunit.client.1.smithi174.stdout:5/916: read d1/d6/fa2 [476941,25305] 0 2024-05-06T14:04:20.356 INFO:tasks.workunit.client.1.smithi174.stdout:5/917: stat d1/d6/d7/d3e 0 2024-05-06T14:04:20.356 INFO:tasks.workunit.client.1.smithi174.stdout:7/634: dread d0/d1d/da4/d61/d19/d24/d47/f7a [524288,94208] 0 2024-05-06T14:04:20.356 INFO:tasks.workunit.client.1.smithi174.stdout:7/635: readlink d0/d1d/da4/d61/lac 0 2024-05-06T14:04:20.356 INFO:tasks.workunit.client.1.smithi174.stdout:7/636: chown d0/d1d/da4/d61/d19/f5b 2861 1 2024-05-06T14:04:20.356 INFO:tasks.workunit.client.1.smithi174.stdout:7/637: creat d0/d1d/da4/d61/d19/d24/fd9 x:0 0 0 2024-05-06T14:04:20.356 INFO:tasks.workunit.client.1.smithi174.stdout:7/638: mkdir d0/d1d/d9c/dad/dda 0 2024-05-06T14:04:20.357 INFO:tasks.workunit.client.1.smithi174.stdout:7/639: chown d0/d1d/da4/d61/d19/d24/d47/fbd 623837432 1 2024-05-06T14:04:20.357 INFO:tasks.workunit.client.1.smithi174.stdout:7/640: mkdir d0/d1d/da4/d61/d28/db1/dc8/ddb 0 2024-05-06T14:04:20.357 INFO:tasks.workunit.client.1.smithi174.stdout:7/641: dread d0/d1d/da4/d61/f38 [1634304,8192] 0 2024-05-06T14:04:20.357 INFO:tasks.workunit.client.1.smithi174.stdout:7/642: creat d0/d1d/da4/d61/d19/d39/d90/fdc x:0 0 0 2024-05-06T14:04:20.358 INFO:tasks.workunit.client.1.smithi174.stdout:2/682: dread d0/d1/d2/d4/d6/f7a [1744896,49152] 0 2024-05-06T14:04:20.358 INFO:tasks.workunit.client.1.smithi174.stdout:2/683: read - d0/d24/fa7 zero size 2024-05-06T14:04:20.417 INFO:tasks.workunit.client.1.smithi174.stdout:9/691: sync 2024-05-06T14:04:20.420 INFO:tasks.workunit.client.1.smithi174.stdout:8/858: dwrite d4/de/fa3 [1130496,98304] 0 2024-05-06T14:04:20.420 INFO:tasks.workunit.client.1.smithi174.stdout:9/692: dread dc/d27/f77 [819200,20480] 0 2024-05-06T14:04:20.420 INFO:tasks.workunit.client.1.smithi174.stdout:0/750: dwrite d0/d1a/d17/f9e [1101824,61440] 0 2024-05-06T14:04:20.420 INFO:tasks.workunit.client.1.smithi174.stdout:4/971: dwrite d1/d48/d5a/d61/d68/dec/f11c [278528,45056] 0 2024-05-06T14:04:20.421 INFO:tasks.workunit.client.1.smithi174.stdout:4/972: mknod d1/d9/d15/dc7/c156 0 2024-05-06T14:04:20.421 INFO:tasks.workunit.client.1.smithi174.stdout:0/751: creat d0/d4/d8/d25/d5c/d4a/da7/de0/fff x:0 0 0 2024-05-06T14:04:20.421 INFO:tasks.workunit.client.1.smithi174.stdout:4/973: truncate d1/d9/f23 1662714 0 2024-05-06T14:04:20.421 INFO:tasks.workunit.client.1.smithi174.stdout:0/752: creat d0/d4/d8/d25/d5c/d44/f100 x:0 0 0 2024-05-06T14:04:20.421 INFO:tasks.workunit.client.1.smithi174.stdout:9/693: write dc/d17/d3a/db2/fc6 [858011,85899] 0 2024-05-06T14:04:20.421 INFO:tasks.workunit.client.1.smithi174.stdout:9/694: dread dc/de/f4f [73728,57344] 0 2024-05-06T14:04:20.422 INFO:tasks.workunit.client.1.smithi174.stdout:4/974: write d1/d1f/dd6/d6e/d50/f60 [3602281,18763] 0 2024-05-06T14:04:20.422 INFO:tasks.workunit.client.1.smithi174.stdout:0/753: symlink d0/d4/d8/d25/d5c/d44/dd5/d38/l101 0 2024-05-06T14:04:20.422 INFO:tasks.workunit.client.1.smithi174.stdout:4/975: mknod d1/d1f/d27/c157 0 2024-05-06T14:04:20.422 INFO:tasks.workunit.client.1.smithi174.stdout:4/976: truncate d1/d1f/dd6/d6e/d10e/f133 928838 0 2024-05-06T14:04:20.427 INFO:tasks.workunit.client.1.smithi174.stdout:5/918: dread d1/d6/df/d35/d81/d1e/fe1 [729088,94208] 0 2024-05-06T14:04:20.427 INFO:tasks.workunit.client.1.smithi174.stdout:5/919: write d1/d6/d7/d3e/d4c/fbe [1341832,6928] 0 2024-05-06T14:04:20.530 INFO:tasks.workunit.client.1.smithi174.stdout:8/859: fsync d4/d15/d20/f44 0 2024-05-06T14:04:20.531 INFO:tasks.workunit.client.1.smithi174.stdout:8/860: dread d4/de/d23/d41/d56/f71 [589824,16384] 0 2024-05-06T14:04:20.531 INFO:tasks.workunit.client.1.smithi174.stdout:8/861: creat d4/de/d23/f11c x:0 0 0 2024-05-06T14:04:20.531 INFO:tasks.workunit.client.1.smithi174.stdout:8/862: stat d4/d15/d64/f84 0 2024-05-06T14:04:20.531 INFO:tasks.workunit.client.1.smithi174.stdout:8/863: truncate d4/de/d24/f2e 858173 0 2024-05-06T14:04:20.531 INFO:tasks.workunit.client.1.smithi174.stdout:4/977: dwrite d1/d9/d15/d41/fe9 [618496,12288] 0 2024-05-06T14:04:20.531 INFO:tasks.workunit.client.1.smithi174.stdout:4/978: link d1/d1f/d27/d2c/d45/dc1/lb8 d1/d9/d15/d74/d86/l158 0 2024-05-06T14:04:20.531 INFO:tasks.workunit.client.1.smithi174.stdout:5/920: creat d1/d6/d7/d36/d53/d59/d61/d69/dc3/d134/f137 x:0 0 0 2024-05-06T14:04:20.532 INFO:tasks.workunit.client.1.smithi174.stdout:4/979: creat d1/d9/d15/d35/dd9/f159 x:0 0 0 2024-05-06T14:04:20.532 INFO:tasks.workunit.client.1.smithi174.stdout:0/754: mkdir d0/d4/d80/d102 0 2024-05-06T14:04:20.532 INFO:tasks.workunit.client.1.smithi174.stdout:9/695: mkdir dc/de/d7f/da4/ded 0 2024-05-06T14:04:20.532 INFO:tasks.workunit.client.1.smithi174.stdout:5/921: mknod d1/d6/d7/d36/d53/d59/c138 0 2024-05-06T14:04:20.532 INFO:tasks.workunit.client.1.smithi174.stdout:5/922: stat d1/d6/d7/f87 0 2024-05-06T14:04:20.542 INFO:tasks.workunit.client.1.smithi174.stdout:8/864: fsync d4/de/d24/d5e/fc4 0 2024-05-06T14:04:20.542 INFO:tasks.workunit.client.1.smithi174.stdout:8/865: dread d4/d53/f69 [434176,4096] 0 2024-05-06T14:04:20.542 INFO:tasks.workunit.client.1.smithi174.stdout:8/866: unlink d4/d15/d20/l39 0 2024-05-06T14:04:20.542 INFO:tasks.workunit.client.1.smithi174.stdout:8/867: mknod d4/d15/d20/d3e/d79/c11d 0 2024-05-06T14:04:20.542 INFO:tasks.workunit.client.1.smithi174.stdout:2/684: fdatasync d0/d24/d77/d93/f9c 0 2024-05-06T14:04:20.543 INFO:tasks.workunit.client.1.smithi174.stdout:2/685: dread - d0/d1/f8e zero size 2024-05-06T14:04:20.543 INFO:tasks.workunit.client.1.smithi174.stdout:2/686: stat d0/d24/d77/d93/f9c 0 2024-05-06T14:04:20.543 INFO:tasks.workunit.client.1.smithi174.stdout:2/687: stat d0/d24/f65 0 2024-05-06T14:04:20.543 INFO:tasks.workunit.client.1.smithi174.stdout:8/868: write d4/d15/d20/d3e/f54 [843250,56089] 0 2024-05-06T14:04:20.543 INFO:tasks.workunit.client.1.smithi174.stdout:9/696: fsync dc/d27/f2a 0 2024-05-06T14:04:20.543 INFO:tasks.workunit.client.1.smithi174.stdout:9/697: getdents dc/d17/d3a/dcb/daf/d43/d8e 0 2024-05-06T14:04:20.548 INFO:tasks.workunit.client.1.smithi174.stdout:2/688: creat d0/da/d3f/d67/fd3 x:0 0 0 2024-05-06T14:04:20.548 INFO:tasks.workunit.client.1.smithi174.stdout:4/980: dwrite d1/d1f/dd6/d6e/d50/f5c [90112,28672] 0 2024-05-06T14:04:20.549 INFO:tasks.workunit.client.1.smithi174.stdout:5/923: dwrite d1/d6/fa2 [303104,28672] 0 2024-05-06T14:04:20.549 INFO:tasks.workunit.client.1.smithi174.stdout:5/924: link d1/d6/d7/da1/dd8/de7/fef d1/d6/df/d35/d81/d60/db0/de/dbd/f139 0 2024-05-06T14:04:20.549 INFO:tasks.workunit.client.1.smithi174.stdout:4/981: write d1/d9/d15/d74/fb7 [148857,55900] 0 2024-05-06T14:04:20.549 INFO:tasks.workunit.client.1.smithi174.stdout:8/869: dread d4/de/d23/d3c/f7f [1703936,61440] 0 2024-05-06T14:04:20.549 INFO:tasks.workunit.client.1.smithi174.stdout:8/870: dread - d4/de/d24/d5e/d85/f109 zero size 2024-05-06T14:04:20.549 INFO:tasks.workunit.client.1.smithi174.stdout:8/871: dread d4/d48/f90 [475136,81920] 0 2024-05-06T14:04:20.549 INFO:tasks.workunit.client.1.smithi174.stdout:8/872: stat d4/d15/d20/d3e/d79/d94/lc8 0 2024-05-06T14:04:20.549 INFO:tasks.workunit.client.1.smithi174.stdout:8/873: write d4/d15/d20/d3e/d79/d94/f111 [555499,38116] 0 2024-05-06T14:04:20.550 INFO:tasks.workunit.client.1.smithi174.stdout:8/874: mkdir d4/de/d24/d5e/d85/d91/d11e 0 2024-05-06T14:04:20.550 INFO:tasks.workunit.client.1.smithi174.stdout:8/875: rmdir d4/de/d23/d3c/db2/da6/dad 39 2024-05-06T14:04:20.550 INFO:tasks.workunit.client.1.smithi174.stdout:8/876: write d4/d15/d20/d3e/d79/d94/ff3 [768303,106011] 0 2024-05-06T14:04:20.550 INFO:tasks.workunit.client.1.smithi174.stdout:8/877: truncate d4/d15/fab 442886 0 2024-05-06T14:04:20.550 INFO:tasks.workunit.client.1.smithi174.stdout:8/878: link d4/de/d23/d41/d4e/f86 d4/de/d23/d41/d4e/f11f 0 2024-05-06T14:04:20.550 INFO:tasks.workunit.client.1.smithi174.stdout:2/689: dwrite d0/d1/f94 [897024,86016] 0 2024-05-06T14:04:20.551 INFO:tasks.workunit.client.1.smithi174.stdout:8/879: read d4/d15/d20/d3e/f54 [37161,49567] 0 2024-05-06T14:04:20.551 INFO:tasks.workunit.client.1.smithi174.stdout:2/690: write d0/da/d3f/da6/fd0 [721080,127360] 0 2024-05-06T14:04:20.551 INFO:tasks.workunit.client.1.smithi174.stdout:4/982: dwrite d1/d1f/dd6/d6e/d50/f113 [1245184,106496] 0 2024-05-06T14:04:20.551 INFO:tasks.workunit.client.1.smithi174.stdout:4/983: dread d1/d1f/dd6/d6e/d50/f5c [495616,122880] 0 2024-05-06T14:04:20.551 INFO:tasks.workunit.client.1.smithi174.stdout:4/984: rmdir d1/d1f/dd6/d6e/d50/d95 39 2024-05-06T14:04:20.551 INFO:tasks.workunit.client.1.smithi174.stdout:4/985: creat d1/d1f/d27/d2c/d45/dfc/f15a x:0 0 0 2024-05-06T14:04:20.627 INFO:tasks.workunit.client.1.smithi174.stdout:2/691: dread d0/da/d3f/d67/f80 [176128,57344] 0 2024-05-06T14:04:20.627 INFO:tasks.workunit.client.1.smithi174.stdout:8/880: dwrite d4/de/d23/d3c/fbc [741376,49152] 0 2024-05-06T14:04:20.636 INFO:tasks.workunit.client.1.smithi174.stdout:4/986: dread d1/d1f/dd6/d6e/d50/db0/fd7 [2224128,45056] 0 2024-05-06T14:04:20.636 INFO:tasks.workunit.client.1.smithi174.stdout:4/987: write d1/d9/d15/f9c [674402,121721] 0 2024-05-06T14:04:20.636 INFO:tasks.workunit.client.1.smithi174.stdout:4/988: dread d1/fd [958464,12288] 0 2024-05-06T14:04:20.636 INFO:tasks.workunit.client.1.smithi174.stdout:4/989: creat d1/d1f/dd6/d6e/d14e/f15b x:0 0 0 2024-05-06T14:04:20.636 INFO:tasks.workunit.client.1.smithi174.stdout:4/990: unlink d1/d9/d15/d35/dd9/d6b/ddf/f114 0 2024-05-06T14:04:20.636 INFO:tasks.workunit.client.1.smithi174.stdout:4/991: write d1/d1f/d27/d84/fd2 [1105062,91411] 0 2024-05-06T14:04:20.636 INFO:tasks.workunit.client.1.smithi174.stdout:4/992: mknod d1/d1f/dd6/d6e/d10e/c15c 0 2024-05-06T14:04:20.637 INFO:tasks.workunit.client.1.smithi174.stdout:4/993: mkdir d1/d1f/d15d 0 2024-05-06T14:04:20.637 INFO:tasks.workunit.client.1.smithi174.stdout:4/994: creat d1/d1f/d27/d2c/d45/df8/f15e x:0 0 0 2024-05-06T14:04:20.637 INFO:tasks.workunit.client.1.smithi174.stdout:4/995: mknod d1/d1f/d27/d2c/d45/dfc/c15f 0 2024-05-06T14:04:20.637 INFO:tasks.workunit.client.1.smithi174.stdout:4/996: write d1/d2e/f6a [1480809,59891] 0 2024-05-06T14:04:20.637 INFO:tasks.workunit.client.1.smithi174.stdout:4/997: creat d1/d1f/dd6/d6e/d50/db0/f160 x:0 0 0 2024-05-06T14:04:20.637 INFO:tasks.workunit.client.1.smithi174.stdout:4/998: dread - d1/d1f/dd6/d6e/d14e/f15b zero size 2024-05-06T14:04:20.637 INFO:tasks.workunit.client.1.smithi174.stdout:4/999: chown d1/d9/d15/d35/dd9/f159 12 1 2024-05-06T14:04:20.680 INFO:tasks.workunit.client.1.smithi174.stdout:9/698: fsync f7 0 2024-05-06T14:04:20.680 INFO:tasks.workunit.client.1.smithi174.stdout:9/699: dread - dc/d17/d3a/db2/fbc zero size 2024-05-06T14:04:20.688 INFO:tasks.workunit.client.1.smithi174.stdout:8/881: dread d4/d15/fd2 [897024,118784] 0 2024-05-06T14:04:20.700 INFO:tasks.workunit.client.1.smithi174.stdout:2/692: fdatasync d0/d1/d2/d2a/f48 0 2024-05-06T14:04:20.701 INFO:tasks.workunit.client.1.smithi174.stdout:2/693: link d0/da/d3f/da6/fc4 d0/db/fd4 0 2024-05-06T14:04:20.702 INFO:tasks.workunit.client.1.smithi174.stdout:2/694: chown d0/d1/d2/f17 23344 1 2024-05-06T14:04:20.706 INFO:tasks.workunit.client.1.smithi174.stdout:2/695: rename d0/fc6 to d0/d1/d2/d4/d6/d3c/fd5 0 2024-05-06T14:04:20.709 INFO:tasks.workunit.client.1.smithi174.stdout:9/700: dwrite dc/d17/d3a/dcb/daf/d43/d8e/fd0 [4096,86016] 0 2024-05-06T14:04:20.709 INFO:tasks.workunit.client.1.smithi174.stdout:9/701: creat dc/de/d6b/fee x:0 0 0 2024-05-06T14:04:20.709 INFO:tasks.workunit.client.1.smithi174.stdout:9/702: mknod dc/de/cef 0 2024-05-06T14:04:20.709 INFO:tasks.workunit.client.1.smithi174.stdout:9/703: read dc/d17/d3a/dcb/daf/d43/f4d [645962,74666] 0 2024-05-06T14:04:20.709 INFO:tasks.workunit.client.1.smithi174.stdout:8/882: dwrite d4/de/d24/d5e/d85/f109 [749568,102400] 0 2024-05-06T14:04:20.709 INFO:tasks.workunit.client.1.smithi174.stdout:8/883: read d4/d15/d20/d3e/d79/fcf [1019104,92634] 0 2024-05-06T14:04:20.709 INFO:tasks.workunit.client.1.smithi174.stdout:8/884: truncate d4/de/d23/d41/d4e/f11f 904235 0 2024-05-06T14:04:20.710 INFO:tasks.workunit.client.1.smithi174.stdout:8/885: creat d4/d48/f120 x:0 0 0 2024-05-06T14:04:20.711 INFO:tasks.workunit.client.1.smithi174.stdout:2/696: dwrite d0/da/d3f/fac [233472,90112] 0 2024-05-06T14:04:20.711 INFO:tasks.workunit.client.1.smithi174.stdout:2/697: dread d0/d16/fb2 [761856,28672] 0 2024-05-06T14:04:20.711 INFO:tasks.workunit.client.1.smithi174.stdout:2/698: creat d0/d24/fd6 x:0 0 0 2024-05-06T14:04:20.711 INFO:tasks.workunit.client.1.smithi174.stdout:2/699: mkdir d0/da/dd7 0 2024-05-06T14:04:20.711 INFO:tasks.workunit.client.1.smithi174.stdout:2/700: truncate d0/d1/d2/d4/d18/d2d/f6b 671242 0 2024-05-06T14:04:20.712 INFO:tasks.workunit.client.1.smithi174.stdout:2/701: truncate d0/d92/f99 889459 0 2024-05-06T14:04:20.712 INFO:tasks.workunit.client.1.smithi174.stdout:2/702: mkdir d0/d1/d2/d4/d6/dd8 0 2024-05-06T14:04:20.712 INFO:tasks.workunit.client.1.smithi174.stdout:2/703: chown d0/d1/d2/d2a 415540 1 2024-05-06T14:04:20.712 INFO:tasks.workunit.client.1.smithi174.stdout:2/704: readlink d0/d1/d2/d4/d18/l87 0 2024-05-06T14:04:20.712 INFO:tasks.workunit.client.1.smithi174.stdout:2/705: write d0/da/d3f/d67/f80 [974877,73216] 0 2024-05-06T14:04:20.778 INFO:tasks.workunit.client.1.smithi174.stdout:9/704: dwrite dc/d1c/f55 [1007616,61440] 0 2024-05-06T14:04:20.778 INFO:tasks.workunit.client.1.smithi174.stdout:8/886: dwrite d4/de/d23/fb9 [704512,90112] 0 2024-05-06T14:04:20.778 INFO:tasks.workunit.client.1.smithi174.stdout:8/887: chown d4/d15/d66/ccd 1276 1 2024-05-06T14:04:20.809 INFO:tasks.workunit.client.1.smithi174.stdout:9/705: dwrite dc/d1c/f5f [114688,8192] 0 2024-05-06T14:04:20.809 INFO:tasks.workunit.client.1.smithi174.stdout:9/706: creat dc/d27/d6d/ff0 x:0 0 0 2024-05-06T14:04:20.809 INFO:tasks.workunit.client.1.smithi174.stdout:9/707: readlink dc/df/l2c 0 2024-05-06T14:04:20.809 INFO:tasks.workunit.client.1.smithi174.stdout:9/708: chown dc/d27/d6d/le3 0 1 2024-05-06T14:04:20.809 INFO:tasks.workunit.client.1.smithi174.stdout:9/709: truncate dc/d1c/f41 691679 0 2024-05-06T14:04:20.811 INFO:tasks.workunit.client.1.smithi174.stdout:2/706: dwrite d0/d1/d2/d4/fb4 [1298432,73728] 0 2024-05-06T14:04:20.811 INFO:tasks.workunit.client.1.smithi174.stdout:2/707: getdents d0/d24 0 2024-05-06T14:04:20.812 INFO:tasks.workunit.client.1.smithi174.stdout:9/710: link dc/d17/d4c/fba dc/d17/d3a/dcb/ff1 0 2024-05-06T14:04:20.812 INFO:tasks.workunit.client.1.smithi174.stdout:9/711: readlink dc/d17/d3a/lc7 0 2024-05-06T14:04:20.813 INFO:tasks.workunit.client.1.smithi174.stdout:8/888: dread d4/de/d23/d41/d56/f5d [860160,110592] 0 2024-05-06T14:04:20.813 INFO:tasks.workunit.client.1.smithi174.stdout:8/889: rmdir d4/de/d24/d46/d63/db7/d112 0 2024-05-06T14:04:20.814 INFO:tasks.workunit.client.1.smithi174.stdout:8/890: mkdir d4/d15/d20/d70/d121 0 2024-05-06T14:04:20.814 INFO:tasks.workunit.client.1.smithi174.stdout:8/891: getdents d4/de/d23/d41/d56 0 2024-05-06T14:04:20.814 INFO:tasks.workunit.client.1.smithi174.stdout:2/708: write d0/d1/d2/d4/d6/fcd [2391678,126362] 0 2024-05-06T14:04:20.814 INFO:tasks.workunit.client.1.smithi174.stdout:9/712: dwrite dc/d17/d4c/fba [1671168,49152] 0 2024-05-06T14:04:20.814 INFO:tasks.workunit.client.1.smithi174.stdout:9/713: link dc/df/f11 dc/d17/db8/ff2 0 2024-05-06T14:04:20.814 INFO:tasks.workunit.client.1.smithi174.stdout:9/714: mkdir dc/de/df3 0 2024-05-06T14:04:20.814 INFO:tasks.workunit.client.1.smithi174.stdout:9/715: chown dc/d17/d3a/dcb/daf/f1e 54372 1 2024-05-06T14:04:20.815 INFO:tasks.workunit.client.1.smithi174.stdout:9/716: readlink dc/d27/l7a 0 2024-05-06T14:04:20.815 INFO:tasks.workunit.client.1.smithi174.stdout:9/717: getdents dc/d17/d3a/dcb/daf/d43/d8e/dd2 0 2024-05-06T14:04:20.816 INFO:tasks.workunit.client.1.smithi174.stdout:8/892: dwrite d4/d15/fd2 [1150976,90112] 0 2024-05-06T14:04:20.816 INFO:tasks.workunit.client.1.smithi174.stdout:8/893: write d4/d15/d64/f74 [252616,19653] 0 2024-05-06T14:04:20.816 INFO:tasks.workunit.client.1.smithi174.stdout:2/709: dwrite d0/d1/d2/d4/d18/d2d/d32/d89/faf [0,57344] 0 2024-05-06T14:04:20.816 INFO:tasks.workunit.client.1.smithi174.stdout:2/710: creat d0/d1/d2/d4/d6/d3c/da2/db6/fd9 x:0 0 0 2024-05-06T14:04:20.817 INFO:tasks.workunit.client.1.smithi174.stdout:2/711: rename d0/da/d3f/da6/fc4 to d0/d24/d77/fda 0 2024-05-06T14:04:20.820 INFO:tasks.workunit.client.1.smithi174.stdout:2/712: mknod d0/d1/d2/d4/d18/d2d/dd1/cdb 0 2024-05-06T14:04:20.820 INFO:tasks.workunit.client.1.smithi174.stdout:2/713: read - d0/d24/d77/d93/d9a/fa3 zero size 2024-05-06T14:04:20.820 INFO:tasks.workunit.client.1.smithi174.stdout:2/714: unlink d0/d1/d2/d1b/c82 0 2024-05-06T14:04:20.820 INFO:tasks.workunit.client.1.smithi174.stdout:8/894: creat d4/de/d24/d5e/d85/d91/f122 x:0 0 0 2024-05-06T14:04:20.820 INFO:tasks.workunit.client.1.smithi174.stdout:8/895: mkdir d4/de/d24/d5e/d85/d123 0 2024-05-06T14:04:20.820 INFO:tasks.workunit.client.1.smithi174.stdout:8/896: rename d4/d15/d64 to d4/de/d23/d3c/db2/da6/dad/d124 0 2024-05-06T14:04:20.820 INFO:tasks.workunit.client.1.smithi174.stdout:8/897: unlink d4/de/d24/l6b 0 2024-05-06T14:04:20.821 INFO:tasks.workunit.client.1.smithi174.stdout:8/898: rename d4/de/d23/d3c/db2/da6/dad/d124/lb4 to d4/de/d23/d41/d56/dc0/l125 0 2024-05-06T14:04:20.821 INFO:tasks.workunit.client.1.smithi174.stdout:8/899: link d4/d53/l89 d4/de/d23/d41/d56/dc0/d103/l126 0 2024-05-06T14:04:20.821 INFO:tasks.workunit.client.1.smithi174.stdout:8/900: creat d4/de/d24/d5e/d85/f127 x:0 0 0 2024-05-06T14:04:20.821 INFO:tasks.workunit.client.1.smithi174.stdout:8/901: rmdir d4/de/d24/d46 39 2024-05-06T14:04:20.821 INFO:tasks.workunit.client.1.smithi174.stdout:2/715: dwrite d0/d24/f50 [1171456,106496] 0 2024-05-06T14:04:20.821 INFO:tasks.workunit.client.1.smithi174.stdout:2/716: getdents d0/d1/d2/d4/d18/d2d/d32 0 2024-05-06T14:04:20.821 INFO:tasks.workunit.client.1.smithi174.stdout:2/717: truncate d0/d1/d2/d2a/fca 1079610 0 2024-05-06T14:04:20.821 INFO:tasks.workunit.client.1.smithi174.stdout:2/718: mknod d0/d1/d2/d4/d43/cdc 0 2024-05-06T14:04:20.822 INFO:tasks.workunit.client.1.smithi174.stdout:2/719: chown d0/d24/f50 195 1 2024-05-06T14:04:20.822 INFO:tasks.workunit.client.1.smithi174.stdout:2/720: link d0/d24/f6a d0/db/d72/fdd 0 2024-05-06T14:04:20.826 INFO:tasks.workunit.client.1.smithi174.stdout:1/734: sync 2024-05-06T14:04:20.826 INFO:tasks.workunit.client.1.smithi174.stdout:3/680: sync 2024-05-06T14:04:20.826 INFO:tasks.workunit.client.1.smithi174.stdout:0/755: sync 2024-05-06T14:04:20.826 INFO:tasks.workunit.client.1.smithi174.stdout:6/929: sync 2024-05-06T14:04:20.826 INFO:tasks.workunit.client.1.smithi174.stdout:7/643: sync 2024-05-06T14:04:20.827 INFO:tasks.workunit.client.1.smithi174.stdout:0/756: dread - d0/f51 zero size 2024-05-06T14:04:20.827 INFO:tasks.workunit.client.1.smithi174.stdout:0/757: stat d0/d4/d8/d25/d5c/cf3 0 2024-05-06T14:04:20.827 INFO:tasks.workunit.client.1.smithi174.stdout:3/681: chown df/d2d/d4d/da5/fb0 45 1 2024-05-06T14:04:20.827 INFO:tasks.workunit.client.1.smithi174.stdout:1/735: link d11/d1f/d27/d32/d84/cf8 d11/d1f/d27/d32/d92/dbc/cfe 0 2024-05-06T14:04:20.827 INFO:tasks.workunit.client.1.smithi174.stdout:0/758: chown d0/d4/d8/d25/d5c/d44/dd5/d83/fbc 8735 1 2024-05-06T14:04:20.827 INFO:tasks.workunit.client.1.smithi174.stdout:7/644: creat d0/d1d/da4/d61/d19/d39/d90/fdd x:0 0 0 2024-05-06T14:04:20.827 INFO:tasks.workunit.client.1.smithi174.stdout:6/930: mkdir d0/d25/d52/d80/d10f/d12f 0 2024-05-06T14:04:20.827 INFO:tasks.workunit.client.1.smithi174.stdout:0/759: write d0/d4/d8/d25/d5c/f4c [359045,85185] 0 2024-05-06T14:04:20.827 INFO:tasks.workunit.client.1.smithi174.stdout:0/760: chown d0/d4/d8/d25/d5c/d44/f100 13 1 2024-05-06T14:04:20.828 INFO:tasks.workunit.client.1.smithi174.stdout:0/761: read - d0/d4/d8/fea zero size 2024-05-06T14:04:20.828 INFO:tasks.workunit.client.1.smithi174.stdout:0/762: dread d0/d4/d8/d25/d5c/fbd [2314240,65536] 0 2024-05-06T14:04:20.828 INFO:tasks.workunit.client.1.smithi174.stdout:0/763: link d0/l11 d0/d4/d8/d25/d5c/ddb/l103 0 2024-05-06T14:04:20.828 INFO:tasks.workunit.client.1.smithi174.stdout:0/764: rmdir d0/d4/d8/dce 39 2024-05-06T14:04:20.828 INFO:tasks.workunit.client.1.smithi174.stdout:0/765: rename d0/d1a to d0/d3/d104 0 2024-05-06T14:04:20.828 INFO:tasks.workunit.client.1.smithi174.stdout:0/766: chown d0/d4/d80/d93 1181 1 2024-05-06T14:04:20.828 INFO:tasks.workunit.client.1.smithi174.stdout:0/767: symlink d0/d4/l105 0 2024-05-06T14:04:20.828 INFO:tasks.workunit.client.1.smithi174.stdout:0/768: rmdir d0/d4/d8/d25/d5c/ddb 39 2024-05-06T14:04:20.829 INFO:tasks.workunit.client.1.smithi174.stdout:0/769: dread d0/d36/d45/f89 [200704,122880] 0 2024-05-06T14:04:20.829 INFO:tasks.workunit.client.1.smithi174.stdout:0/770: read d0/d4/d8/d25/d5c/d44/f46 [728398,3062] 0 2024-05-06T14:04:20.829 INFO:tasks.workunit.client.1.smithi174.stdout:0/771: creat d0/d4/d8/d25/d5c/d44/dd5/f106 x:0 0 0 2024-05-06T14:04:20.829 INFO:tasks.workunit.client.1.smithi174.stdout:0/772: truncate d0/d3/dad/f9a 787185 0 2024-05-06T14:04:20.829 INFO:tasks.workunit.client.1.smithi174.stdout:0/773: dread d0/d4/d8/d25/d5c/d44/dd5/d38/f31 [540672,106496] 0 2024-05-06T14:04:20.829 INFO:tasks.workunit.client.1.smithi174.stdout:0/774: creat d0/d4/d8/f107 x:0 0 0 2024-05-06T14:04:20.829 INFO:tasks.workunit.client.1.smithi174.stdout:0/775: unlink d0/d3/d104/d17/f2a 0 2024-05-06T14:04:20.829 INFO:tasks.workunit.client.1.smithi174.stdout:0/776: creat d0/d4/d8/d25/d5c/d44/f108 x:0 0 0 2024-05-06T14:04:20.829 INFO:tasks.workunit.client.1.smithi174.stdout:0/777: creat d0/d4/d8/d25/d5c/d44/dd5/d38/dcd/f109 x:0 0 0 2024-05-06T14:04:20.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/778: chown d0/d4/d8 176352 1 2024-05-06T14:04:20.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/779: dread d0/d4/d8/d25/d5c/d44/dd5/f43 [2150400,90112] 0 2024-05-06T14:04:20.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/780: chown d0/d4/d80/d93/f97 1 1 2024-05-06T14:04:20.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/781: getdents d0/d4/d8/d25/d5c/d44/dd5/d83 0 2024-05-06T14:04:20.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/782: link d0/d4/d8/d25/d5c/f4c d0/d3/dad/f10a 0 2024-05-06T14:04:20.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/783: getdents d0/d4/d8/d25/d5c 0 2024-05-06T14:04:20.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/784: mkdir d0/d4/d8/d25/d5c/d4a/da7/d10b 0 2024-05-06T14:04:20.830 INFO:tasks.workunit.client.1.smithi174.stdout:0/785: write d0/d3/dad/f62 [1030842,124172] 0 2024-05-06T14:04:20.844 INFO:tasks.workunit.client.1.smithi174.stdout:8/902: dread d4/de/d23/f25 [610304,45056] 0 2024-05-06T14:04:20.845 INFO:tasks.workunit.client.1.smithi174.stdout:8/903: mkdir d4/de/d24/d46/d63/d117/d128 0 2024-05-06T14:04:20.845 INFO:tasks.workunit.client.1.smithi174.stdout:8/904: dread d4/de/d24/d46/d63/f6f [69632,20480] 0 2024-05-06T14:04:20.845 INFO:tasks.workunit.client.1.smithi174.stdout:8/905: write d4/d15/fd2 [1028387,24472] 0 2024-05-06T14:04:20.845 INFO:tasks.workunit.client.1.smithi174.stdout:8/906: rmdir d4/d15 39 2024-05-06T14:04:20.982 INFO:tasks.workunit.client.1.smithi174.stdout:3/682: fdatasync df/d2d/d4d/f4f 0 2024-05-06T14:04:20.987 INFO:tasks.workunit.client.1.smithi174.stdout:8/907: dwrite d4/de/d23/d41/d56/de6/ff8 [442368,114688] 0 2024-05-06T14:04:20.987 INFO:tasks.workunit.client.1.smithi174.stdout:1/736: dwrite d11/d57/fd8 [499712,24576] 0 2024-05-06T14:04:20.987 INFO:tasks.workunit.client.1.smithi174.stdout:0/786: dwrite d0/d3/d104/d17/d2e/fc0 [757760,98304] 0 2024-05-06T14:04:20.987 INFO:tasks.workunit.client.1.smithi174.stdout:6/931: dwrite d0/d25/d52/d2c/f120 [581632,73728] 0 2024-05-06T14:04:20.987 INFO:tasks.workunit.client.1.smithi174.stdout:2/721: dwrite d0/db/d15/f9e [655360,94208] 0 2024-05-06T14:04:20.987 INFO:tasks.workunit.client.1.smithi174.stdout:3/683: mkdir df/d2d/d4e/db6/db8/dd9 0 2024-05-06T14:04:20.987 INFO:tasks.workunit.client.1.smithi174.stdout:7/645: dwrite d0/d1d/da4/d61/f5c [602112,49152] 0 2024-05-06T14:04:20.988 INFO:tasks.workunit.client.1.smithi174.stdout:3/684: chown df/d2d/d4d/da5 2097 1 2024-05-06T14:04:20.988 INFO:tasks.workunit.client.1.smithi174.stdout:3/685: mknod df/d2d/d87/cda 0 2024-05-06T14:04:20.988 INFO:tasks.workunit.client.1.smithi174.stdout:0/787: rmdir d0/d4/d80/dfb 0 2024-05-06T14:04:20.988 INFO:tasks.workunit.client.1.smithi174.stdout:7/646: rename d0/d1d/da4/d61/d19/d39/d46/f58 to d0/d3a/fde 0 2024-05-06T14:04:20.988 INFO:tasks.workunit.client.1.smithi174.stdout:1/737: truncate f5 1018945 0 2024-05-06T14:04:20.988 INFO:tasks.workunit.client.1.smithi174.stdout:3/686: mknod df/d10/d1b/d59/cdb 0 2024-05-06T14:04:20.988 INFO:tasks.workunit.client.1.smithi174.stdout:2/722: mkdir d0/d1/d2/d4/dde 0 2024-05-06T14:04:20.988 INFO:tasks.workunit.client.1.smithi174.stdout:3/687: readlink l3 0 2024-05-06T14:04:20.989 INFO:tasks.workunit.client.1.smithi174.stdout:8/908: unlink d4/de/d23/d3c/f7f 0 2024-05-06T14:04:20.989 INFO:tasks.workunit.client.1.smithi174.stdout:8/909: stat d4/d15/d20/d3e/d79/dbf/fe2 0 2024-05-06T14:04:20.989 INFO:tasks.workunit.client.1.smithi174.stdout:2/723: dread d0/db/d15/f4e [364544,53248] 0 2024-05-06T14:04:20.989 INFO:tasks.workunit.client.1.smithi174.stdout:1/738: dread d11/d1f/d27/d2d/f31 [606208,61440] 0 2024-05-06T14:04:20.989 INFO:tasks.workunit.client.1.smithi174.stdout:1/739: link d11/d57/d77/f7d d11/d1f/d27/d32/fff 0 2024-05-06T14:04:20.989 INFO:tasks.workunit.client.1.smithi174.stdout:2/724: creat d0/da/d3f/d67/fdf x:0 0 0 2024-05-06T14:04:20.989 INFO:tasks.workunit.client.1.smithi174.stdout:8/910: creat d4/de/d23/d41/d56/dc0/d103/f129 x:0 0 0 2024-05-06T14:04:20.989 INFO:tasks.workunit.client.1.smithi174.stdout:8/911: rename d4/d53/f69 to d4/de/d23/d3c/db2/da6/f12a 0 2024-05-06T14:04:20.989 INFO:tasks.workunit.client.1.smithi174.stdout:1/740: symlink d11/d41/dc9/d6c/l100 0 2024-05-06T14:04:20.990 INFO:tasks.workunit.client.1.smithi174.stdout:1/741: stat d11/d41/cdb 0 2024-05-06T14:04:20.990 INFO:tasks.workunit.client.1.smithi174.stdout:8/912: unlink d4/de/d23/d41/d56/dc0/df0/ffe 0 2024-05-06T14:04:20.990 INFO:tasks.workunit.client.1.smithi174.stdout:2/725: unlink d0/da/f1d 0 2024-05-06T14:04:20.990 INFO:tasks.workunit.client.1.smithi174.stdout:1/742: write d11/d1f/d27/d32/d92/feb [589896,58059] 0 2024-05-06T14:04:20.990 INFO:tasks.workunit.client.1.smithi174.stdout:8/913: creat d4/de/d24/d5e/d85/d91/f12b x:0 0 0 2024-05-06T14:04:20.990 INFO:tasks.workunit.client.1.smithi174.stdout:8/914: creat d4/de/d24/d46/d63/d117/d128/f12c x:0 0 0 2024-05-06T14:04:20.990 INFO:tasks.workunit.client.1.smithi174.stdout:8/915: mknod d4/de/d24/d5e/c12d 0 2024-05-06T14:04:20.990 INFO:tasks.workunit.client.1.smithi174.stdout:8/916: creat d4/de/d23/d41/d56/dc0/df0/f12e x:0 0 0 2024-05-06T14:04:20.991 INFO:tasks.workunit.client.1.smithi174.stdout:8/917: mknod d4/de/d24/d5e/c12f 0 2024-05-06T14:04:20.991 INFO:tasks.workunit.client.1.smithi174.stdout:8/918: mkdir d4/d15/d20/d70/d121/d130 0 2024-05-06T14:04:20.991 INFO:tasks.workunit.client.1.smithi174.stdout:8/919: write d4/d15/d20/d3e/d79/fb1 [1350402,46074] 0 2024-05-06T14:04:21.017 INFO:tasks.workunit.client.1.smithi174.stdout:6/932: fdatasync d0/d25/d52/ffc 0 2024-05-06T14:04:21.017 INFO:tasks.workunit.client.1.smithi174.stdout:6/933: creat d0/f130 x:0 0 0 2024-05-06T14:04:21.017 INFO:tasks.workunit.client.1.smithi174.stdout:3/688: fdatasync df/d10/d1b/d7e/fa1 0 2024-05-06T14:04:21.017 INFO:tasks.workunit.client.1.smithi174.stdout:0/788: fdatasync d0/d36/f9b 0 2024-05-06T14:04:21.017 INFO:tasks.workunit.client.1.smithi174.stdout:2/726: fdatasync d0/d1/d2/d4/d18/d2d/d32/f47 0 2024-05-06T14:04:21.018 INFO:tasks.workunit.client.1.smithi174.stdout:0/789: dread d0/d4/d8/d25/d5c/f87 [757760,32768] 0 2024-05-06T14:04:21.018 INFO:tasks.workunit.client.1.smithi174.stdout:0/790: creat d0/d4/d8/d25/d5c/f10c x:0 0 0 2024-05-06T14:04:21.018 INFO:tasks.workunit.client.1.smithi174.stdout:0/791: readlink d0/d4/d80/d93/laa 0 2024-05-06T14:04:21.018 INFO:tasks.workunit.client.1.smithi174.stdout:0/792: chown d0/d3/d104/c8a 288 1 2024-05-06T14:04:21.018 INFO:tasks.workunit.client.1.smithi174.stdout:0/793: dread - d0/d4/d8/d25/d5c/d44/f108 zero size 2024-05-06T14:04:21.018 INFO:tasks.workunit.client.1.smithi174.stdout:2/727: write d0/d24/fa7 [464199,72530] 0 2024-05-06T14:04:21.018 INFO:tasks.workunit.client.1.smithi174.stdout:2/728: write d0/d92/f99 [1356755,45971] 0 2024-05-06T14:04:21.018 INFO:tasks.workunit.client.1.smithi174.stdout:0/794: read d0/d16/fcc [28025,113990] 0 2024-05-06T14:04:21.019 INFO:tasks.workunit.client.1.smithi174.stdout:2/729: creat d0/d1/d2/d4/dde/fe0 x:0 0 0 2024-05-06T14:04:21.019 INFO:tasks.workunit.client.1.smithi174.stdout:2/730: link d0/d16/f19 d0/d1/d2/d4/d6/d3c/fe1 0 2024-05-06T14:04:21.019 INFO:tasks.workunit.client.1.smithi174.stdout:2/731: rename d0/db/c73 to d0/d1/ce2 0 2024-05-06T14:04:21.019 INFO:tasks.workunit.client.1.smithi174.stdout:2/732: dread d0/d1/d2/d4/d6/f88 [4096,73728] 0 2024-05-06T14:04:21.019 INFO:tasks.workunit.client.1.smithi174.stdout:2/733: mknod d0/d24/d77/d93/d9a/ce3 0 2024-05-06T14:04:21.019 INFO:tasks.workunit.client.1.smithi174.stdout:1/743: dwrite d11/d57/d98/daf/f87 [561152,28672] 0 2024-05-06T14:04:21.019 INFO:tasks.workunit.client.1.smithi174.stdout:2/734: write d0/d24/fa7 [343712,114691] 0 2024-05-06T14:04:21.019 INFO:tasks.workunit.client.1.smithi174.stdout:2/735: rmdir d0/d1/d2/d4/d6/d3c/da2 39 2024-05-06T14:04:21.020 INFO:tasks.workunit.client.1.smithi174.stdout:2/736: readlink d0/d24/d77/d93/la4 0 2024-05-06T14:04:21.020 INFO:tasks.workunit.client.1.smithi174.stdout:1/744: creat d11/d57/d98/daf/f101 x:0 0 0 2024-05-06T14:04:21.020 INFO:tasks.workunit.client.1.smithi174.stdout:1/745: read d11/d1f/d27/d2d/f31 [706462,23670] 0 2024-05-06T14:04:21.020 INFO:tasks.workunit.client.1.smithi174.stdout:1/746: link d11/d57/c80 d11/d1f/d27/d32/d84/d8c/dee/c102 0 2024-05-06T14:04:21.020 INFO:tasks.workunit.client.1.smithi174.stdout:1/747: readlink d11/d57/d83/ld7 0 2024-05-06T14:04:21.020 INFO:tasks.workunit.client.1.smithi174.stdout:1/748: write d11/d1f/d27/d2d/f43 [2162679,78331] 0 2024-05-06T14:04:21.020 INFO:tasks.workunit.client.1.smithi174.stdout:1/749: truncate d11/d1f/d27/d32/d84/fe5 498047 0 2024-05-06T14:04:21.020 INFO:tasks.workunit.client.1.smithi174.stdout:1/750: rename d11/d1f/d27/d2d/c82 to d11/d57/d77/c103 0 2024-05-06T14:04:21.021 INFO:tasks.workunit.client.1.smithi174.stdout:1/751: write d11/d1f/d27/d2d/f8b [29570,9683] 0 2024-05-06T14:04:21.021 INFO:tasks.workunit.client.1.smithi174.stdout:1/752: chown d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/cd6 173 1 2024-05-06T14:04:21.021 INFO:tasks.workunit.client.1.smithi174.stdout:1/753: read - d11/d1f/fc4 zero size 2024-05-06T14:04:21.021 INFO:tasks.workunit.client.1.smithi174.stdout:1/754: creat d11/d1f/d27/d32/f104 x:0 0 0 2024-05-06T14:04:21.021 INFO:tasks.workunit.client.1.smithi174.stdout:1/755: chown d11/d1f/l48 159 1 2024-05-06T14:04:21.021 INFO:tasks.workunit.client.1.smithi174.stdout:1/756: write d11/d41/d4a/f81 [222932,116397] 0 2024-05-06T14:04:21.021 INFO:tasks.workunit.client.1.smithi174.stdout:1/757: link d11/d1f/d27/d2d/f43 d11/d57/d98/daf/d9b/f105 0 2024-05-06T14:04:21.021 INFO:tasks.workunit.client.1.smithi174.stdout:1/758: creat d11/d57/d98/f106 x:0 0 0 2024-05-06T14:04:21.021 INFO:tasks.workunit.client.1.smithi174.stdout:1/759: mkdir d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/d107 0 2024-05-06T14:04:21.022 INFO:tasks.workunit.client.1.smithi174.stdout:1/760: unlink d11/d41/dc9/fad 0 2024-05-06T14:04:21.022 INFO:tasks.workunit.client.1.smithi174.stdout:1/761: mkdir d11/d1f/d27/d32/d84/d8c/d94/d108 0 2024-05-06T14:04:21.022 INFO:tasks.workunit.client.1.smithi174.stdout:1/762: stat d11/d1f/d27/d32/d84/d8c/cd9 0 2024-05-06T14:04:21.022 INFO:tasks.workunit.client.1.smithi174.stdout:1/763: dread d11/d1f/d27/d2d/fd0 [630784,57344] 0 2024-05-06T14:04:21.022 INFO:tasks.workunit.client.1.smithi174.stdout:3/689: dread df/d10/f52 [180224,28672] 0 2024-05-06T14:04:21.022 INFO:tasks.workunit.client.1.smithi174.stdout:0/795: dwrite d0/d3/d104/d17/ffd [4096,4096] 0 2024-05-06T14:04:21.022 INFO:tasks.workunit.client.1.smithi174.stdout:0/796: rename d0/d4/d8/d25/d5c/d44/dd5/d83/fbc to d0/d4/d8/d25/d5c/f10d 0 2024-05-06T14:04:21.022 INFO:tasks.workunit.client.1.smithi174.stdout:0/797: dread - d0/d4/d8/d25/d5c/d44/ff4 zero size 2024-05-06T14:04:21.023 INFO:tasks.workunit.client.1.smithi174.stdout:2/737: dwrite d0/d24/d77/d93/f9c [1134592,61440] 0 2024-05-06T14:04:21.023 INFO:tasks.workunit.client.1.smithi174.stdout:0/798: truncate d0/d3/d104/d17/d2e/fc0 318738 0 2024-05-06T14:04:21.023 INFO:tasks.workunit.client.1.smithi174.stdout:2/738: dread d0/db/f86 [352256,98304] 0 2024-05-06T14:04:21.023 INFO:tasks.workunit.client.1.smithi174.stdout:0/799: chown d0/d4/d8/d25/d5c/d44/dd5/d38/c9d 30 1 2024-05-06T14:04:21.023 INFO:tasks.workunit.client.1.smithi174.stdout:2/739: getdents d0/db/d15 0 2024-05-06T14:04:21.023 INFO:tasks.workunit.client.1.smithi174.stdout:2/740: mkdir d0/d1/d2/d4/dde/de4 0 2024-05-06T14:04:21.023 INFO:tasks.workunit.client.1.smithi174.stdout:2/741: stat d0/da/d3f/c5d 0 2024-05-06T14:04:21.023 INFO:tasks.workunit.client.1.smithi174.stdout:2/742: rename d0/d1/d2/f17 to d0/d24/d77/d93/d9a/fe5 0 2024-05-06T14:04:21.024 INFO:tasks.workunit.client.1.smithi174.stdout:2/743: mknod d0/d24/d77/ce6 0 2024-05-06T14:04:21.024 INFO:tasks.workunit.client.1.smithi174.stdout:2/744: mknod d0/d1/d2/d1b/ce7 0 2024-05-06T14:04:21.024 INFO:tasks.workunit.client.1.smithi174.stdout:2/745: chown d0/d1/d2/d4/d6/dd8 120992 1 2024-05-06T14:04:21.024 INFO:tasks.workunit.client.1.smithi174.stdout:2/746: creat d0/d1/d2/d4/d18/fe8 x:0 0 0 2024-05-06T14:04:21.024 INFO:tasks.workunit.client.1.smithi174.stdout:2/747: write d0/d1/d2/d4/d18/d2d/d32/f47 [606214,7961] 0 2024-05-06T14:04:21.024 INFO:tasks.workunit.client.1.smithi174.stdout:2/748: chown d0/d24/f65 13842541 1 2024-05-06T14:04:21.024 INFO:tasks.workunit.client.1.smithi174.stdout:6/934: dread d0/d25/f30 [335872,28672] 0 2024-05-06T14:04:21.028 INFO:tasks.workunit.client.1.smithi174.stdout:1/764: dread d11/d1f/d27/f5d [32768,28672] 0 2024-05-06T14:04:21.028 INFO:tasks.workunit.client.1.smithi174.stdout:1/765: chown d11/d1f/d27/d2d/d9c/fca 1 1 2024-05-06T14:04:21.060 INFO:tasks.workunit.client.1.smithi174.stdout:6/935: dwrite d0/df/d3c/f8b [491520,106496] 0 2024-05-06T14:04:21.060 INFO:tasks.workunit.client.1.smithi174.stdout:3/690: dwrite f7 [323584,73728] 0 2024-05-06T14:04:21.061 INFO:tasks.workunit.client.1.smithi174.stdout:0/800: dwrite d0/d4/d8/d25/d5c/d44/f46 [3076096,57344] 0 2024-05-06T14:04:21.061 INFO:tasks.workunit.client.1.smithi174.stdout:1/766: dwrite d11/d1f/f38 [319488,8192] 0 2024-05-06T14:04:21.061 INFO:tasks.workunit.client.1.smithi174.stdout:6/936: getdents d0/d25/d52/dba 0 2024-05-06T14:04:21.061 INFO:tasks.workunit.client.1.smithi174.stdout:3/691: readlink df/d2d/d87/lb5 0 2024-05-06T14:04:21.061 INFO:tasks.workunit.client.1.smithi174.stdout:1/767: truncate d11/d57/fd8 1097226 0 2024-05-06T14:04:21.061 INFO:tasks.workunit.client.1.smithi174.stdout:0/801: write d0/d3/d104/d17/d2e/fc0 [114303,52580] 0 2024-05-06T14:04:21.061 INFO:tasks.workunit.client.1.smithi174.stdout:3/692: creat df/d10/da2/fdc x:0 0 0 2024-05-06T14:04:21.061 INFO:tasks.workunit.client.1.smithi174.stdout:1/768: write d11/d1f/d27/d32/d84/ddc/fe6 [288165,33292] 0 2024-05-06T14:04:21.062 INFO:tasks.workunit.client.1.smithi174.stdout:1/769: getdents d11/d57/d98/daf 0 2024-05-06T14:04:21.062 INFO:tasks.workunit.client.1.smithi174.stdout:3/693: symlink df/d10/d1b/d7e/d5a/ldd 0 2024-05-06T14:04:21.062 INFO:tasks.workunit.client.1.smithi174.stdout:1/770: stat d11/d1f/d27/f2b 0 2024-05-06T14:04:21.062 INFO:tasks.workunit.client.1.smithi174.stdout:1/771: dread d11/d1f/d27/d32/d84/ffa [94208,12288] 0 2024-05-06T14:04:21.062 INFO:tasks.workunit.client.1.smithi174.stdout:1/772: write d11/d57/d98/f106 [551825,2554] 0 2024-05-06T14:04:21.062 INFO:tasks.workunit.client.1.smithi174.stdout:1/773: symlink d11/d57/d98/daf/l109 0 2024-05-06T14:04:21.062 INFO:tasks.workunit.client.1.smithi174.stdout:1/774: truncate d11/d1f/d27/d2d/f43 347070 0 2024-05-06T14:04:21.062 INFO:tasks.workunit.client.1.smithi174.stdout:1/775: chown d11/d1f/d27/d32/d92/dbc/cfe 86755 1 2024-05-06T14:04:21.063 INFO:tasks.workunit.client.1.smithi174.stdout:1/776: dread d11/f22 [356352,20480] 0 2024-05-06T14:04:21.063 INFO:tasks.workunit.client.1.smithi174.stdout:1/777: unlink d11/d1f/d27/d32/f4e 0 2024-05-06T14:04:21.063 INFO:tasks.workunit.client.1.smithi174.stdout:1/778: rmdir d11/d1f/d27/d32/d84/ddc 39 2024-05-06T14:04:21.063 INFO:tasks.workunit.client.1.smithi174.stdout:6/937: dwrite d0/df/f5e [491520,36864] 0 2024-05-06T14:04:21.063 INFO:tasks.workunit.client.1.smithi174.stdout:6/938: mkdir d0/df/d3c/d131 0 2024-05-06T14:04:21.063 INFO:tasks.workunit.client.1.smithi174.stdout:6/939: mknod d0/d25/d52/d2c/d105/d85/ddf/ded/d126/c132 0 2024-05-06T14:04:21.063 INFO:tasks.workunit.client.1.smithi174.stdout:6/940: mknod d0/df/d3c/df9/c133 0 2024-05-06T14:04:21.063 INFO:tasks.workunit.client.1.smithi174.stdout:6/941: write d0/d25/d52/d2c/f63 [2034371,19941] 0 2024-05-06T14:04:21.064 INFO:tasks.workunit.client.1.smithi174.stdout:6/942: creat d0/d25/d52/da6/f134 x:0 0 0 2024-05-06T14:04:21.064 INFO:tasks.workunit.client.1.smithi174.stdout:3/694: dwrite df/f90 [4096,90112] 0 2024-05-06T14:04:21.064 INFO:tasks.workunit.client.1.smithi174.stdout:3/695: chown df/d2d/d4d 61 1 2024-05-06T14:04:21.064 INFO:tasks.workunit.client.1.smithi174.stdout:1/779: dwrite d11/d57/d77/f7d [528384,81920] 0 2024-05-06T14:04:21.064 INFO:tasks.workunit.client.1.smithi174.stdout:1/780: creat d11/d1f/d27/d32/f10a x:0 0 0 2024-05-06T14:04:21.064 INFO:tasks.workunit.client.1.smithi174.stdout:1/781: dread - d11/d57/ff6 zero size 2024-05-06T14:04:21.064 INFO:tasks.workunit.client.1.smithi174.stdout:1/782: chown d11/c21 0 1 2024-05-06T14:04:21.064 INFO:tasks.workunit.client.1.smithi174.stdout:1/783: symlink d11/d1f/d27/d32/d84/d8c/d94/l10b 0 2024-05-06T14:04:21.064 INFO:tasks.workunit.client.1.smithi174.stdout:1/784: mkdir d11/d1f/d10c 0 2024-05-06T14:04:21.065 INFO:tasks.workunit.client.1.smithi174.stdout:1/785: write d11/d57/d83/f97 [458932,60911] 0 2024-05-06T14:04:21.065 INFO:tasks.workunit.client.1.smithi174.stdout:1/786: creat d11/d1f/d27/d32/d92/dbc/f10d x:0 0 0 2024-05-06T14:04:21.065 INFO:tasks.workunit.client.1.smithi174.stdout:1/787: creat d11/d57/d77/f10e x:0 0 0 2024-05-06T14:04:21.065 INFO:tasks.workunit.client.1.smithi174.stdout:1/788: rename d11/d41/dc9/f70 to d11/d57/d98/daf/db2/f10f 0 2024-05-06T14:04:21.065 INFO:tasks.workunit.client.1.smithi174.stdout:1/789: chown d11/d57/d77/f10e 26686 1 2024-05-06T14:04:21.067 INFO:tasks.workunit.client.1.smithi174.stdout:2/749: dread d0/d1/d2/d4/f6c [675840,73728] 0 2024-05-06T14:04:21.067 INFO:tasks.workunit.client.1.smithi174.stdout:2/750: rename d0/da/d3f/da6 to d0/d1/d2/d4/d18/de9 0 2024-05-06T14:04:21.067 INFO:tasks.workunit.client.1.smithi174.stdout:2/751: chown d0/db/f7b 2050 1 2024-05-06T14:04:21.067 INFO:tasks.workunit.client.1.smithi174.stdout:2/752: dread d0/d1/d2/d4/d6/fe [106496,36864] 0 2024-05-06T14:04:21.067 INFO:tasks.workunit.client.1.smithi174.stdout:2/753: stat d0/d92/f99 0 2024-05-06T14:04:21.067 INFO:tasks.workunit.client.1.smithi174.stdout:2/754: mknod d0/d1/d2/d4/d6/d3c/dc7/cea 0 2024-05-06T14:04:21.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/755: link d0/d24/c4f d0/d1/d2/d4/d6/d3c/dc7/ceb 0 2024-05-06T14:04:21.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/756: symlink d0/d1/d2/d1b/lec 0 2024-05-06T14:04:21.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/757: link d0/d1/d2/d2a/l52 d0/da/d3f/led 0 2024-05-06T14:04:21.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/758: truncate d0/d1/d2/d2a/fca 1807320 0 2024-05-06T14:04:21.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/759: unlink d0/d1/d2/d4/d18/de9/fd0 0 2024-05-06T14:04:21.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/760: rename d0/d24/d77/ce6 to d0/d1/d2/d4/d18/de9/cee 0 2024-05-06T14:04:21.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/761: rmdir d0/d1/d2/d4/d18/d2d/d32/d89 39 2024-05-06T14:04:21.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/762: rename d0/da/d3f/d67/fdf to d0/d24/d84/fef 0 2024-05-06T14:04:21.068 INFO:tasks.workunit.client.1.smithi174.stdout:2/763: truncate d0/da/f74 188989 0 2024-05-06T14:04:21.069 INFO:tasks.workunit.client.1.smithi174.stdout:2/764: write d0/db/d15/f2e [450990,83334] 0 2024-05-06T14:04:21.069 INFO:tasks.workunit.client.1.smithi174.stdout:2/765: chown d0/d24/d84/fef 6265 1 2024-05-06T14:04:21.154 INFO:tasks.workunit.client.1.smithi174.stdout:1/790: dwrite d11/d1f/d27/d32/d84/ddc/fe6 [720896,61440] 0 2024-05-06T14:04:21.154 INFO:tasks.workunit.client.1.smithi174.stdout:1/791: symlink d11/d41/dc9/d6c/l110 0 2024-05-06T14:04:21.155 INFO:tasks.workunit.client.1.smithi174.stdout:1/792: mkdir d11/d41/dc9/d6c/d111 0 2024-05-06T14:04:21.157 INFO:tasks.workunit.client.1.smithi174.stdout:2/766: dwrite d0/d1/d2/d4/d18/d2d/f6b [1126400,4096] 0 2024-05-06T14:04:21.157 INFO:tasks.workunit.client.1.smithi174.stdout:2/767: chown d0/d1/d2/d4/d43/lad 2666 1 2024-05-06T14:04:21.158 INFO:tasks.workunit.client.1.smithi174.stdout:2/768: link d0/d1/d2/d1b/c25 d0/da/d3f/d67/cf0 0 2024-05-06T14:04:21.158 INFO:tasks.workunit.client.1.smithi174.stdout:2/769: creat d0/d1/ff1 x:0 0 0 2024-05-06T14:04:21.158 INFO:tasks.workunit.client.1.smithi174.stdout:2/770: truncate d0/db/fa8 748336 0 2024-05-06T14:04:21.158 INFO:tasks.workunit.client.1.smithi174.stdout:6/943: write d0/df/d3c/f91 [2414064,17422] 0 2024-05-06T14:04:21.158 INFO:tasks.workunit.client.1.smithi174.stdout:2/771: rename d0/d1/f35 to d0/db/d15/ff2 0 2024-05-06T14:04:21.158 INFO:tasks.workunit.client.1.smithi174.stdout:2/772: creat d0/d1/d2/d4/ff3 x:0 0 0 2024-05-06T14:04:21.158 INFO:tasks.workunit.client.1.smithi174.stdout:2/773: write d0/d1/faa [948690,123931] 0 2024-05-06T14:04:21.159 INFO:tasks.workunit.client.1.smithi174.stdout:2/774: mknod d0/d1/d2/d2a/cf4 0 2024-05-06T14:04:21.197 INFO:tasks.workunit.client.1.smithi174.stdout:0/802: fsync d0/d4/d8/d25/f6f 0 2024-05-06T14:04:21.197 INFO:tasks.workunit.client.1.smithi174.stdout:0/803: symlink d0/d4/d8/l10e 0 2024-05-06T14:04:21.197 INFO:tasks.workunit.client.1.smithi174.stdout:8/920: fdatasync d4/de/d24/d5e/d85/d91/f12b 0 2024-05-06T14:04:21.197 INFO:tasks.workunit.client.1.smithi174.stdout:0/804: write d0/f59 [1089402,48941] 0 2024-05-06T14:04:21.197 INFO:tasks.workunit.client.1.smithi174.stdout:0/805: creat d0/d36/d3f/f10f x:0 0 0 2024-05-06T14:04:21.221 INFO:tasks.workunit.client.1.smithi174.stdout:3/696: fsync df/d10/f1c 0 2024-05-06T14:04:21.222 INFO:tasks.workunit.client.1.smithi174.stdout:3/697: creat df/d2d/d4e/db6/fde x:0 0 0 2024-05-06T14:04:21.222 INFO:tasks.workunit.client.1.smithi174.stdout:3/698: write df/d10/d1b/f2b [232017,47301] 0 2024-05-06T14:04:21.222 INFO:tasks.workunit.client.1.smithi174.stdout:3/699: chown df 14411942 1 2024-05-06T14:04:21.256 INFO:tasks.workunit.client.1.smithi174.stdout:8/921: fsync d4/de/f17 0 2024-05-06T14:04:21.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/944: dread d0/d25/d52/d2c/d105/da9/f109 [339968,110592] 0 2024-05-06T14:04:21.261 INFO:tasks.workunit.client.1.smithi174.stdout:2/775: dwrite d0/d24/d84/fce [12288,53248] 0 2024-05-06T14:04:21.261 INFO:tasks.workunit.client.1.smithi174.stdout:0/806: mkdir d0/d3/dfc/d110 0 2024-05-06T14:04:21.261 INFO:tasks.workunit.client.1.smithi174.stdout:8/922: creat d4/f131 x:0 0 0 2024-05-06T14:04:21.261 INFO:tasks.workunit.client.1.smithi174.stdout:8/923: chown d4/de/d23/d3c/db2/da6/dad 49 1 2024-05-06T14:04:21.261 INFO:tasks.workunit.client.1.smithi174.stdout:6/945: write d0/d25/d35/de3/f114 [96527,45407] 0 2024-05-06T14:04:21.261 INFO:tasks.workunit.client.1.smithi174.stdout:0/807: symlink d0/d3/dfc/l111 0 2024-05-06T14:04:21.262 INFO:tasks.workunit.client.1.smithi174.stdout:2/776: write d0/da/d3f/f71 [444520,68471] 0 2024-05-06T14:04:21.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/808: symlink d0/d4/d8/d25/d5c/ddb/l112 0 2024-05-06T14:04:21.262 INFO:tasks.workunit.client.1.smithi174.stdout:6/946: mkdir d0/d25/d52/d80/d10f/d12f/d135 0 2024-05-06T14:04:21.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/809: read d0/d3/d104/d17/d2e/f3c [341879,2898] 0 2024-05-06T14:04:21.263 INFO:tasks.workunit.client.1.smithi174.stdout:8/924: creat d4/de/d23/d3c/db2/da6/dad/d124/f132 x:0 0 0 2024-05-06T14:04:21.265 INFO:tasks.workunit.client.1.smithi174.stdout:6/947: truncate d0/d25/d52/d3b/f83 1015965 0 2024-05-06T14:04:21.265 INFO:tasks.workunit.client.1.smithi174.stdout:6/948: mkdir d0/d25/d52/dba/d136 0 2024-05-06T14:04:21.265 INFO:tasks.workunit.client.1.smithi174.stdout:6/949: rename d0/d25/d52/d2c/d5f/l96 to d0/d25/d52/d80/d10f/l137 0 2024-05-06T14:04:21.266 INFO:tasks.workunit.client.1.smithi174.stdout:6/950: truncate d0/d25/d52/da6/f134 733519 0 2024-05-06T14:04:21.266 INFO:tasks.workunit.client.1.smithi174.stdout:6/951: mkdir d0/df/d3c/d131/d138 0 2024-05-06T14:04:21.266 INFO:tasks.workunit.client.1.smithi174.stdout:6/952: write d0/d25/d35/fa4 [1436955,96442] 0 2024-05-06T14:04:21.266 INFO:tasks.workunit.client.1.smithi174.stdout:6/953: unlink d0/d25/d52/d4c/l6d 0 2024-05-06T14:04:21.266 INFO:tasks.workunit.client.1.smithi174.stdout:2/777: dwrite d0/db/d72/fdd [851968,81920] 0 2024-05-06T14:04:21.266 INFO:tasks.workunit.client.1.smithi174.stdout:6/954: read d0/d25/d52/d2c/d6f/f72 [519979,74550] 0 2024-05-06T14:04:21.266 INFO:tasks.workunit.client.1.smithi174.stdout:2/778: unlink d0/d1/d2/d4/f6c 0 2024-05-06T14:04:21.267 INFO:tasks.workunit.client.1.smithi174.stdout:6/955: symlink d0/d25/d52/d2c/d105/d4b/l139 0 2024-05-06T14:04:21.267 INFO:tasks.workunit.client.1.smithi174.stdout:6/956: creat d0/d25/d35/d122/f13a x:0 0 0 2024-05-06T14:04:21.267 INFO:tasks.workunit.client.1.smithi174.stdout:0/810: dwrite d0/d4/d8/d25/d5c/d44/f100 [32768,57344] 0 2024-05-06T14:04:21.267 INFO:tasks.workunit.client.1.smithi174.stdout:0/811: stat d0/d4/d8/d25/d5c/d4a/da7/cd2 0 2024-05-06T14:04:21.267 INFO:tasks.workunit.client.1.smithi174.stdout:0/812: readlink d0/d4/d8/lf8 0 2024-05-06T14:04:21.267 INFO:tasks.workunit.client.1.smithi174.stdout:0/813: readlink d0/d4/d8/d25/d5c/d4a/da7/leb 0 2024-05-06T14:04:21.267 INFO:tasks.workunit.client.1.smithi174.stdout:0/814: dread d0/d4/f37 [339968,8192] 0 2024-05-06T14:04:21.267 INFO:tasks.workunit.client.1.smithi174.stdout:0/815: write d0/d3/f8d [1302310,80089] 0 2024-05-06T14:04:21.267 INFO:tasks.workunit.client.1.smithi174.stdout:0/816: creat d0/d4/d80/d93/f113 x:0 0 0 2024-05-06T14:04:21.268 INFO:tasks.workunit.client.1.smithi174.stdout:8/925: dwrite d4/d15/d20/d3e/f54 [1396736,57344] 0 2024-05-06T14:04:21.375 INFO:tasks.workunit.client.1.smithi174.stdout:8/926: truncate d4/de/d24/d5e/d85/d91/fbe 1270016 0 2024-05-06T14:04:21.388 INFO:tasks.workunit.client.1.smithi174.stdout:6/957: write d0/d25/d52/d2c/f37 [196117,109272] 0 2024-05-06T14:04:21.388 INFO:tasks.workunit.client.1.smithi174.stdout:6/958: read d0/d25/d35/f9e [128414,101097] 0 2024-05-06T14:04:21.388 INFO:tasks.workunit.client.1.smithi174.stdout:6/959: dread d0/d93/fe2 [466944,126976] 0 2024-05-06T14:04:21.398 INFO:tasks.workunit.client.1.smithi174.stdout:2/779: dread d0/d1/d2/d4/d6/f88 [114688,57344] 0 2024-05-06T14:04:21.398 INFO:tasks.workunit.client.1.smithi174.stdout:2/780: unlink d0/d24/d77/fda 0 2024-05-06T14:04:21.435 INFO:tasks.workunit.client.1.smithi174.stdout:8/927: fsync d4/d15/d20/d3e/f93 0 2024-05-06T14:04:21.435 INFO:tasks.workunit.client.1.smithi174.stdout:0/817: fsync d0/d3/f29 0 2024-05-06T14:04:21.436 INFO:tasks.workunit.client.1.smithi174.stdout:8/928: dread d4/d15/d20/d3e/d79/dbf/fe2 [1658880,81920] 0 2024-05-06T14:04:21.436 INFO:tasks.workunit.client.1.smithi174.stdout:8/929: creat d4/de/d24/d46/d63/d117/f133 x:0 0 0 2024-05-06T14:04:21.436 INFO:tasks.workunit.client.1.smithi174.stdout:0/818: mkdir d0/d36/d45/d114 0 2024-05-06T14:04:21.436 INFO:tasks.workunit.client.1.smithi174.stdout:8/930: creat d4/d15/d20/f134 x:0 0 0 2024-05-06T14:04:21.436 INFO:tasks.workunit.client.1.smithi174.stdout:0/819: rename d0/d4/d8/d25/d5c/d4a/da7/leb to d0/d4/d8/d25/l115 0 2024-05-06T14:04:21.436 INFO:tasks.workunit.client.1.smithi174.stdout:8/931: write d4/de/d23/f92 [839507,47391] 0 2024-05-06T14:04:21.436 INFO:tasks.workunit.client.1.smithi174.stdout:8/932: mknod d4/de/d23/d41/d56/de6/c135 0 2024-05-06T14:04:21.436 INFO:tasks.workunit.client.1.smithi174.stdout:8/933: getdents d4/de/d23/d3c 0 2024-05-06T14:04:21.468 INFO:tasks.workunit.client.1.smithi174.stdout:0/820: fsync d0/d3/dfc/ff6 0 2024-05-06T14:04:21.469 INFO:tasks.workunit.client.1.smithi174.stdout:0/821: write d0/d36/f9b [1981652,10616] 0 2024-05-06T14:04:21.469 INFO:tasks.workunit.client.1.smithi174.stdout:0/822: write d0/d4/d8/d25/d5c/fa0 [1021659,69037] 0 2024-05-06T14:04:21.470 INFO:tasks.workunit.client.1.smithi174.stdout:0/823: unlink d0/d4/d8/d25/f9f 0 2024-05-06T14:04:21.470 INFO:tasks.workunit.client.1.smithi174.stdout:0/824: truncate d0/f59 2016012 0 2024-05-06T14:04:21.471 INFO:tasks.workunit.client.1.smithi174.stdout:0/825: readlink d0/d3/dfc/l111 0 2024-05-06T14:04:21.510 INFO:tasks.workunit.client.1.smithi174.stdout:0/826: dread d0/d4/f3d [2322432,98304] 0 2024-05-06T14:04:21.510 INFO:tasks.workunit.client.1.smithi174.stdout:0/827: mknod d0/d4/d8/d25/d5c/d4a/da7/d10b/c116 0 2024-05-06T14:04:21.510 INFO:tasks.workunit.client.1.smithi174.stdout:0/828: rename d0/d4/d8/d25/la5 to d0/d3/dad/l117 0 2024-05-06T14:04:21.510 INFO:tasks.workunit.client.1.smithi174.stdout:0/829: mkdir d0/d4/d8/d25/d5c/d44/dd5/d118 0 2024-05-06T14:04:21.554 INFO:tasks.workunit.client.1.smithi174.stdout:3/700: fdatasync df/d10/d1b/f2b 0 2024-05-06T14:04:21.560 INFO:tasks.workunit.client.1.smithi174.stdout:5/925: sync 2024-05-06T14:04:21.560 INFO:tasks.workunit.client.1.smithi174.stdout:9/718: sync 2024-05-06T14:04:21.560 INFO:tasks.workunit.client.1.smithi174.stdout:7/647: sync 2024-05-06T14:04:21.562 INFO:tasks.workunit.client.1.smithi174.stdout:0/830: dwrite d0/d36/f9b [1294336,114688] 0 2024-05-06T14:04:21.562 INFO:tasks.workunit.client.1.smithi174.stdout:9/719: creat dc/de/d7f/da4/ff4 x:0 0 0 2024-05-06T14:04:21.562 INFO:tasks.workunit.client.1.smithi174.stdout:9/720: read - dc/d27/d6d/dd7/fdd zero size 2024-05-06T14:04:21.562 INFO:tasks.workunit.client.1.smithi174.stdout:3/701: creat df/d2d/d4e/fdf x:0 0 0 2024-05-06T14:04:21.562 INFO:tasks.workunit.client.1.smithi174.stdout:5/926: mkdir d1/d6/df/d35/d8b/d9f/df8/d13a 0 2024-05-06T14:04:21.562 INFO:tasks.workunit.client.1.smithi174.stdout:9/721: mkdir dc/d27/d51/df5 0 2024-05-06T14:04:21.563 INFO:tasks.workunit.client.1.smithi174.stdout:0/831: mkdir d0/d3/dad/d119 0 2024-05-06T14:04:21.563 INFO:tasks.workunit.client.1.smithi174.stdout:5/927: dread - d1/fdb zero size 2024-05-06T14:04:21.563 INFO:tasks.workunit.client.1.smithi174.stdout:5/928: chown d1/ddf/l109 71555736 1 2024-05-06T14:04:21.563 INFO:tasks.workunit.client.1.smithi174.stdout:3/702: write df/d10/fc0 [621649,65048] 0 2024-05-06T14:04:21.563 INFO:tasks.workunit.client.1.smithi174.stdout:5/929: symlink d1/d6/d7/da1/dfc/l13b 0 2024-05-06T14:04:21.563 INFO:tasks.workunit.client.1.smithi174.stdout:9/722: write dc/d27/d63/fa3 [780671,91330] 0 2024-05-06T14:04:21.563 INFO:tasks.workunit.client.1.smithi174.stdout:5/930: symlink d1/d6/d7/d36/d53/d59/d61/l13c 0 2024-05-06T14:04:21.563 INFO:tasks.workunit.client.1.smithi174.stdout:9/723: creat dc/d17/d3a/db2/ff6 x:0 0 0 2024-05-06T14:04:21.564 INFO:tasks.workunit.client.1.smithi174.stdout:3/703: write df/f9c [192854,94820] 0 2024-05-06T14:04:21.564 INFO:tasks.workunit.client.1.smithi174.stdout:3/704: chown df/d10/d1b/c74 160 1 2024-05-06T14:04:21.625 INFO:tasks.workunit.client.1.smithi174.stdout:7/648: dwrite d0/d1d/da4/d61/d19/d24/d89/f94 [65536,126976] 0 2024-05-06T14:04:21.625 INFO:tasks.workunit.client.1.smithi174.stdout:7/649: stat d0/d1d/d9c/fce 0 2024-05-06T14:04:21.625 INFO:tasks.workunit.client.1.smithi174.stdout:7/650: chown d0/d1d/c2b 28819027 1 2024-05-06T14:04:21.650 INFO:tasks.workunit.client.1.smithi174.stdout:3/705: fdatasync df/d10/d1b/d7e/f6d 0 2024-05-06T14:04:21.651 INFO:tasks.workunit.client.1.smithi174.stdout:0/832: fdatasync d0/d4/d8/d25/d5c/f10c 0 2024-05-06T14:04:21.651 INFO:tasks.workunit.client.1.smithi174.stdout:5/931: fdatasync d1/d6/d7/d11b/f121 0 2024-05-06T14:04:21.651 INFO:tasks.workunit.client.1.smithi174.stdout:0/833: dread d0/d3/dad/f10a [90112,45056] 0 2024-05-06T14:04:21.651 INFO:tasks.workunit.client.1.smithi174.stdout:3/706: creat df/d2d/d5b/fe0 x:0 0 0 2024-05-06T14:04:21.651 INFO:tasks.workunit.client.1.smithi174.stdout:5/932: dread d1/d6/df/d35/d81/d8d/fb7 [290816,94208] 0 2024-05-06T14:04:21.651 INFO:tasks.workunit.client.1.smithi174.stdout:3/707: truncate df/f18 1075289 0 2024-05-06T14:04:21.652 INFO:tasks.workunit.client.1.smithi174.stdout:0/834: link d0/d36/d3f/l5b d0/d3/dfc/l11a 0 2024-05-06T14:04:21.652 INFO:tasks.workunit.client.1.smithi174.stdout:3/708: rename df to df/d2d/de1 22 2024-05-06T14:04:21.652 INFO:tasks.workunit.client.1.smithi174.stdout:5/933: dread - d1/d6/d7/d8e/f103 zero size 2024-05-06T14:04:21.652 INFO:tasks.workunit.client.1.smithi174.stdout:3/709: link df/d2d/d4e/fdf df/d10/d1b/d7e/d57/fe2 0 2024-05-06T14:04:21.652 INFO:tasks.workunit.client.1.smithi174.stdout:5/934: write d1/d6/d7/d36/fe8 [2152620,65101] 0 2024-05-06T14:04:21.652 INFO:tasks.workunit.client.1.smithi174.stdout:5/935: symlink d1/d6/d7/da1/d9a/l13d 0 2024-05-06T14:04:21.652 INFO:tasks.workunit.client.1.smithi174.stdout:5/936: dread - d1/d6/df/d35/d81/f10d zero size 2024-05-06T14:04:21.652 INFO:tasks.workunit.client.1.smithi174.stdout:5/937: read d1/d6/d7/da1/d9a/da5/fde [59157,43019] 0 2024-05-06T14:04:21.653 INFO:tasks.workunit.client.1.smithi174.stdout:5/938: rmdir d1/d6/d7/da1/d9a 39 2024-05-06T14:04:21.653 INFO:tasks.workunit.client.1.smithi174.stdout:5/939: truncate d1/d6/df/d35/d81/d60/db0/de/f3f 2492394 0 2024-05-06T14:04:21.653 INFO:tasks.workunit.client.1.smithi174.stdout:5/940: symlink d1/d6/df/d35/d81/d60/db0/de/d11a/l13e 0 2024-05-06T14:04:21.654 INFO:tasks.workunit.client.1.smithi174.stdout:7/651: dwrite d0/d1d/da4/d61/d19/d39/d90/da6/db6/fd2 [3555328,81920] 0 2024-05-06T14:04:21.655 INFO:tasks.workunit.client.1.smithi174.stdout:7/652: mknod d0/d1d/da4/d61/d19/d24/d47/d70/d67/cdf 0 2024-05-06T14:04:21.655 INFO:tasks.workunit.client.1.smithi174.stdout:7/653: getdents d0/d1d/d9c/dad 0 2024-05-06T14:04:21.655 INFO:tasks.workunit.client.1.smithi174.stdout:7/654: rename d0/d1d/da4/d61/fc9 to d0/d1d/da4/d61/d19/d24/d47/fe0 0 2024-05-06T14:04:21.655 INFO:tasks.workunit.client.1.smithi174.stdout:7/655: creat d0/d1d/da4/d61/d19/d39/d9e/fe1 x:0 0 0 2024-05-06T14:04:21.655 INFO:tasks.workunit.client.1.smithi174.stdout:7/656: creat d0/d1d/da4/d61/d28/d59/fe2 x:0 0 0 2024-05-06T14:04:21.655 INFO:tasks.workunit.client.1.smithi174.stdout:7/657: creat d0/d1d/da4/d61/d19/d24/d47/dc6/fe3 x:0 0 0 2024-05-06T14:04:21.655 INFO:tasks.workunit.client.1.smithi174.stdout:7/658: chown d0/d1d/da4/d61/fb9 7652 1 2024-05-06T14:04:21.655 INFO:tasks.workunit.client.1.smithi174.stdout:7/659: symlink d0/d3a/dd7/le4 0 2024-05-06T14:04:21.656 INFO:tasks.workunit.client.1.smithi174.stdout:7/660: mkdir d0/d1d/d9c/dad/dda/de5 0 2024-05-06T14:04:21.664 INFO:tasks.workunit.client.1.smithi174.stdout:7/661: rename d0/la7 to d0/d1d/da4/d61/d19/d24/d47/dc6/le6 0 2024-05-06T14:04:21.664 INFO:tasks.workunit.client.1.smithi174.stdout:3/710: dread df/d10/d1b/d7e/f6d [450560,102400] 0 2024-05-06T14:04:21.664 INFO:tasks.workunit.client.1.smithi174.stdout:7/662: rename d0/d1d/da4/d61/d19/d24/fbb to d0/d1d/da4/d61/d19/db7/fe7 0 2024-05-06T14:04:21.664 INFO:tasks.workunit.client.1.smithi174.stdout:7/663: read - d0/d1d/da4/d61/d19/d39/d46/fab zero size 2024-05-06T14:04:21.664 INFO:tasks.workunit.client.1.smithi174.stdout:7/664: write d0/d1d/f2c [100893,32091] 0 2024-05-06T14:04:21.665 INFO:tasks.workunit.client.1.smithi174.stdout:3/711: mkdir df/d2d/d4e/d81/de3 0 2024-05-06T14:04:21.665 INFO:tasks.workunit.client.1.smithi174.stdout:3/712: dread - df/d2d/d4e/fdf zero size 2024-05-06T14:04:21.665 INFO:tasks.workunit.client.1.smithi174.stdout:3/713: stat df/d10/d1b/d7e/lb7 0 2024-05-06T14:04:21.665 INFO:tasks.workunit.client.1.smithi174.stdout:3/714: stat df/d2d/d4e/db6/db9 0 2024-05-06T14:04:21.665 INFO:tasks.workunit.client.1.smithi174.stdout:3/715: write df/d10/d1b/f7f [608939,41858] 0 2024-05-06T14:04:21.665 INFO:tasks.workunit.client.1.smithi174.stdout:7/665: unlink d0/f6 0 2024-05-06T14:04:21.665 INFO:tasks.workunit.client.1.smithi174.stdout:7/666: creat d0/d1d/d9c/dad/dda/de5/fe8 x:0 0 0 2024-05-06T14:04:21.666 INFO:tasks.workunit.client.1.smithi174.stdout:7/667: mkdir d0/d1d/da4/d61/d19/d39/d90/de9 0 2024-05-06T14:04:21.666 INFO:tasks.workunit.client.1.smithi174.stdout:7/668: write d0/d1d/da4/d61/d19/d24/d6f/d88/f8d [867374,109622] 0 2024-05-06T14:04:21.667 INFO:tasks.workunit.client.1.smithi174.stdout:3/716: dwrite df/d10/da2/fdc [102400,90112] 0 2024-05-06T14:04:21.667 INFO:tasks.workunit.client.1.smithi174.stdout:3/717: write df/d10/d1b/f7f [1013029,28289] 0 2024-05-06T14:04:21.667 INFO:tasks.workunit.client.1.smithi174.stdout:3/718: write df/d2d/f6c [134067,55827] 0 2024-05-06T14:04:21.667 INFO:tasks.workunit.client.1.smithi174.stdout:3/719: write df/d10/d1b/d7e/d5a/f6a [1043888,110649] 0 2024-05-06T14:04:21.667 INFO:tasks.workunit.client.1.smithi174.stdout:5/941: write d1/d6/d7/d3e/d4c/fbe [268143,54034] 0 2024-05-06T14:04:21.675 INFO:tasks.workunit.client.1.smithi174.stdout:3/720: getdents df/d2d/d4e/db6/db8/dd9 0 2024-05-06T14:04:21.675 INFO:tasks.workunit.client.1.smithi174.stdout:5/942: mknod d1/d6/d7/d36/c13f 0 2024-05-06T14:04:21.675 INFO:tasks.workunit.client.1.smithi174.stdout:3/721: dread df/d2d/d4e/db6/fc1 [90112,4096] 0 2024-05-06T14:04:21.675 INFO:tasks.workunit.client.1.smithi174.stdout:7/669: write d0/d1d/da4/d61/d19/d24/d14/d52/f8c [275194,31436] 0 2024-05-06T14:04:21.675 INFO:tasks.workunit.client.1.smithi174.stdout:5/943: dread - d1/d6/d7/d36/d53/d59/d61/d69/dc3/d134/f137 zero size 2024-05-06T14:04:21.676 INFO:tasks.workunit.client.1.smithi174.stdout:7/670: getdents d0/d1d/da4/d61/d19/d24/d47 0 2024-05-06T14:04:21.815 INFO:tasks.workunit.client.1.smithi174.stdout:5/944: dwrite d1/d6/d7/d36/f7f [1495040,28672] 0 2024-05-06T14:04:21.829 INFO:tasks.workunit.client.1.smithi174.stdout:7/671: read d0/d1d/da4/d61/d19/f5b [601715,56634] 0 2024-05-06T14:04:21.829 INFO:tasks.workunit.client.1.smithi174.stdout:7/672: chown d0/d1d/da4/d61/d19/c73 95835 1 2024-05-06T14:04:21.862 INFO:tasks.workunit.client.1.smithi174.stdout:7/673: fsync d0/d1d/da4/d61/d28/d37/f4e 0 2024-05-06T14:04:21.862 INFO:tasks.workunit.client.1.smithi174.stdout:5/945: fdatasync d1/d6/d7/da1/dd8/f125 0 2024-05-06T14:04:21.868 INFO:tasks.workunit.client.1.smithi174.stdout:7/674: creat d0/d1d/da4/d61/d19/d39/d46/fea x:0 0 0 2024-05-06T14:04:21.868 INFO:tasks.workunit.client.1.smithi174.stdout:5/946: creat d1/d6/d7/da1/dd8/de7/f140 x:0 0 0 2024-05-06T14:04:21.868 INFO:tasks.workunit.client.1.smithi174.stdout:7/675: dread - d0/d1d/da4/d61/d19/d39/fa2 zero size 2024-05-06T14:04:21.869 INFO:tasks.workunit.client.1.smithi174.stdout:7/676: mkdir d0/d1d/da4/d61/d28/db1/deb 0 2024-05-06T14:04:21.869 INFO:tasks.workunit.client.1.smithi174.stdout:5/947: write d1/d6/df/d35/d81/d60/db0/de/f80 [2457121,118577] 0 2024-05-06T14:04:21.869 INFO:tasks.workunit.client.1.smithi174.stdout:5/948: mkdir d1/d6/d7/d36/d53/d59/d141 0 2024-05-06T14:04:21.869 INFO:tasks.workunit.client.1.smithi174.stdout:5/949: unlink d1/d6/d7/d3e/c10a 0 2024-05-06T14:04:21.869 INFO:tasks.workunit.client.1.smithi174.stdout:7/677: write d0/d1d/da4/d61/fb9 [463843,100643] 0 2024-05-06T14:04:21.869 INFO:tasks.workunit.client.1.smithi174.stdout:5/950: symlink d1/d6/d7/da1/dd8/l142 0 2024-05-06T14:04:21.869 INFO:tasks.workunit.client.1.smithi174.stdout:7/678: getdents d0/d1d/d9c 0 2024-05-06T14:04:21.869 INFO:tasks.workunit.client.1.smithi174.stdout:7/679: stat d0/d1d/da4/d61/d19/d24/d47/d70/d67/l9d 0 2024-05-06T14:04:21.870 INFO:tasks.workunit.client.1.smithi174.stdout:5/951: mkdir d1/d6/d7/d36/d53/d59/d141/d143 0 2024-05-06T14:04:21.870 INFO:tasks.workunit.client.1.smithi174.stdout:7/680: link d0/d1d/da4/d61/d19/d24/f7e d0/d1d/da4/d61/d28/fec 0 2024-05-06T14:04:21.870 INFO:tasks.workunit.client.1.smithi174.stdout:5/952: chown d1/d6/df/d35/d81/d60/db0/d41/fcf 0 1 2024-05-06T14:04:21.870 INFO:tasks.workunit.client.1.smithi174.stdout:7/681: readlink d0/d3a/lbe 0 2024-05-06T14:04:21.870 INFO:tasks.workunit.client.1.smithi174.stdout:5/953: getdents d1/ddf 0 2024-05-06T14:04:21.870 INFO:tasks.workunit.client.1.smithi174.stdout:5/954: dread d1/d6/d7/d3e/fbc [569344,114688] 0 2024-05-06T14:04:21.870 INFO:tasks.workunit.client.1.smithi174.stdout:5/955: stat d1/d6/df/d35/d81/d1e/l37 0 2024-05-06T14:04:21.870 INFO:tasks.workunit.client.1.smithi174.stdout:5/956: chown d1/d6/df/l20 34471 1 2024-05-06T14:04:21.871 INFO:tasks.workunit.client.1.smithi174.stdout:5/957: creat d1/d6/df/d35/d81/d60/d82/f144 x:0 0 0 2024-05-06T14:04:21.871 INFO:tasks.workunit.client.1.smithi174.stdout:5/958: rename d1/d6/d7/da1/dd8/f125 to d1/ddf/f145 0 2024-05-06T14:04:21.871 INFO:tasks.workunit.client.1.smithi174.stdout:5/959: dread - d1/d6/df/d35/d81/d60/db0/d41/fcf zero size 2024-05-06T14:04:21.871 INFO:tasks.workunit.client.1.smithi174.stdout:5/960: dwrite d1/d6/df/d35/d81/d60/f135 [827392,102400] 0 2024-05-06T14:04:21.871 INFO:tasks.workunit.client.1.smithi174.stdout:5/961: write d1/d6/df/d35/d81/d60/db0/f25 [1004259,37111] 0 2024-05-06T14:04:21.871 INFO:tasks.workunit.client.1.smithi174.stdout:5/962: creat d1/d6/d7/d36/d53/d59/d141/d143/f146 x:0 0 0 2024-05-06T14:04:21.871 INFO:tasks.workunit.client.1.smithi174.stdout:5/963: mknod d1/d6/df/d35/d129/c147 0 2024-05-06T14:04:21.871 INFO:tasks.workunit.client.1.smithi174.stdout:5/964: read d1/d6/df/d35/d81/d60/db0/de/f26 [1331120,117570] 0 2024-05-06T14:04:21.953 INFO:tasks.workunit.client.1.smithi174.stdout:7/682: fdatasync d0/d1d/da4/d61/d19/d24/d47/dc6/fe3 0 2024-05-06T14:04:21.953 INFO:tasks.workunit.client.1.smithi174.stdout:7/683: write d0/d1d/da4/f4b [1508235,54266] 0 2024-05-06T14:04:21.956 INFO:tasks.workunit.client.1.smithi174.stdout:7/684: rename d0 to d0/d1d/da4/d61/ded 22 2024-05-06T14:04:21.956 INFO:tasks.workunit.client.1.smithi174.stdout:7/685: chown d0/d1d/da4/d61/d28/d37/ca5 36022993 1 2024-05-06T14:04:22.000 INFO:tasks.workunit.client.1.smithi174.stdout:5/965: fsync d1/d6/d7/d36/f47 0 2024-05-06T14:04:22.000 INFO:tasks.workunit.client.1.smithi174.stdout:5/966: creat d1/d6/d7/d36/d53/d59/d141/d143/f148 x:0 0 0 2024-05-06T14:04:22.000 INFO:tasks.workunit.client.1.smithi174.stdout:5/967: write d1/d6/d7/d8e/fed [656511,83248] 0 2024-05-06T14:04:22.001 INFO:tasks.workunit.client.1.smithi174.stdout:5/968: unlink d1/d6/d7/da1/dfc/c130 0 2024-05-06T14:04:22.004 INFO:tasks.workunit.client.1.smithi174.stdout:5/969: dwrite d1/f11d [352256,106496] 0 2024-05-06T14:04:22.004 INFO:tasks.workunit.client.1.smithi174.stdout:5/970: mknod d1/d6/d7/d36/d53/d59/d61/d69/dc3/c149 0 2024-05-06T14:04:22.008 INFO:tasks.workunit.client.1.smithi174.stdout:5/971: link d1/d6/d7/da1/d9a/cdd d1/d6/df/d35/d81/d60/db0/de/c14a 0 2024-05-06T14:04:22.009 INFO:tasks.workunit.client.1.smithi174.stdout:7/686: dwrite d0/d1d/da4/d61/d28/f62 [118784,20480] 0 2024-05-06T14:04:22.009 INFO:tasks.workunit.client.1.smithi174.stdout:5/972: creat d1/d6/d7/d36/d53/f14b x:0 0 0 2024-05-06T14:04:22.009 INFO:tasks.workunit.client.1.smithi174.stdout:7/687: creat d0/d1d/da4/d61/d28/d37/fee x:0 0 0 2024-05-06T14:04:22.009 INFO:tasks.workunit.client.1.smithi174.stdout:7/688: rmdir d0/d1d/da4/d61/d19/d24/d47/d64 39 2024-05-06T14:04:22.011 INFO:tasks.workunit.client.1.smithi174.stdout:5/973: dwrite d1/d6/d7/da1/d9a/ff0 [1015808,40960] 0 2024-05-06T14:04:22.012 INFO:tasks.workunit.client.1.smithi174.stdout:5/974: rename d1/d6/d7/da1/fad to d1/d6/d7/da1/f14c 0 2024-05-06T14:04:22.012 INFO:tasks.workunit.client.1.smithi174.stdout:7/689: dwrite d0/d1d/da4/d61/d28/d59/da1/faf [487424,20480] 0 2024-05-06T14:04:22.012 INFO:tasks.workunit.client.1.smithi174.stdout:8/934: sync 2024-05-06T14:04:22.012 INFO:tasks.workunit.client.1.smithi174.stdout:2/781: sync 2024-05-06T14:04:22.012 INFO:tasks.workunit.client.1.smithi174.stdout:9/724: sync 2024-05-06T14:04:22.012 INFO:tasks.workunit.client.1.smithi174.stdout:1/793: sync 2024-05-06T14:04:22.012 INFO:tasks.workunit.client.1.smithi174.stdout:6/960: sync 2024-05-06T14:04:22.012 INFO:tasks.workunit.client.1.smithi174.stdout:8/935: dread d4/d15/d20/d3e/f62 [565248,126976] 0 2024-05-06T14:04:22.013 INFO:tasks.workunit.client.1.smithi174.stdout:6/961: dread d0/d25/d52/d2c/d5f/daa/fc6 [1191936,49152] 0 2024-05-06T14:04:22.013 INFO:tasks.workunit.client.1.smithi174.stdout:9/725: read dc/f4e [65145,57096] 0 2024-05-06T14:04:22.013 INFO:tasks.workunit.client.1.smithi174.stdout:1/794: getdents d11 0 2024-05-06T14:04:22.013 INFO:tasks.workunit.client.1.smithi174.stdout:8/936: chown d4/de/d23/l116 330997 1 2024-05-06T14:04:22.013 INFO:tasks.workunit.client.1.smithi174.stdout:6/962: getdents d0/d93 0 2024-05-06T14:04:22.013 INFO:tasks.workunit.client.1.smithi174.stdout:1/795: mknod d11/d1f/c112 0 2024-05-06T14:04:22.013 INFO:tasks.workunit.client.1.smithi174.stdout:8/937: creat d4/d53/f136 x:0 0 0 2024-05-06T14:04:22.013 INFO:tasks.workunit.client.1.smithi174.stdout:8/938: readlink d4/de/d23/d3c/db2/da6/leb 0 2024-05-06T14:04:22.014 INFO:tasks.workunit.client.1.smithi174.stdout:8/939: dread d4/de/d23/d3c/db2/f8f [385024,53248] 0 2024-05-06T14:04:22.014 INFO:tasks.workunit.client.1.smithi174.stdout:9/726: write dc/de/d7f/d93/fac [865541,79498] 0 2024-05-06T14:04:22.014 INFO:tasks.workunit.client.1.smithi174.stdout:8/940: getdents d4/de/d24/d46/d63/d117/d128 0 2024-05-06T14:04:22.014 INFO:tasks.workunit.client.1.smithi174.stdout:8/941: read d4/d15/d20/f44 [477767,40972] 0 2024-05-06T14:04:22.014 INFO:tasks.workunit.client.1.smithi174.stdout:8/942: dread - d4/de/d24/d46/d63/d117/d128/f12c zero size 2024-05-06T14:04:22.110 INFO:tasks.workunit.client.1.smithi174.stdout:8/943: dwrite d4/de/d23/d3c/ffc [921600,98304] 0 2024-05-06T14:04:22.110 INFO:tasks.workunit.client.1.smithi174.stdout:1/796: creat d11/d1f/d27/d32/d92/dbc/f113 x:0 0 0 2024-05-06T14:04:22.110 INFO:tasks.workunit.client.1.smithi174.stdout:1/797: chown d11/d41/d4a/d5e 5962701 1 2024-05-06T14:04:22.111 INFO:tasks.workunit.client.1.smithi174.stdout:6/963: mkdir d0/df/d3c/df9/d13b 0 2024-05-06T14:04:22.111 INFO:tasks.workunit.client.1.smithi174.stdout:6/964: chown d0/d25/d52/d2c/d105/da9/lbf 54 1 2024-05-06T14:04:22.111 INFO:tasks.workunit.client.1.smithi174.stdout:6/965: rename d0/df/d3c/d131 to d0/d25/d52/d80/d10f/d12f/d13c 0 2024-05-06T14:04:22.111 INFO:tasks.workunit.client.1.smithi174.stdout:7/690: dread d0/d3a/f6a [462848,57344] 0 2024-05-06T14:04:22.111 INFO:tasks.workunit.client.1.smithi174.stdout:1/798: write d11/d1f/d27/d32/d84/d8c/f9d [355760,93576] 0 2024-05-06T14:04:22.111 INFO:tasks.workunit.client.1.smithi174.stdout:6/966: read d0/d25/d52/d2c/d105/d4b/fc5 [340307,61040] 0 2024-05-06T14:04:22.111 INFO:tasks.workunit.client.1.smithi174.stdout:6/967: read d0/d25/d52/d2c/d5f/fd4 [182389,9871] 0 2024-05-06T14:04:22.111 INFO:tasks.workunit.client.1.smithi174.stdout:6/968: stat d0/d25/d52/d2c/c10a 0 2024-05-06T14:04:22.112 INFO:tasks.workunit.client.1.smithi174.stdout:6/969: write d0/d25/d52/d4c/fff [270682,27318] 0 2024-05-06T14:04:22.112 INFO:tasks.workunit.client.1.smithi174.stdout:1/799: write d11/f20 [1183853,88635] 0 2024-05-06T14:04:22.112 INFO:tasks.workunit.client.1.smithi174.stdout:6/970: mknod d0/d25/d35/de3/dfb/c13d 0 2024-05-06T14:04:22.112 INFO:tasks.workunit.client.1.smithi174.stdout:1/800: write d11/d1f/d27/f45 [1378623,52281] 0 2024-05-06T14:04:22.112 INFO:tasks.workunit.client.1.smithi174.stdout:6/971: creat d0/d25/d52/d2c/d105/da9/d11c/f13e x:0 0 0 2024-05-06T14:04:22.112 INFO:tasks.workunit.client.1.smithi174.stdout:6/972: write d0/df/f5e [33004,19094] 0 2024-05-06T14:04:22.112 INFO:tasks.workunit.client.1.smithi174.stdout:6/973: dread - d0/d25/d52/d2c/d5f/daa/f127 zero size 2024-05-06T14:04:22.112 INFO:tasks.workunit.client.1.smithi174.stdout:6/974: truncate d0/d93/fe2 218519 0 2024-05-06T14:04:22.146 INFO:tasks.workunit.client.1.smithi174.stdout:8/944: fsync d4/d15/d20/f134 0 2024-05-06T14:04:22.147 INFO:tasks.workunit.client.1.smithi174.stdout:2/782: fsync d0/d1/d2/d4/d18/fa0 0 2024-05-06T14:04:22.147 INFO:tasks.workunit.client.1.smithi174.stdout:9/727: fsync dc/d17/db8/ff2 0 2024-05-06T14:04:22.147 INFO:tasks.workunit.client.1.smithi174.stdout:7/691: fdatasync d0/d1d/da4/d61/d19/d24/fd9 0 2024-05-06T14:04:22.147 INFO:tasks.workunit.client.1.smithi174.stdout:2/783: unlink d0/d16/la5 0 2024-05-06T14:04:22.147 INFO:tasks.workunit.client.1.smithi174.stdout:9/728: dread dc/d17/d3a/dcb/f69 [331776,20480] 0 2024-05-06T14:04:22.147 INFO:tasks.workunit.client.1.smithi174.stdout:9/729: rmdir dc/d17/d3a/d8d 39 2024-05-06T14:04:22.147 INFO:tasks.workunit.client.1.smithi174.stdout:7/692: creat d0/d1d/da4/d61/fef x:0 0 0 2024-05-06T14:04:22.148 INFO:tasks.workunit.client.1.smithi174.stdout:2/784: dread d0/d1/d2/f54 [778240,106496] 0 2024-05-06T14:04:22.148 INFO:tasks.workunit.client.1.smithi174.stdout:8/945: mkdir d4/de/d24/d46/d63/d137 0 2024-05-06T14:04:22.148 INFO:tasks.workunit.client.1.smithi174.stdout:8/946: dread - d4/f131 zero size 2024-05-06T14:04:22.148 INFO:tasks.workunit.client.1.smithi174.stdout:8/947: read - d4/de/d24/d5e/fc4 zero size 2024-05-06T14:04:22.148 INFO:tasks.workunit.client.1.smithi174.stdout:8/948: chown d4/lb3 0 1 2024-05-06T14:04:22.148 INFO:tasks.workunit.client.1.smithi174.stdout:2/785: mkdir d0/d1/d2/d4/d6/dd8/df5 0 2024-05-06T14:04:22.148 INFO:tasks.workunit.client.1.smithi174.stdout:8/949: write d4/d15/d20/f44 [1616918,43571] 0 2024-05-06T14:04:22.148 INFO:tasks.workunit.client.1.smithi174.stdout:8/950: chown d4/de/d23/d3c/cd8 275942500 1 2024-05-06T14:04:22.151 INFO:tasks.workunit.client.1.smithi174.stdout:1/801: dwrite d11/d1f/d27/d32/d84/d8c/fa4 [2023424,61440] 0 2024-05-06T14:04:22.151 INFO:tasks.workunit.client.1.smithi174.stdout:1/802: write d11/d1f/d27/d32/f59 [1314236,45634] 0 2024-05-06T14:04:22.151 INFO:tasks.workunit.client.1.smithi174.stdout:1/803: write d11/d1f/d27/d32/d84/fe5 [280180,38498] 0 2024-05-06T14:04:22.151 INFO:tasks.workunit.client.1.smithi174.stdout:1/804: rmdir d11/d1f/d27/d2d 39 2024-05-06T14:04:22.151 INFO:tasks.workunit.client.1.smithi174.stdout:6/975: dwrite d0/df/f1f [2588672,73728] 0 2024-05-06T14:04:22.151 INFO:tasks.workunit.client.1.smithi174.stdout:6/976: creat d0/df/d3c/df9/f13f x:0 0 0 2024-05-06T14:04:22.151 INFO:tasks.workunit.client.1.smithi174.stdout:6/977: rmdir d0/d25/d52/d80 39 2024-05-06T14:04:22.152 INFO:tasks.workunit.client.1.smithi174.stdout:6/978: stat d0/d25/d52/d2c/c70 0 2024-05-06T14:04:22.152 INFO:tasks.workunit.client.1.smithi174.stdout:6/979: unlink d0/d93/f10b 0 2024-05-06T14:04:22.152 INFO:tasks.workunit.client.1.smithi174.stdout:6/980: mknod d0/d25/d52/d2c/d5f/daa/c140 0 2024-05-06T14:04:22.152 INFO:tasks.workunit.client.1.smithi174.stdout:6/981: write d0/d25/d52/d2c/d5f/ff8 [1824048,47036] 0 2024-05-06T14:04:22.152 INFO:tasks.workunit.client.1.smithi174.stdout:9/730: mknod dc/df/de8/cf7 0 2024-05-06T14:04:22.152 INFO:tasks.workunit.client.1.smithi174.stdout:2/786: truncate d0/db/d15/f6f 611377 0 2024-05-06T14:04:22.152 INFO:tasks.workunit.client.1.smithi174.stdout:2/787: dread d0/d1/d2/d4/d6/f7a [876544,49152] 0 2024-05-06T14:04:22.152 INFO:tasks.workunit.client.1.smithi174.stdout:9/731: mknod dc/d9b/dd4/cf8 0 2024-05-06T14:04:22.153 INFO:tasks.workunit.client.1.smithi174.stdout:9/732: dread - dc/d1c/f7d zero size 2024-05-06T14:04:22.153 INFO:tasks.workunit.client.1.smithi174.stdout:9/733: dread dc/d17/d3a/dcb/daf/d43/f4d [28672,81920] 0 2024-05-06T14:04:22.153 INFO:tasks.workunit.client.1.smithi174.stdout:2/788: symlink d0/d1/d2/d4/d18/d2d/dd1/lf6 0 2024-05-06T14:04:22.153 INFO:tasks.workunit.client.1.smithi174.stdout:2/789: symlink d0/d1/d2/d4/d43/lf7 0 2024-05-06T14:04:22.153 INFO:tasks.workunit.client.1.smithi174.stdout:9/734: write dc/de/d7f/da4/fc4 [340414,125898] 0 2024-05-06T14:04:22.259 INFO:tasks.workunit.client.1.smithi174.stdout:7/693: fdatasync d0/d1d/da4/d61/d19/d24/f48 0 2024-05-06T14:04:22.260 INFO:tasks.workunit.client.1.smithi174.stdout:7/694: unlink d0/c65 0 2024-05-06T14:04:22.260 INFO:tasks.workunit.client.1.smithi174.stdout:7/695: dread d0/d1d/da4/d61/d19/d24/f7e [454656,4096] 0 2024-05-06T14:04:22.260 INFO:tasks.workunit.client.1.smithi174.stdout:7/696: rmdir d0/d1d/da4/d61/d28 39 2024-05-06T14:04:22.262 INFO:tasks.workunit.client.1.smithi174.stdout:0/835: sync 2024-05-06T14:04:22.262 INFO:tasks.workunit.client.1.smithi174.stdout:3/722: sync 2024-05-06T14:04:22.262 INFO:tasks.workunit.client.1.smithi174.stdout:3/723: symlink df/d10/d1b/d7e/d57/le4 0 2024-05-06T14:04:22.269 INFO:tasks.workunit.client.1.smithi174.stdout:7/697: truncate d0/d1d/da4/d61/d19/d24/d14/d52/f92 742703 0 2024-05-06T14:04:22.270 INFO:tasks.workunit.client.1.smithi174.stdout:8/951: dwrite d4/de/d24/d46/d63/d117/f133 [221184,53248] 0 2024-05-06T14:04:22.270 INFO:tasks.workunit.client.1.smithi174.stdout:7/698: chown d0/d1d/da4/d61/d19/d24/f87 714985 1 2024-05-06T14:04:22.270 INFO:tasks.workunit.client.1.smithi174.stdout:0/836: symlink d0/d4/d8/d25/d5c/d44/dd5/d38/l11b 0 2024-05-06T14:04:22.270 INFO:tasks.workunit.client.1.smithi174.stdout:8/952: readlink d4/de/d24/d5e/lc9 0 2024-05-06T14:04:22.270 INFO:tasks.workunit.client.1.smithi174.stdout:1/805: dwrite d11/d1f/fa7 [335872,53248] 0 2024-05-06T14:04:22.270 INFO:tasks.workunit.client.1.smithi174.stdout:8/953: read d4/de/d23/d3c/db2/da6/f12a [1809402,25721] 0 2024-05-06T14:04:22.270 INFO:tasks.workunit.client.1.smithi174.stdout:7/699: creat d0/d1d/da4/d61/d28/db1/deb/ff0 x:0 0 0 2024-05-06T14:04:22.271 INFO:tasks.workunit.client.1.smithi174.stdout:0/837: creat d0/d3/dad/d119/f11c x:0 0 0 2024-05-06T14:04:22.271 INFO:tasks.workunit.client.1.smithi174.stdout:1/806: creat d11/d41/dc9/d6c/d111/f114 x:0 0 0 2024-05-06T14:04:22.271 INFO:tasks.workunit.client.1.smithi174.stdout:7/700: truncate d0/d1d/da4/d61/d19/d24/d47/d70/d67/f86 1722462 0 2024-05-06T14:04:22.271 INFO:tasks.workunit.client.1.smithi174.stdout:0/838: dread d0/f59 [1204224,98304] 0 2024-05-06T14:04:22.271 INFO:tasks.workunit.client.1.smithi174.stdout:7/701: rmdir d0/d1d/da4/d61/d19/d24/d14/d52 39 2024-05-06T14:04:22.271 INFO:tasks.workunit.client.1.smithi174.stdout:8/954: rename d4/de/d23/l105 to d4/de/d23/d3c/db2/da6/dad/l138 0 2024-05-06T14:04:22.271 INFO:tasks.workunit.client.1.smithi174.stdout:1/807: rename d11/d41/f66 to d11/f115 0 2024-05-06T14:04:22.272 INFO:tasks.workunit.client.1.smithi174.stdout:0/839: unlink d0/d3/dad/f9a 0 2024-05-06T14:04:22.272 INFO:tasks.workunit.client.1.smithi174.stdout:1/808: mknod d11/d41/dc9/d6c/c116 0 2024-05-06T14:04:22.272 INFO:tasks.workunit.client.1.smithi174.stdout:8/955: mknod d4/de/d23/d3c/db2/da6/dad/de9/c139 0 2024-05-06T14:04:22.272 INFO:tasks.workunit.client.1.smithi174.stdout:0/840: rename d0/d4/d8/d25/c77 to d0/d4/d8/d25/d5c/d44/dd5/d118/c11d 0 2024-05-06T14:04:22.272 INFO:tasks.workunit.client.1.smithi174.stdout:1/809: chown d11/f20 0 1 2024-05-06T14:04:22.272 INFO:tasks.workunit.client.1.smithi174.stdout:0/841: symlink d0/d3/d104/d17/l11e 0 2024-05-06T14:04:22.272 INFO:tasks.workunit.client.1.smithi174.stdout:0/842: link d0/d3/d104/d17/d2e/c81 d0/d4/d8/d25/d5c/d44/c11f 0 2024-05-06T14:04:22.272 INFO:tasks.workunit.client.1.smithi174.stdout:0/843: rmdir d0/d4 39 2024-05-06T14:04:22.273 INFO:tasks.workunit.client.1.smithi174.stdout:1/810: unlink d11/f22 0 2024-05-06T14:04:22.273 INFO:tasks.workunit.client.1.smithi174.stdout:1/811: readlink d11/d41/dc9/d6c/l110 0 2024-05-06T14:04:22.273 INFO:tasks.workunit.client.1.smithi174.stdout:1/812: rmdir d11/d57 39 2024-05-06T14:04:22.273 INFO:tasks.workunit.client.1.smithi174.stdout:1/813: mknod d11/d1f/d27/d32/d92/c117 0 2024-05-06T14:04:22.273 INFO:tasks.workunit.client.1.smithi174.stdout:1/814: creat d11/d1f/d27/d32/d84/f118 x:0 0 0 2024-05-06T14:04:22.273 INFO:tasks.workunit.client.1.smithi174.stdout:1/815: stat d11/d1f/d27/d32/d84/d8c/f9d 0 2024-05-06T14:04:22.273 INFO:tasks.workunit.client.1.smithi174.stdout:1/816: creat d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/d107/f119 x:0 0 0 2024-05-06T14:04:22.274 INFO:tasks.workunit.client.1.smithi174.stdout:9/735: dread dc/d1c/f38 [282624,49152] 0 2024-05-06T14:04:22.275 INFO:tasks.workunit.client.1.smithi174.stdout:9/736: rename dc/d17/d3a/dcb/lb6 to dc/d17/d3a/dcb/lf9 0 2024-05-06T14:04:22.275 INFO:tasks.workunit.client.1.smithi174.stdout:9/737: rename dc/d17/d3a/dcb/daf/f6c to dc/d27/d6d/dd7/ffa 0 2024-05-06T14:04:22.275 INFO:tasks.workunit.client.1.smithi174.stdout:9/738: rename dc/d27/d51/c8c to dc/d27/d51/da5/cfb 0 2024-05-06T14:04:22.275 INFO:tasks.workunit.client.1.smithi174.stdout:9/739: dread - dc/d27/d6d/dd7/fec zero size 2024-05-06T14:04:22.275 INFO:tasks.workunit.client.1.smithi174.stdout:9/740: rename dc/d17/d3a/db2/le2 to dc/d17/d3a/dcb/daf/d43/lfc 0 2024-05-06T14:04:22.275 INFO:tasks.workunit.client.1.smithi174.stdout:9/741: mknod dc/de/d7f/da4/ded/cfd 0 2024-05-06T14:04:22.275 INFO:tasks.workunit.client.1.smithi174.stdout:9/742: rename dc/d17/l48 to dc/df/lfe 0 2024-05-06T14:04:22.276 INFO:tasks.workunit.client.1.smithi174.stdout:9/743: chown dc/d17/d3a/dcb/daf/l7e 7945 1 2024-05-06T14:04:22.276 INFO:tasks.workunit.client.1.smithi174.stdout:9/744: truncate dc/d9b/fcc 438302 0 2024-05-06T14:04:22.330 INFO:tasks.workunit.client.1.smithi174.stdout:3/724: fdatasync df/f18 0 2024-05-06T14:04:22.330 INFO:tasks.workunit.client.1.smithi174.stdout:3/725: read fd [594233,31469] 0 2024-05-06T14:04:22.330 INFO:tasks.workunit.client.1.smithi174.stdout:3/726: creat df/d10/d1b/fe5 x:0 0 0 2024-05-06T14:04:22.331 INFO:tasks.workunit.client.1.smithi174.stdout:3/727: readlink df/d10/da2/lc9 0 2024-05-06T14:04:22.331 INFO:tasks.workunit.client.1.smithi174.stdout:3/728: symlink df/d10/le6 0 2024-05-06T14:04:22.331 INFO:tasks.workunit.client.1.smithi174.stdout:7/702: fdatasync d0/d1d/da4/d61/d19/d24/d47/d64/fa9 0 2024-05-06T14:04:22.331 INFO:tasks.workunit.client.1.smithi174.stdout:9/745: fsync dc/f3d 0 2024-05-06T14:04:22.331 INFO:tasks.workunit.client.1.smithi174.stdout:9/746: read - dc/d9b/dd4/fe4 zero size 2024-05-06T14:04:22.331 INFO:tasks.workunit.client.1.smithi174.stdout:9/747: creat dc/fff x:0 0 0 2024-05-06T14:04:22.331 INFO:tasks.workunit.client.1.smithi174.stdout:7/703: creat d0/d1d/da4/d61/d19/d39/d90/da6/db6/ff1 x:0 0 0 2024-05-06T14:04:22.331 INFO:tasks.workunit.client.1.smithi174.stdout:7/704: truncate d0/d1d/da4/d61/d28/d59/da1/dcf/fd5 291050 0 2024-05-06T14:04:22.332 INFO:tasks.workunit.client.1.smithi174.stdout:7/705: mknod d0/d1d/d9c/dad/dda/de5/cf2 0 2024-05-06T14:04:22.332 INFO:tasks.workunit.client.1.smithi174.stdout:7/706: chown d0/d1d/da4/d61/d28/d59/da1/faf 11038926 1 2024-05-06T14:04:22.332 INFO:tasks.workunit.client.1.smithi174.stdout:7/707: dread - d0/d1d/da4/d61/d19/d39/d90/fdd zero size 2024-05-06T14:04:22.332 INFO:tasks.workunit.client.1.smithi174.stdout:7/708: stat d0/d1d/da4/d61/d19/d24/d47/d64/c69 0 2024-05-06T14:04:22.334 INFO:tasks.workunit.client.1.smithi174.stdout:0/844: dwrite d0/d4/d8/f107 [487424,28672] 0 2024-05-06T14:04:22.335 INFO:tasks.workunit.client.1.smithi174.stdout:0/845: write d0/d16/f3a [988920,52080] 0 2024-05-06T14:04:22.335 INFO:tasks.workunit.client.1.smithi174.stdout:0/846: creat d0/d4/d80/d93/dbe/f120 x:0 0 0 2024-05-06T14:04:22.335 INFO:tasks.workunit.client.1.smithi174.stdout:2/790: dwrite d0/d1/f5e [2265088,69632] 0 2024-05-06T14:04:22.335 INFO:tasks.workunit.client.1.smithi174.stdout:2/791: dread d0/d24/d77/d93/d9a/fe5 [1617920,77824] 0 2024-05-06T14:04:22.335 INFO:tasks.workunit.client.1.smithi174.stdout:2/792: dread d0/db/f86 [143360,53248] 0 2024-05-06T14:04:22.335 INFO:tasks.workunit.client.1.smithi174.stdout:2/793: write d0/d1/d2/d4/d6/f7 [1116289,67569] 0 2024-05-06T14:04:22.335 INFO:tasks.workunit.client.1.smithi174.stdout:8/956: dwrite d4/de/d23/d41/d56/f9c [1310720,40960] 0 2024-05-06T14:04:22.335 INFO:tasks.workunit.client.1.smithi174.stdout:8/957: dread d4/d15/d20/d3e/d79/f7d [61440,90112] 0 2024-05-06T14:04:22.336 INFO:tasks.workunit.client.1.smithi174.stdout:2/794: symlink d0/d1/d2/d4/d6/d3c/dc7/lf8 0 2024-05-06T14:04:22.336 INFO:tasks.workunit.client.1.smithi174.stdout:2/795: dread d0/db/d15/ff2 [270336,28672] 0 2024-05-06T14:04:22.336 INFO:tasks.workunit.client.1.smithi174.stdout:2/796: rename d0/d1/d2/f54 to d0/da/ff9 0 2024-05-06T14:04:22.336 INFO:tasks.workunit.client.1.smithi174.stdout:2/797: chown d0/d24/fb5 0 1 2024-05-06T14:04:22.336 INFO:tasks.workunit.client.1.smithi174.stdout:2/798: dread - d0/d1/d2/d4/d43/f7c zero size 2024-05-06T14:04:22.336 INFO:tasks.workunit.client.1.smithi174.stdout:2/799: rmdir d0/d1/d2/d4/dde/de4 0 2024-05-06T14:04:22.336 INFO:tasks.workunit.client.1.smithi174.stdout:9/748: dwrite dc/d17/d3a/dcb/daf/fde [466944,49152] 0 2024-05-06T14:04:22.336 INFO:tasks.workunit.client.1.smithi174.stdout:2/800: symlink d0/lfa 0 2024-05-06T14:04:22.337 INFO:tasks.workunit.client.1.smithi174.stdout:2/801: symlink d0/d1/d2/d4/d18/de9/lfb 0 2024-05-06T14:04:22.337 INFO:tasks.workunit.client.1.smithi174.stdout:2/802: write d0/d1/d2/d4/d18/fe8 [213279,29845] 0 2024-05-06T14:04:22.337 INFO:tasks.workunit.client.1.smithi174.stdout:2/803: write d0/d1/d2/d4/d6/d3c/fe1 [2585333,60992] 0 2024-05-06T14:04:22.337 INFO:tasks.workunit.client.1.smithi174.stdout:2/804: symlink d0/d1/d2/d2a/lfc 0 2024-05-06T14:04:22.345 INFO:tasks.workunit.client.1.smithi174.stdout:1/817: dread d11/f5a [81920,98304] 0 2024-05-06T14:04:22.408 INFO:tasks.workunit.client.1.smithi174.stdout:3/729: fsync df/f1f 0 2024-05-06T14:04:22.408 INFO:tasks.workunit.client.1.smithi174.stdout:7/709: fsync d0/d1d/da4/d61/d19/d39/d90/fdc 0 2024-05-06T14:04:22.409 INFO:tasks.workunit.client.1.smithi174.stdout:7/710: dread d0/d1d/da4/d61/d28/d37/f60 [598016,53248] 0 2024-05-06T14:04:22.409 INFO:tasks.workunit.client.1.smithi174.stdout:3/730: dread df/d10/fc0 [147456,118784] 0 2024-05-06T14:04:22.409 INFO:tasks.workunit.client.1.smithi174.stdout:3/731: read - df/d10/d1b/d59/fa9 zero size 2024-05-06T14:04:22.409 INFO:tasks.workunit.client.1.smithi174.stdout:7/711: getdents d0/d1d/da4/d61/d19 0 2024-05-06T14:04:22.409 INFO:tasks.workunit.client.1.smithi174.stdout:7/712: chown d0/d1d/da4/d61/d19/d24/f7e 144 1 2024-05-06T14:04:22.409 INFO:tasks.workunit.client.1.smithi174.stdout:7/713: mknod d0/d1d/da4/d61/d19/d24/d47/d70/d83/cf3 0 2024-05-06T14:04:22.409 INFO:tasks.workunit.client.1.smithi174.stdout:7/714: chown d0/d1d/d9c/dad/fb4 5 1 2024-05-06T14:04:22.410 INFO:tasks.workunit.client.1.smithi174.stdout:3/732: dwrite df/d10/d1b/d7e/d5a/f77 [516096,36864] 0 2024-05-06T14:04:22.422 INFO:tasks.workunit.client.1.smithi174.stdout:8/958: dread d4/d15/d20/d3e/d79/f7d [471040,77824] 0 2024-05-06T14:04:22.452 INFO:tasks.workunit.client.1.smithi174.stdout:0/847: fdatasync d0/d3/d104/d17/d2e/f53 0 2024-05-06T14:04:22.452 INFO:tasks.workunit.client.1.smithi174.stdout:2/805: fsync d0/da/d3f/f71 0 2024-05-06T14:04:22.452 INFO:tasks.workunit.client.1.smithi174.stdout:2/806: stat d0/d1/d2/d4/d6/f44 0 2024-05-06T14:04:22.452 INFO:tasks.workunit.client.1.smithi174.stdout:0/848: rmdir d0/d4/d8/dce 39 2024-05-06T14:04:22.453 INFO:tasks.workunit.client.1.smithi174.stdout:0/849: dread d0/d4/d8/d25/d5c/d44/dd5/f43 [745472,61440] 0 2024-05-06T14:04:22.455 INFO:tasks.workunit.client.1.smithi174.stdout:9/749: write dc/f54 [135709,30172] 0 2024-05-06T14:04:22.458 INFO:tasks.workunit.client.1.smithi174.stdout:7/715: rename d0/d1d/da4/d61/d19/d39/d90/da6/fb8 to d0/d1d/da4/d61/d19/d24/d6f/d88/ff4 0 2024-05-06T14:04:22.458 INFO:tasks.workunit.client.1.smithi174.stdout:1/818: dwrite f1 [196608,81920] 0 2024-05-06T14:04:22.458 INFO:tasks.workunit.client.1.smithi174.stdout:0/850: creat d0/d4/d8/d25/d5c/d44/dd5/d83/f121 x:0 0 0 2024-05-06T14:04:22.458 INFO:tasks.workunit.client.1.smithi174.stdout:8/959: rename d4/de/d23/d3c/db2/da6/dad/de9 to d4/de/d24/d5e/d85/d91/d13a 0 2024-05-06T14:04:22.458 INFO:tasks.workunit.client.1.smithi174.stdout:9/750: write dc/de/d7f/da4/fc4 [1017792,97355] 0 2024-05-06T14:04:22.459 INFO:tasks.workunit.client.1.smithi174.stdout:9/751: dread - dc/d17/d3a/db2/fbc zero size 2024-05-06T14:04:22.459 INFO:tasks.workunit.client.1.smithi174.stdout:7/716: write d0/d1d/da4/d61/d19/d24/f87 [915667,36194] 0 2024-05-06T14:04:22.459 INFO:tasks.workunit.client.1.smithi174.stdout:0/851: truncate d0/d3/d104/f6c 504914 0 2024-05-06T14:04:22.459 INFO:tasks.workunit.client.1.smithi174.stdout:9/752: dread dc/d27/d63/f9a [647168,94208] 0 2024-05-06T14:04:22.459 INFO:tasks.workunit.client.1.smithi174.stdout:8/960: creat d4/de/f13b x:0 0 0 2024-05-06T14:04:22.459 INFO:tasks.workunit.client.1.smithi174.stdout:3/733: write df/d10/f1c [1012357,96579] 0 2024-05-06T14:04:22.459 INFO:tasks.workunit.client.1.smithi174.stdout:1/819: write d11/d41/dc9/d6c/f72 [1785307,57557] 0 2024-05-06T14:04:22.459 INFO:tasks.workunit.client.1.smithi174.stdout:3/734: stat df/d10/d1b/d59/c8d 0 2024-05-06T14:04:22.460 INFO:tasks.workunit.client.1.smithi174.stdout:8/961: truncate d4/de/d24/d46/d63/d117/f133 663147 0 2024-05-06T14:04:22.460 INFO:tasks.workunit.client.1.smithi174.stdout:9/753: creat dc/d17/f100 x:0 0 0 2024-05-06T14:04:22.460 INFO:tasks.workunit.client.1.smithi174.stdout:9/754: creat dc/d27/d51/da5/f101 x:0 0 0 2024-05-06T14:04:22.460 INFO:tasks.workunit.client.1.smithi174.stdout:9/755: stat dc/d1c/f58 0 2024-05-06T14:04:22.460 INFO:tasks.workunit.client.1.smithi174.stdout:1/820: mkdir d11/d41/dc9/d11a 0 2024-05-06T14:04:22.460 INFO:tasks.workunit.client.1.smithi174.stdout:9/756: rename dc/d1c/l85 to dc/de/d81/l102 0 2024-05-06T14:04:22.460 INFO:tasks.workunit.client.1.smithi174.stdout:9/757: rmdir dc/d17/d3a/db2 39 2024-05-06T14:04:22.460 INFO:tasks.workunit.client.1.smithi174.stdout:1/821: read d11/d57/d98/ff9 [728357,99887] 0 2024-05-06T14:04:22.461 INFO:tasks.workunit.client.1.smithi174.stdout:1/822: mkdir d11/d1f/d27/d32/d84/d8c/d11b 0 2024-05-06T14:04:22.498 INFO:tasks.workunit.client.1.smithi174.stdout:7/717: fsync d0/d1d/da4/d61/d19/f7d 0 2024-05-06T14:04:22.498 INFO:tasks.workunit.client.1.smithi174.stdout:8/962: fdatasync d4/de/d23/d3c/db2/da6/dad/d124/f74 0 2024-05-06T14:04:22.498 INFO:tasks.workunit.client.1.smithi174.stdout:2/807: fsync d0/da/d3f/d67/fd3 0 2024-05-06T14:04:22.499 INFO:tasks.workunit.client.1.smithi174.stdout:0/852: dwrite d0/d36/d45/f4d [1396736,24576] 0 2024-05-06T14:04:22.499 INFO:tasks.workunit.client.1.smithi174.stdout:0/853: read d0/f68 [257695,89724] 0 2024-05-06T14:04:22.503 INFO:tasks.workunit.client.1.smithi174.stdout:3/735: dwrite df/d10/fc0 [1609728,4096] 0 2024-05-06T14:04:22.503 INFO:tasks.workunit.client.1.smithi174.stdout:3/736: mknod df/ce7 0 2024-05-06T14:04:22.503 INFO:tasks.workunit.client.1.smithi174.stdout:3/737: mknod df/d2d/d84/ce8 0 2024-05-06T14:04:22.506 INFO:tasks.workunit.client.1.smithi174.stdout:7/718: creat d0/d1d/da4/d61/d28/db1/ff5 x:0 0 0 2024-05-06T14:04:22.507 INFO:tasks.workunit.client.1.smithi174.stdout:7/719: write d0/d1d/da4/d61/d19/d39/d46/f57 [1222072,60750] 0 2024-05-06T14:04:22.507 INFO:tasks.workunit.client.1.smithi174.stdout:7/720: chown d0/d1d/da4/d61/d19/d39/d90/da6/db6/fd2 12 1 2024-05-06T14:04:22.507 INFO:tasks.workunit.client.1.smithi174.stdout:7/721: symlink d0/d1d/da4/d61/d19/d24/d47/d64/lf6 0 2024-05-06T14:04:22.507 INFO:tasks.workunit.client.1.smithi174.stdout:7/722: readlink d0/d1d/da4/d61/d19/d24/d47/dc6/le6 0 2024-05-06T14:04:22.507 INFO:tasks.workunit.client.1.smithi174.stdout:8/963: rename d4/de/d24/d46/d63 to d4/de/d23/d41/d4e/d13c 0 2024-05-06T14:04:22.507 INFO:tasks.workunit.client.1.smithi174.stdout:8/964: dread - d4/de/d24/d46/fa2 zero size 2024-05-06T14:04:22.507 INFO:tasks.workunit.client.1.smithi174.stdout:8/965: write d4/de/d23/d41/d56/f9c [403381,47216] 0 2024-05-06T14:04:22.508 INFO:tasks.workunit.client.1.smithi174.stdout:8/966: unlink d4/d15/d20/d3e/le7 0 2024-05-06T14:04:22.508 INFO:tasks.workunit.client.1.smithi174.stdout:1/823: dwrite d11/d57/f96 [32768,77824] 0 2024-05-06T14:04:22.508 INFO:tasks.workunit.client.1.smithi174.stdout:1/824: read d11/d1f/d27/d32/d84/ddc/fe1 [533028,65407] 0 2024-05-06T14:04:22.508 INFO:tasks.workunit.client.1.smithi174.stdout:0/854: dwrite d0/d4/d8/d25/d5c/ddb/fe7 [1265664,12288] 0 2024-05-06T14:04:22.508 INFO:tasks.workunit.client.1.smithi174.stdout:0/855: chown d0/d4/d8/d25/d5c/d44/dd5/fec 6787074 1 2024-05-06T14:04:22.508 INFO:tasks.workunit.client.1.smithi174.stdout:0/856: dread d0/d4/d80/d93/f97 [294912,20480] 0 2024-05-06T14:04:22.508 INFO:tasks.workunit.client.1.smithi174.stdout:0/857: read - d0/d3/dfc/fdd zero size 2024-05-06T14:04:22.518 INFO:tasks.workunit.client.1.smithi174.stdout:9/758: truncate f2 933052 0 2024-05-06T14:04:22.518 INFO:tasks.workunit.client.1.smithi174.stdout:9/759: write dc/d27/dc9/fd9 [1894663,32309] 0 2024-05-06T14:04:22.518 INFO:tasks.workunit.client.1.smithi174.stdout:9/760: creat dc/de/d7f/f103 x:0 0 0 2024-05-06T14:04:22.561 INFO:tasks.workunit.client.1.smithi174.stdout:2/808: fdatasync d0/d1/d2/d4/d6/f44 0 2024-05-06T14:04:22.561 INFO:tasks.workunit.client.1.smithi174.stdout:2/809: getdents d0/d24 0 2024-05-06T14:04:22.561 INFO:tasks.workunit.client.1.smithi174.stdout:2/810: chown d0/d24/d84/ld2 15 1 2024-05-06T14:04:22.561 INFO:tasks.workunit.client.1.smithi174.stdout:2/811: readlink d0/d1/d2/d4/d18/d2d/dd1/lf6 0 2024-05-06T14:04:22.562 INFO:tasks.workunit.client.1.smithi174.stdout:2/812: stat d0/da/d3f/fac 0 2024-05-06T14:04:22.562 INFO:tasks.workunit.client.1.smithi174.stdout:2/813: dread d0/d1/d2/d2a/fca [1155072,16384] 0 2024-05-06T14:04:22.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/967: dwrite d4/de/d24/d5e/d85/d91/f12b [876544,102400] 0 2024-05-06T14:04:22.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/968: truncate d4/d15/d20/d3e/d79/d94/ff3 863671 0 2024-05-06T14:04:22.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/969: write d4/de/d23/d41/d56/dc0/df0/f12e [685583,115814] 0 2024-05-06T14:04:22.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/970: rename d4/de/d23/d41/d56/f5d to d4/de/d23/d41/d4e/d13c/d117/f13d 0 2024-05-06T14:04:22.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/971: creat d4/de/f13e x:0 0 0 2024-05-06T14:04:22.562 INFO:tasks.workunit.client.1.smithi174.stdout:8/972: write d4/de/d23/d3c/ffc [361340,65209] 0 2024-05-06T14:04:22.563 INFO:tasks.workunit.client.1.smithi174.stdout:8/973: dread - d4/de/d23/d3c/db2/da6/ff4 zero size 2024-05-06T14:04:22.563 INFO:tasks.workunit.client.1.smithi174.stdout:8/974: creat d4/de/d23/d3c/db2/f13f x:0 0 0 2024-05-06T14:04:22.563 INFO:tasks.workunit.client.1.smithi174.stdout:8/975: creat d4/d15/d20/d3e/d79/d94/f140 x:0 0 0 2024-05-06T14:04:22.563 INFO:tasks.workunit.client.1.smithi174.stdout:8/976: mkdir d4/d15/d20/d141 0 2024-05-06T14:04:22.566 INFO:tasks.workunit.client.1.smithi174.stdout:9/761: write dc/d17/d4c/fba [1623423,67971] 0 2024-05-06T14:04:22.567 INFO:tasks.workunit.client.1.smithi174.stdout:9/762: unlink dc/d1c/f55 0 2024-05-06T14:04:22.567 INFO:tasks.workunit.client.1.smithi174.stdout:3/738: dwrite df/d10/d1b/d7e/d5a/f69 [868352,36864] 0 2024-05-06T14:04:22.567 INFO:tasks.workunit.client.1.smithi174.stdout:9/763: mknod dc/d17/d3a/dcb/c104 0 2024-05-06T14:04:22.567 INFO:tasks.workunit.client.1.smithi174.stdout:9/764: unlink dc/d17/d3a/dcb/daf/d43/d8e/dd2/cda 0 2024-05-06T14:04:22.567 INFO:tasks.workunit.client.1.smithi174.stdout:9/765: dread - dc/de/d7f/f103 zero size 2024-05-06T14:04:22.567 INFO:tasks.workunit.client.1.smithi174.stdout:3/739: creat df/d10/da2/fe9 x:0 0 0 2024-05-06T14:04:22.567 INFO:tasks.workunit.client.1.smithi174.stdout:9/766: chown dc/de/d7f/d93/fac 27468541 1 2024-05-06T14:04:22.568 INFO:tasks.workunit.client.1.smithi174.stdout:3/740: mknod df/d2d/d4e/d81/cea 0 2024-05-06T14:04:22.568 INFO:tasks.workunit.client.1.smithi174.stdout:9/767: mknod dc/d17/d3a/db2/c105 0 2024-05-06T14:04:22.568 INFO:tasks.workunit.client.1.smithi174.stdout:9/768: mknod dc/d9b/c106 0 2024-05-06T14:04:22.568 INFO:tasks.workunit.client.1.smithi174.stdout:9/769: write dc/d27/d6d/dd7/ffa [589489,61119] 0 2024-05-06T14:04:22.568 INFO:tasks.workunit.client.1.smithi174.stdout:9/770: creat dc/de/d81/f107 x:0 0 0 2024-05-06T14:04:22.568 INFO:tasks.workunit.client.1.smithi174.stdout:9/771: symlink dc/de/d7f/da4/ded/l108 0 2024-05-06T14:04:22.568 INFO:tasks.workunit.client.1.smithi174.stdout:9/772: symlink dc/d27/d51/l109 0 2024-05-06T14:04:22.568 INFO:tasks.workunit.client.1.smithi174.stdout:7/723: dwrite d0/f2e [1540096,77824] 0 2024-05-06T14:04:22.569 INFO:tasks.workunit.client.1.smithi174.stdout:7/724: dread d0/d3a/fde [909312,12288] 0 2024-05-06T14:04:22.569 INFO:tasks.workunit.client.1.smithi174.stdout:9/773: write dc/f42 [543969,101204] 0 2024-05-06T14:04:22.569 INFO:tasks.workunit.client.1.smithi174.stdout:7/725: mkdir d0/d1d/da4/d61/d19/d39/d90/da6/df7 0 2024-05-06T14:04:22.569 INFO:tasks.workunit.client.1.smithi174.stdout:7/726: truncate d0/d1d/da4/d61/d19/f1c 233536 0 2024-05-06T14:04:22.569 INFO:tasks.workunit.client.1.smithi174.stdout:5/975: sync 2024-05-06T14:04:22.569 INFO:tasks.workunit.client.1.smithi174.stdout:5/976: creat d1/d6/d7/d3e/d4c/f14d x:0 0 0 2024-05-06T14:04:22.569 INFO:tasks.workunit.client.1.smithi174.stdout:5/977: chown d1/d6/df/f79 1983 1 2024-05-06T14:04:22.570 INFO:tasks.workunit.client.1.smithi174.stdout:5/978: getdents d1/d6/d7/da1/dfc 0 2024-05-06T14:04:22.570 INFO:tasks.workunit.client.1.smithi174.stdout:0/858: dwrite d0/d4/d8/d25/d5c/f10c [729088,4096] 0 2024-05-06T14:04:22.570 INFO:tasks.workunit.client.1.smithi174.stdout:0/859: write d0/d16/f3a [1731384,75174] 0 2024-05-06T14:04:22.570 INFO:tasks.workunit.client.1.smithi174.stdout:0/860: truncate d0/d4/d8/d25/d5c/d4a/f95 1713913 0 2024-05-06T14:04:22.570 INFO:tasks.workunit.client.1.smithi174.stdout:1/825: dwrite d11/d57/fb4 [647168,110592] 0 2024-05-06T14:04:22.570 INFO:tasks.workunit.client.1.smithi174.stdout:1/826: truncate d11/d1f/d27/d32/d92/fac 1793779 0 2024-05-06T14:04:22.570 INFO:tasks.workunit.client.1.smithi174.stdout:1/827: dread - d11/d57/d77/f10e zero size 2024-05-06T14:04:22.571 INFO:tasks.workunit.client.1.smithi174.stdout:1/828: unlink d11/d1f/d27/f6a 0 2024-05-06T14:04:22.571 INFO:tasks.workunit.client.1.smithi174.stdout:1/829: symlink d11/d41/dc9/d11a/l11c 0 2024-05-06T14:04:22.571 INFO:tasks.workunit.client.1.smithi174.stdout:1/830: symlink d11/d1f/d27/d2d/l11d 0 2024-05-06T14:04:22.571 INFO:tasks.workunit.client.1.smithi174.stdout:1/831: write d11/d41/d4a/f56 [108891,68006] 0 2024-05-06T14:04:22.571 INFO:tasks.workunit.client.1.smithi174.stdout:1/832: dread - d11/d1f/d27/d32/f104 zero size 2024-05-06T14:04:22.622 INFO:tasks.workunit.client.1.smithi174.stdout:2/814: fdatasync d0/db/f7b 0 2024-05-06T14:04:22.623 INFO:tasks.workunit.client.1.smithi174.stdout:3/741: dwrite df/d2d/f36 [1384448,49152] 0 2024-05-06T14:04:22.623 INFO:tasks.workunit.client.1.smithi174.stdout:3/742: write df/d10/f2f [1128542,101003] 0 2024-05-06T14:04:22.623 INFO:tasks.workunit.client.1.smithi174.stdout:3/743: chown df/d10/d1b/d7e/d5a/f69 6701 1 2024-05-06T14:04:22.623 INFO:tasks.workunit.client.1.smithi174.stdout:3/744: dread df/d10/f19 [290816,40960] 0 2024-05-06T14:04:22.627 INFO:tasks.workunit.client.1.smithi174.stdout:8/977: read d4/d15/d20/d3e/d79/dbf/fe2 [15024,110120] 0 2024-05-06T14:04:22.627 INFO:tasks.workunit.client.1.smithi174.stdout:9/774: dwrite dc/de/d81/f9f [2027520,8192] 0 2024-05-06T14:04:22.628 INFO:tasks.workunit.client.1.smithi174.stdout:9/775: symlink dc/d27/l10a 0 2024-05-06T14:04:22.628 INFO:tasks.workunit.client.1.smithi174.stdout:7/727: dwrite d0/d1d/da4/d61/d19/d24/d47/f50 [524288,53248] 0 2024-05-06T14:04:22.628 INFO:tasks.workunit.client.1.smithi174.stdout:9/776: creat dc/d17/d3a/dcb/daf/d43/d8e/f10b x:0 0 0 2024-05-06T14:04:22.628 INFO:tasks.workunit.client.1.smithi174.stdout:7/728: chown d0/d1d/da4/d61/d19/d24/d47/dc6 4628 1 2024-05-06T14:04:22.628 INFO:tasks.workunit.client.1.smithi174.stdout:9/777: symlink dc/de/d81/l10c 0 2024-05-06T14:04:22.628 INFO:tasks.workunit.client.1.smithi174.stdout:7/729: creat d0/d1d/da4/d61/d19/db7/ff8 x:0 0 0 2024-05-06T14:04:22.628 INFO:tasks.workunit.client.1.smithi174.stdout:9/778: getdents dc/d27/d6d 0 2024-05-06T14:04:22.629 INFO:tasks.workunit.client.1.smithi174.stdout:9/779: rmdir dc/d17 39 2024-05-06T14:04:22.631 INFO:tasks.workunit.client.1.smithi174.stdout:0/861: rename d0/f68 to d0/d4/d80/d93/f122 0 2024-05-06T14:04:22.632 INFO:tasks.workunit.client.1.smithi174.stdout:8/978: rename d4/de/d23/d3c/db2/da6/dad to d4/de/d24/d5e/d85/d91/d13a/d142 0 2024-05-06T14:04:22.632 INFO:tasks.workunit.client.1.smithi174.stdout:0/862: creat d0/d36/d45/d114/f123 x:0 0 0 2024-05-06T14:04:22.632 INFO:tasks.workunit.client.1.smithi174.stdout:2/815: dwrite d0/db/f7b [1089536,57344] 0 2024-05-06T14:04:22.632 INFO:tasks.workunit.client.1.smithi174.stdout:2/816: dread d0/d1/d2/d4/f22 [266240,118784] 0 2024-05-06T14:04:22.632 INFO:tasks.workunit.client.1.smithi174.stdout:1/833: unlink f5 0 2024-05-06T14:04:22.632 INFO:tasks.workunit.client.1.smithi174.stdout:1/834: write d11/d1f/d27/d32/d84/ddc/fe6 [632358,3613] 0 2024-05-06T14:04:22.632 INFO:tasks.workunit.client.1.smithi174.stdout:1/835: chown d11/d1f/d27/d32/d84/d8c/d94/db0/c7b 23838235 1 2024-05-06T14:04:22.633 INFO:tasks.workunit.client.1.smithi174.stdout:1/836: write d11/d41/d4a/fa2 [1079544,22550] 0 2024-05-06T14:04:22.633 INFO:tasks.workunit.client.1.smithi174.stdout:2/817: rename d0/d1/d2/d4/d6/d3c to d0/d24/d77/d93/d9a/dfd 0 2024-05-06T14:04:22.633 INFO:tasks.workunit.client.1.smithi174.stdout:2/818: stat d0/d1/d2/d4/d18/de9/lfb 0 2024-05-06T14:04:22.633 INFO:tasks.workunit.client.1.smithi174.stdout:2/819: stat d0/d1/d2/d1b/f4c 0 2024-05-06T14:04:22.633 INFO:tasks.workunit.client.1.smithi174.stdout:8/979: mknod d4/de/d23/d41/c143 0 2024-05-06T14:04:22.633 INFO:tasks.workunit.client.1.smithi174.stdout:0/863: creat d0/d16/f124 x:0 0 0 2024-05-06T14:04:22.633 INFO:tasks.workunit.client.1.smithi174.stdout:0/864: stat d0/d4/d8/d25/d5c/d4a/da7/fb8 0 2024-05-06T14:04:22.634 INFO:tasks.workunit.client.1.smithi174.stdout:8/980: symlink d4/d15/d20/d70/d121/l144 0 2024-05-06T14:04:22.634 INFO:tasks.workunit.client.1.smithi174.stdout:1/837: dwrite d11/f20 [1277952,4096] 0 2024-05-06T14:04:22.634 INFO:tasks.workunit.client.1.smithi174.stdout:1/838: chown d11/d1f/d27/d32/fff 1022 1 2024-05-06T14:04:22.634 INFO:tasks.workunit.client.1.smithi174.stdout:1/839: chown d11/d1f/d27/d32/f50 28624 1 2024-05-06T14:04:22.642 INFO:tasks.workunit.client.1.smithi174.stdout:3/745: dread df/d2d/f31 [376832,94208] 0 2024-05-06T14:04:22.651 INFO:tasks.workunit.client.1.smithi174.stdout:5/979: read d1/d6/df/f79 [421170,99106] 0 2024-05-06T14:04:22.717 INFO:tasks.workunit.client.1.smithi174.stdout:9/780: fdatasync dc/d27/d6d/f8a 0 2024-05-06T14:04:22.717 INFO:tasks.workunit.client.1.smithi174.stdout:9/781: symlink dc/d9b/de0/l10d 0 2024-05-06T14:04:22.717 INFO:tasks.workunit.client.1.smithi174.stdout:9/782: creat dc/de/df3/f10e x:0 0 0 2024-05-06T14:04:22.717 INFO:tasks.workunit.client.1.smithi174.stdout:9/783: chown dc/l45 2840 1 2024-05-06T14:04:22.717 INFO:tasks.workunit.client.1.smithi174.stdout:9/784: truncate f7 988451 0 2024-05-06T14:04:22.717 INFO:tasks.workunit.client.1.smithi174.stdout:9/785: chown dc/d27/c79 37583234 1 2024-05-06T14:04:22.719 INFO:tasks.workunit.client.1.smithi174.stdout:1/840: dwrite d11/d41/d4a/f56 [286720,90112] 0 2024-05-06T14:04:22.723 INFO:tasks.workunit.client.1.smithi174.stdout:1/841: mkdir d11/d1f/d27/d32/d84/d8c/d11b/d11e 0 2024-05-06T14:04:22.723 INFO:tasks.workunit.client.1.smithi174.stdout:7/730: dread d0/d1d/da4/f4b [3198976,118784] 0 2024-05-06T14:04:22.723 INFO:tasks.workunit.client.1.smithi174.stdout:9/786: creat dc/d27/d63/f10f x:0 0 0 2024-05-06T14:04:22.723 INFO:tasks.workunit.client.1.smithi174.stdout:3/746: rename df/l32 to df/dbc/leb 0 2024-05-06T14:04:22.723 INFO:tasks.workunit.client.1.smithi174.stdout:0/865: read d0/d4/d8/d25/f6f [2116334,90602] 0 2024-05-06T14:04:22.724 INFO:tasks.workunit.client.1.smithi174.stdout:1/842: rename d11/d1f/d27/d32/d92/fac to d11/d41/dc9/d6c/f11f 0 2024-05-06T14:04:22.724 INFO:tasks.workunit.client.1.smithi174.stdout:1/843: readlink d11/d57/d83/l8f 0 2024-05-06T14:04:22.724 INFO:tasks.workunit.client.1.smithi174.stdout:5/980: rename d1/d6/f9 to d1/d6/d7/f14e 0 2024-05-06T14:04:22.724 INFO:tasks.workunit.client.1.smithi174.stdout:7/731: creat d0/d1d/da4/d61/d19/d39/d90/da6/db6/ff9 x:0 0 0 2024-05-06T14:04:22.724 INFO:tasks.workunit.client.1.smithi174.stdout:9/787: symlink dc/d9b/de0/l110 0 2024-05-06T14:04:22.724 INFO:tasks.workunit.client.1.smithi174.stdout:1/844: unlink d11/d57/d98/daf/ca9 0 2024-05-06T14:04:22.724 INFO:tasks.workunit.client.1.smithi174.stdout:0/866: creat d0/d36/d45/f125 x:0 0 0 2024-05-06T14:04:22.724 INFO:tasks.workunit.client.1.smithi174.stdout:3/747: symlink df/d10/d1b/d7e/d5a/lec 0 2024-05-06T14:04:22.725 INFO:tasks.workunit.client.1.smithi174.stdout:9/788: dread dc/f4e [741376,20480] 0 2024-05-06T14:04:22.725 INFO:tasks.workunit.client.1.smithi174.stdout:7/732: unlink d0/d1d/d9c/dad/dda/de5/fe8 0 2024-05-06T14:04:22.725 INFO:tasks.workunit.client.1.smithi174.stdout:5/981: creat d1/d6/df/d35/d8b/f14f x:0 0 0 2024-05-06T14:04:22.725 INFO:tasks.workunit.client.1.smithi174.stdout:1/845: mknod d11/d1f/d27/d2d/d9c/c120 0 2024-05-06T14:04:22.725 INFO:tasks.workunit.client.1.smithi174.stdout:0/867: rename d0/d4/d8/l49 to d0/d3/dfc/l126 0 2024-05-06T14:04:22.725 INFO:tasks.workunit.client.1.smithi174.stdout:5/982: readlink d1/d6/df/d35/d81/d60/db0/de/dbd/de0/l133 0 2024-05-06T14:04:22.725 INFO:tasks.workunit.client.1.smithi174.stdout:9/789: rename dc/d1c/f58 to dc/df/f111 0 2024-05-06T14:04:22.725 INFO:tasks.workunit.client.1.smithi174.stdout:5/983: chown d1/d6/df/f30 3086 1 2024-05-06T14:04:22.726 INFO:tasks.workunit.client.1.smithi174.stdout:9/790: dread - dc/d1c/fb7 zero size 2024-05-06T14:04:22.726 INFO:tasks.workunit.client.1.smithi174.stdout:1/846: creat d11/d1f/d27/d2d/ddd/f121 x:0 0 0 2024-05-06T14:04:22.726 INFO:tasks.workunit.client.1.smithi174.stdout:9/791: unlink dc/l19 0 2024-05-06T14:04:22.726 INFO:tasks.workunit.client.1.smithi174.stdout:1/847: rename d11/d1f/d27/d32/f50 to d11/d1f/d27/d32/d92/dbc/f122 0 2024-05-06T14:04:22.726 INFO:tasks.workunit.client.1.smithi174.stdout:5/984: truncate d1/d6/d7/da1/d9a/ff0 580393 0 2024-05-06T14:04:22.726 INFO:tasks.workunit.client.1.smithi174.stdout:3/748: dread df/d2d/f6e [167936,122880] 0 2024-05-06T14:04:22.726 INFO:tasks.workunit.client.1.smithi174.stdout:5/985: unlink d1/d6/d7/c46 0 2024-05-06T14:04:22.727 INFO:tasks.workunit.client.1.smithi174.stdout:5/986: chown d1/d6/df/d35/d81/d8d/f104 37 1 2024-05-06T14:04:22.727 INFO:tasks.workunit.client.1.smithi174.stdout:1/848: mkdir d11/d1f/d27/d32/d84/d8c/d94/db0/d123 0 2024-05-06T14:04:22.727 INFO:tasks.workunit.client.1.smithi174.stdout:5/987: creat d1/d6/d7/d36/f150 x:0 0 0 2024-05-06T14:04:22.727 INFO:tasks.workunit.client.1.smithi174.stdout:5/988: creat d1/d6/d7/d3e/f151 x:0 0 0 2024-05-06T14:04:22.727 INFO:tasks.workunit.client.1.smithi174.stdout:5/989: rmdir d1/d6/df/d35/d81/d60/db0 39 2024-05-06T14:04:22.727 INFO:tasks.workunit.client.1.smithi174.stdout:5/990: chown d1/d6/df/de2/cfa 24 1 2024-05-06T14:04:22.772 INFO:tasks.workunit.client.1.smithi174.stdout:7/733: dwrite d0/d1d/da4/d61/d19/d24/d14/d52/f3e [1314816,4096] 0 2024-05-06T14:04:22.777 INFO:tasks.workunit.client.1.smithi174.stdout:3/749: dwrite df/d10/d1b/d59/f89 [667648,24576] 0 2024-05-06T14:04:22.777 INFO:tasks.workunit.client.1.smithi174.stdout:3/750: mkdir df/d2d/d4d/ded 0 2024-05-06T14:04:22.777 INFO:tasks.workunit.client.1.smithi174.stdout:3/751: dread df/d10/f1c [1327104,118784] 0 2024-05-06T14:04:22.778 INFO:tasks.workunit.client.1.smithi174.stdout:0/868: dwrite d0/d4/d80/d93/f113 [458752,126976] 0 2024-05-06T14:04:22.778 INFO:tasks.workunit.client.1.smithi174.stdout:0/869: unlink d0/d36/d45/fbb 0 2024-05-06T14:04:22.778 INFO:tasks.workunit.client.1.smithi174.stdout:0/870: dread d0/d4/d8/d25/d5c/d4a/f60 [266240,4096] 0 2024-05-06T14:04:22.778 INFO:tasks.workunit.client.1.smithi174.stdout:0/871: getdents d0/d4/d8/d25/d5c/d44/db9 0 2024-05-06T14:04:22.778 INFO:tasks.workunit.client.1.smithi174.stdout:0/872: creat d0/d4/d8/d25/f127 x:0 0 0 2024-05-06T14:04:22.778 INFO:tasks.workunit.client.1.smithi174.stdout:1/849: dwrite d11/f5a [1478656,90112] 0 2024-05-06T14:04:22.778 INFO:tasks.workunit.client.1.smithi174.stdout:0/873: mknod d0/d3/dad/d119/c128 0 2024-05-06T14:04:22.785 INFO:tasks.workunit.client.1.smithi174.stdout:5/991: dread d1/d6/f13 [2215936,110592] 0 2024-05-06T14:04:22.785 INFO:tasks.workunit.client.1.smithi174.stdout:5/992: dread d1/d6/df/d35/d81/d60/f135 [393216,114688] 0 2024-05-06T14:04:22.786 INFO:tasks.workunit.client.1.smithi174.stdout:5/993: dread d1/d6/d7/d3e/d4c/ff3 [507904,40960] 0 2024-05-06T14:04:22.786 INFO:tasks.workunit.client.1.smithi174.stdout:5/994: symlink d1/ddf/d136/l152 0 2024-05-06T14:04:22.786 INFO:tasks.workunit.client.1.smithi174.stdout:5/995: mkdir d1/d6/d7/d36/d53/d59/d61/d69/d153 0 2024-05-06T14:04:22.786 INFO:tasks.workunit.client.1.smithi174.stdout:5/996: getdents d1/d6/df/d35/d81 0 2024-05-06T14:04:22.786 INFO:tasks.workunit.client.1.smithi174.stdout:5/997: chown d1/d6/d7/da1/f113 6974 1 2024-05-06T14:04:22.786 INFO:tasks.workunit.client.1.smithi174.stdout:5/998: write d1/d6/df/d35/d8b/d9f/fa9 [1870273,76137] 0 2024-05-06T14:04:22.786 INFO:tasks.workunit.client.1.smithi174.stdout:5/999: write d1/d6/d7/d8e/f103 [141533,76987] 0 2024-05-06T14:04:22.839 INFO:tasks.workunit.client.1.smithi174.stdout:8/981: fsync d4/d15/f4d 0 2024-05-06T14:04:22.839 INFO:tasks.workunit.client.1.smithi174.stdout:8/982: write d4/de/d24/d5e/d85/d91/f122 [358190,89198] 0 2024-05-06T14:04:22.839 INFO:tasks.workunit.client.1.smithi174.stdout:8/983: truncate d4/de/d24/f33 884532 0 2024-05-06T14:04:22.841 INFO:tasks.workunit.client.1.smithi174.stdout:6/982: sync 2024-05-06T14:04:22.844 INFO:tasks.workunit.client.1.smithi174.stdout:0/874: dwrite d0/d3/dfc/fdd [446464,94208] 0 2024-05-06T14:04:22.844 INFO:tasks.workunit.client.1.smithi174.stdout:6/983: symlink d0/d25/d52/d4c/l141 0 2024-05-06T14:04:22.844 INFO:tasks.workunit.client.1.smithi174.stdout:8/984: mkdir d4/de/d23/d41/dce/d145 0 2024-05-06T14:04:22.844 INFO:tasks.workunit.client.1.smithi174.stdout:6/984: chown d0/d25/d52/d4c/l64 1632 1 2024-05-06T14:04:22.845 INFO:tasks.workunit.client.1.smithi174.stdout:6/985: dread - d0/d25/d52/d2c/d6f/dfa/f11d zero size 2024-05-06T14:04:22.845 INFO:tasks.workunit.client.1.smithi174.stdout:8/985: creat d4/de/d24/dc1/f146 x:0 0 0 2024-05-06T14:04:22.845 INFO:tasks.workunit.client.1.smithi174.stdout:8/986: dread d4/d15/d20/d3e/d79/fcf [880640,8192] 0 2024-05-06T14:04:22.845 INFO:tasks.workunit.client.1.smithi174.stdout:0/875: symlink d0/d4/d8/dce/l129 0 2024-05-06T14:04:22.845 INFO:tasks.workunit.client.1.smithi174.stdout:8/987: getdents d4/d53 0 2024-05-06T14:04:22.846 INFO:tasks.workunit.client.1.smithi174.stdout:6/986: mknod d0/d25/d52/d2c/d105/d56/c142 0 2024-05-06T14:04:22.846 INFO:tasks.workunit.client.1.smithi174.stdout:0/876: write d0/d4/d8/d25/d5c/d4a/da7/dcb/fe6 [884305,34511] 0 2024-05-06T14:04:22.846 INFO:tasks.workunit.client.1.smithi174.stdout:0/877: dread - d0/d36/d45/f125 zero size 2024-05-06T14:04:22.851 INFO:tasks.workunit.client.1.smithi174.stdout:1/850: dread d11/d1f/d27/d2d/f52 [1802240,114688] 0 2024-05-06T14:04:22.851 INFO:tasks.workunit.client.1.smithi174.stdout:1/851: read d11/d1f/d27/d32/f59 [1805825,66995] 0 2024-05-06T14:04:22.851 INFO:tasks.workunit.client.1.smithi174.stdout:1/852: dread d11/d1f/f89 [180224,90112] 0 2024-05-06T14:04:22.851 INFO:tasks.workunit.client.1.smithi174.stdout:1/853: dread d11/d57/d98/daf/d9b/fa0 [0,118784] 0 2024-05-06T14:04:22.936 INFO:tasks.workunit.client.1.smithi174.stdout:1/854: dwrite d11/d1f/d27/f2b [1687552,45056] 0 2024-05-06T14:04:22.937 INFO:tasks.workunit.client.1.smithi174.stdout:1/855: unlink d11/l26 0 2024-05-06T14:04:22.937 INFO:tasks.workunit.client.1.smithi174.stdout:1/856: rename d11/d1f/d27/d32/d84/d8c/ce0 to d11/d1f/d27/d32/c124 0 2024-05-06T14:04:22.939 INFO:tasks.workunit.client.1.smithi174.stdout:8/988: dwrite d4/de/d23/d3c/db2/da6/f12a [487424,53248] 0 2024-05-06T14:04:22.939 INFO:tasks.workunit.client.1.smithi174.stdout:6/987: dwrite d0/d25/d52/d2c/d105/da9/db3/fc8 [573440,77824] 0 2024-05-06T14:04:23.019 INFO:tasks.workunit.client.1.smithi174.stdout:2/820: fdatasync d0/d16/f19 0 2024-05-06T14:04:23.020 INFO:tasks.workunit.client.1.smithi174.stdout:3/752: fsync df/d2d/f36 0 2024-05-06T14:04:23.020 INFO:tasks.workunit.client.1.smithi174.stdout:9/792: fdatasync f7 0 2024-05-06T14:04:23.020 INFO:tasks.workunit.client.1.smithi174.stdout:6/988: fdatasync d0/df/d3c/f9f 0 2024-05-06T14:04:23.020 INFO:tasks.workunit.client.1.smithi174.stdout:3/753: rename df/d10/d1b/f65 to df/d2d/d4d/da5/fee 0 2024-05-06T14:04:23.020 INFO:tasks.workunit.client.1.smithi174.stdout:3/754: readlink df/d2d/d4e/l67 0 2024-05-06T14:04:23.028 INFO:tasks.workunit.client.1.smithi174.stdout:2/821: link d0/d1/d2/d4/d6/l36 d0/d24/d77/d93/d9a/dfd/da2/lfe 0 2024-05-06T14:04:23.028 INFO:tasks.workunit.client.1.smithi174.stdout:9/793: creat dc/d9b/de0/f112 x:0 0 0 2024-05-06T14:04:23.028 INFO:tasks.workunit.client.1.smithi174.stdout:8/989: dwrite d4/de/d23/d41/d4e/f11f [401408,61440] 0 2024-05-06T14:04:23.028 INFO:tasks.workunit.client.1.smithi174.stdout:9/794: dread dc/d17/d4c/f72 [2351104,36864] 0 2024-05-06T14:04:23.028 INFO:tasks.workunit.client.1.smithi174.stdout:2/822: write d0/d16/f5f [798544,34530] 0 2024-05-06T14:04:23.029 INFO:tasks.workunit.client.1.smithi174.stdout:8/990: symlink d4/de/d24/l147 0 2024-05-06T14:04:23.029 INFO:tasks.workunit.client.1.smithi174.stdout:8/991: chown d4/de/d23/f78 6057 1 2024-05-06T14:04:23.029 INFO:tasks.workunit.client.1.smithi174.stdout:9/795: mkdir dc/d113 0 2024-05-06T14:04:23.029 INFO:tasks.workunit.client.1.smithi174.stdout:9/796: truncate dc/d9b/fcc 690208 0 2024-05-06T14:04:23.029 INFO:tasks.workunit.client.1.smithi174.stdout:8/992: creat d4/de/d24/d5e/d85/d91/d13a/d142/d124/f148 x:0 0 0 2024-05-06T14:04:23.029 INFO:tasks.workunit.client.1.smithi174.stdout:9/797: mknod dc/d17/d3a/dcb/daf/d43/c114 0 2024-05-06T14:04:23.029 INFO:tasks.workunit.client.1.smithi174.stdout:8/993: rename d4/d15/fd2 to d4/de/d24/d5e/f149 0 2024-05-06T14:04:23.029 INFO:tasks.workunit.client.1.smithi174.stdout:6/989: write d0/d25/d52/d2c/d105/d4b/ffe [1300422,114946] 0 2024-05-06T14:04:23.030 INFO:tasks.workunit.client.1.smithi174.stdout:8/994: mkdir d4/d15/da1/d14a 0 2024-05-06T14:04:23.030 INFO:tasks.workunit.client.1.smithi174.stdout:9/798: truncate dc/de/d7f/d93/fac 879648 0 2024-05-06T14:04:23.030 INFO:tasks.workunit.client.1.smithi174.stdout:8/995: rename d4/d15/d20/c58 to d4/de/d23/d41/d56/c14b 0 2024-05-06T14:04:23.030 INFO:tasks.workunit.client.1.smithi174.stdout:8/996: creat d4/de/d24/d46/f14c x:0 0 0 2024-05-06T14:04:23.030 INFO:tasks.workunit.client.1.smithi174.stdout:9/799: rename dc/d27/dc9/fd9 to dc/d17/d4c/f115 0 2024-05-06T14:04:23.030 INFO:tasks.workunit.client.1.smithi174.stdout:9/800: chown dc/de/laa 188 1 2024-05-06T14:04:23.030 INFO:tasks.workunit.client.1.smithi174.stdout:8/997: creat d4/de/d23/d41/d4e/d13c/d117/f14d x:0 0 0 2024-05-06T14:04:23.031 INFO:tasks.workunit.client.1.smithi174.stdout:9/801: dread - dc/d27/d6d/fa7 zero size 2024-05-06T14:04:23.031 INFO:tasks.workunit.client.1.smithi174.stdout:9/802: chown dc/d17/d3a/dcb/daf/d43/d8e/fc3 1 1 2024-05-06T14:04:23.031 INFO:tasks.workunit.client.1.smithi174.stdout:8/998: write d4/de/f72 [540154,50812] 0 2024-05-06T14:04:23.031 INFO:tasks.workunit.client.1.smithi174.stdout:9/803: creat dc/d17/d3a/dcb/f116 x:0 0 0 2024-05-06T14:04:23.031 INFO:tasks.workunit.client.1.smithi174.stdout:9/804: mkdir dc/de/d117 0 2024-05-06T14:04:23.031 INFO:tasks.workunit.client.1.smithi174.stdout:8/999: write d4/f131 [691996,67575] 0 2024-05-06T14:04:23.031 INFO:tasks.workunit.client.1.smithi174.stdout:9/805: write dc/d17/d3a/dcb/ff1 [1463733,75313] 0 2024-05-06T14:04:23.031 INFO:tasks.workunit.client.1.smithi174.stdout:9/806: stat dc/d9b/cbb 0 2024-05-06T14:04:23.032 INFO:tasks.workunit.client.1.smithi174.stdout:9/807: mkdir dc/d9b/de0/d118 0 2024-05-06T14:04:23.032 INFO:tasks.workunit.client.1.smithi174.stdout:6/990: dread d0/d25/f98 [290816,24576] 0 2024-05-06T14:04:23.032 INFO:tasks.workunit.client.1.smithi174.stdout:9/808: symlink dc/df/l119 0 2024-05-06T14:04:23.032 INFO:tasks.workunit.client.1.smithi174.stdout:2/823: dwrite d0/d24/fd6 [327680,20480] 0 2024-05-06T14:04:23.032 INFO:tasks.workunit.client.1.smithi174.stdout:2/824: creat d0/d1/d2/d4/d18/d2d/d32/fff x:0 0 0 2024-05-06T14:04:23.032 INFO:tasks.workunit.client.1.smithi174.stdout:2/825: getdents d0/db/d72 0 2024-05-06T14:04:23.032 INFO:tasks.workunit.client.1.smithi174.stdout:2/826: read d0/db/d15/f4e [491339,65094] 0 2024-05-06T14:04:23.032 INFO:tasks.workunit.client.1.smithi174.stdout:2/827: creat d0/da/dd7/f100 x:0 0 0 2024-05-06T14:04:23.033 INFO:tasks.workunit.client.1.smithi174.stdout:2/828: unlink d0/d1/f8e 0 2024-05-06T14:04:23.033 INFO:tasks.workunit.client.1.smithi174.stdout:2/829: chown d0/db/d72/c8d 76419128 1 2024-05-06T14:04:23.033 INFO:tasks.workunit.client.1.smithi174.stdout:6/991: dwrite d0/d25/d52/dba/ff7 [1458176,122880] 0 2024-05-06T14:04:23.033 INFO:tasks.workunit.client.1.smithi174.stdout:6/992: mkdir d0/d25/d52/da6/d143 0 2024-05-06T14:04:23.033 INFO:tasks.workunit.client.1.smithi174.stdout:6/993: chown d0/d25/d52/d2c/d105/d56/c11a 194 1 2024-05-06T14:04:23.033 INFO:tasks.workunit.client.1.smithi174.stdout:6/994: symlink d0/d25/d52/d2c/d5f/daa/l144 0 2024-05-06T14:04:23.033 INFO:tasks.workunit.client.1.smithi174.stdout:6/995: truncate d0/d25/d52/d2c/d6f/f99 1935581 0 2024-05-06T14:04:23.034 INFO:tasks.workunit.client.1.smithi174.stdout:6/996: mkdir d0/d25/d52/d2c/d105/d4b/d145 0 2024-05-06T14:04:23.034 INFO:tasks.workunit.client.1.smithi174.stdout:6/997: creat d0/df/d3c/d7a/f146 x:0 0 0 2024-05-06T14:04:23.034 INFO:tasks.workunit.client.1.smithi174.stdout:6/998: truncate d0/d25/d52/d2c/d5f/f102 308191 0 2024-05-06T14:04:23.151 INFO:tasks.workunit.client.1.smithi174.stdout:9/809: fsync dc/d27/d6d/f8a 0 2024-05-06T14:04:23.152 INFO:tasks.workunit.client.1.smithi174.stdout:9/810: chown dc/d27/c86 7 1 2024-05-06T14:04:23.152 INFO:tasks.workunit.client.1.smithi174.stdout:9/811: getdents dc/de/d81/da6 0 2024-05-06T14:04:23.155 INFO:tasks.workunit.client.1.smithi174.stdout:9/812: dwrite dc/d27/f2a [266240,65536] 0 2024-05-06T14:04:23.166 INFO:tasks.workunit.client.1.smithi174.stdout:9/813: creat dc/d17/d3a/f11a x:0 0 0 2024-05-06T14:04:23.167 INFO:tasks.workunit.client.1.smithi174.stdout:9/814: mknod dc/d27/d51/da5/c11b 0 2024-05-06T14:04:23.167 INFO:tasks.workunit.client.1.smithi174.stdout:9/815: rename dc/d17/db8/lb9 to dc/d17/d3a/dcb/daf/d43/l11c 0 2024-05-06T14:04:23.283 INFO:tasks.workunit.client.1.smithi174.stdout:9/816: fdatasync dc/d17/d3a/dcb/daf/d43/d8e/fd0 0 2024-05-06T14:04:23.283 INFO:tasks.workunit.client.1.smithi174.stdout:9/817: read - dc/d1c/fcf zero size 2024-05-06T14:04:23.283 INFO:tasks.workunit.client.1.smithi174.stdout:9/818: truncate dc/d27/d6d/ff0 196431 0 2024-05-06T14:04:23.285 INFO:tasks.workunit.client.1.smithi174.stdout:7/734: sync 2024-05-06T14:04:23.346 INFO:tasks.workunit.client.1.smithi174.stdout:7/735: fdatasync d0/d1d/da4/d61/fb 0 2024-05-06T14:04:23.346 INFO:tasks.workunit.client.1.smithi174.stdout:7/736: chown d0/d1d/da4/d61/fb9 85 1 2024-05-06T14:04:23.347 INFO:tasks.workunit.client.1.smithi174.stdout:7/737: write d0/d1d/da4/d61/d19/d24/d47/f7a [886088,125593] 0 2024-05-06T14:04:23.353 INFO:tasks.workunit.client.1.smithi174.stdout:7/738: mkdir d0/d1d/d9c/dad/dda/de5/dfa 0 2024-05-06T14:04:23.353 INFO:tasks.workunit.client.1.smithi174.stdout:7/739: dread d0/d1d/da4/d61/d19/d24/d14/d52/f3e [1859584,57344] 0 2024-05-06T14:04:23.354 INFO:tasks.workunit.client.1.smithi174.stdout:7/740: dwrite d0/d1d/da4/d61/d19/d39/d46/f81 [954368,24576] 0 2024-05-06T14:04:23.441 INFO:tasks.workunit.client.1.smithi174.stdout:3/755: sync 2024-05-06T14:04:23.441 INFO:tasks.workunit.client.1.smithi174.stdout:1/857: sync 2024-05-06T14:04:23.441 INFO:tasks.workunit.client.1.smithi174.stdout:0/878: sync 2024-05-06T14:04:23.441 INFO:tasks.workunit.client.1.smithi174.stdout:3/756: unlink df/d10/l26 0 2024-05-06T14:04:23.442 INFO:tasks.workunit.client.1.smithi174.stdout:1/858: truncate d11/d1f/d27/d32/d84/d8c/d94/db0/fb9 378489 0 2024-05-06T14:04:23.442 INFO:tasks.workunit.client.1.smithi174.stdout:1/859: truncate d11/d1f/d27/d32/fff 1545877 0 2024-05-06T14:04:23.442 INFO:tasks.workunit.client.1.smithi174.stdout:0/879: rename d0/d4/d80/d93/dbe/fc6 to d0/d36/d45/d114/f12a 0 2024-05-06T14:04:23.442 INFO:tasks.workunit.client.1.smithi174.stdout:0/880: truncate d0/d4/d8/d25/d5c/d44/f108 769180 0 2024-05-06T14:04:23.442 INFO:tasks.workunit.client.1.smithi174.stdout:3/757: creat df/d2d/d5b/fef x:0 0 0 2024-05-06T14:04:23.467 INFO:tasks.workunit.client.1.smithi174.stdout:7/741: fsync d0/d1d/da4/d61/d28/f62 0 2024-05-06T14:04:23.468 INFO:tasks.workunit.client.1.smithi174.stdout:7/742: chown d0/d1d/da4/d61/d19/f1c 80 1 2024-05-06T14:04:23.468 INFO:tasks.workunit.client.1.smithi174.stdout:9/819: fsync dc/d17/d3a/dcb/ff1 0 2024-05-06T14:04:23.468 INFO:tasks.workunit.client.1.smithi174.stdout:9/820: mknod dc/df/de8/c11d 0 2024-05-06T14:04:23.468 INFO:tasks.workunit.client.1.smithi174.stdout:0/881: fsync d0/d36/d3f/d7a/ff7 0 2024-05-06T14:04:23.471 INFO:tasks.workunit.client.1.smithi174.stdout:9/821: mkdir dc/d27/d51/da5/d11e 0 2024-05-06T14:04:23.471 INFO:tasks.workunit.client.1.smithi174.stdout:7/743: mkdir d0/d1d/da4/d61/d28/d37/dfb 0 2024-05-06T14:04:23.471 INFO:tasks.workunit.client.1.smithi174.stdout:1/860: dwrite d11/d1f/d27/d32/d92/feb [77824,4096] 0 2024-05-06T14:04:23.471 INFO:tasks.workunit.client.1.smithi174.stdout:0/882: readlink d0/d4/d8/d25/l115 0 2024-05-06T14:04:23.471 INFO:tasks.workunit.client.1.smithi174.stdout:9/822: dread dc/df/f12 [368640,40960] 0 2024-05-06T14:04:23.471 INFO:tasks.workunit.client.1.smithi174.stdout:7/744: chown d0/d1d/da4/d61/d28/f62 57336 1 2024-05-06T14:04:23.471 INFO:tasks.workunit.client.1.smithi174.stdout:7/745: link d0/d1d/da4/d61/d19/d24/c9a d0/d1d/da4/d61/d19/d39/d90/de9/cfc 0 2024-05-06T14:04:23.472 INFO:tasks.workunit.client.1.smithi174.stdout:0/883: creat d0/d4/d8/d25/d5c/d44/dd5/d83/f12b x:0 0 0 2024-05-06T14:04:23.472 INFO:tasks.workunit.client.1.smithi174.stdout:1/861: symlink d11/d57/d77/dea/l125 0 2024-05-06T14:04:23.472 INFO:tasks.workunit.client.1.smithi174.stdout:1/862: rmdir d11/d1f/d27/d2d 39 2024-05-06T14:04:23.472 INFO:tasks.workunit.client.1.smithi174.stdout:0/884: write d0/d3/d104/f1b [1657806,24811] 0 2024-05-06T14:04:23.472 INFO:tasks.workunit.client.1.smithi174.stdout:0/885: creat d0/d3/dad/f12c x:0 0 0 2024-05-06T14:04:23.472 INFO:tasks.workunit.client.1.smithi174.stdout:0/886: creat d0/d36/d3f/f12d x:0 0 0 2024-05-06T14:04:23.472 INFO:tasks.workunit.client.1.smithi174.stdout:9/823: write dc/f36 [2388332,111137] 0 2024-05-06T14:04:23.473 INFO:tasks.workunit.client.1.smithi174.stdout:9/824: chown dc/d9b 48 1 2024-05-06T14:04:23.473 INFO:tasks.workunit.client.1.smithi174.stdout:9/825: mkdir dc/de/d7f/da4/ded/d11f 0 2024-05-06T14:04:23.473 INFO:tasks.workunit.client.1.smithi174.stdout:9/826: mkdir dc/d17/d3a/dcb/daf/d43/d8e/d120 0 2024-05-06T14:04:23.473 INFO:tasks.workunit.client.1.smithi174.stdout:9/827: chown dc/d9b/de0/l10d 8 1 2024-05-06T14:04:23.473 INFO:tasks.workunit.client.1.smithi174.stdout:9/828: symlink dc/d17/d4c/l121 0 2024-05-06T14:04:23.473 INFO:tasks.workunit.client.1.smithi174.stdout:9/829: write dc/f25 [1267179,83471] 0 2024-05-06T14:04:23.473 INFO:tasks.workunit.client.1.smithi174.stdout:9/830: mknod dc/d27/dc9/c122 0 2024-05-06T14:04:23.473 INFO:tasks.workunit.client.1.smithi174.stdout:9/831: unlink dc/df/de8/c11d 0 2024-05-06T14:04:23.474 INFO:tasks.workunit.client.1.smithi174.stdout:9/832: truncate dc/d17/d3a/db2/fbc 853036 0 2024-05-06T14:04:23.474 INFO:tasks.workunit.client.1.smithi174.stdout:9/833: truncate dc/d17/d3a/dcb/daf/d43/d8e/f10b 747235 0 2024-05-06T14:04:23.478 INFO:tasks.workunit.client.1.smithi174.stdout:3/758: dread df/d10/f3f [1585152,49152] 0 2024-05-06T14:04:23.478 INFO:tasks.workunit.client.1.smithi174.stdout:3/759: mknod df/d10/d1b/d59/cf0 0 2024-05-06T14:04:23.478 INFO:tasks.workunit.client.1.smithi174.stdout:3/760: chown df/d2d/d84/cbb 345332154 1 2024-05-06T14:04:23.509 INFO:tasks.workunit.client.1.smithi174.stdout:1/863: dwrite d11/d1f/d27/f5d [413696,81920] 0 2024-05-06T14:04:23.509 INFO:tasks.workunit.client.1.smithi174.stdout:1/864: write d11/d1f/d27/d32/d84/d8c/fa4 [2624206,92981] 0 2024-05-06T14:04:23.509 INFO:tasks.workunit.client.1.smithi174.stdout:1/865: chown d11/d41/d4a/f56 255249928 1 2024-05-06T14:04:23.509 INFO:tasks.workunit.client.1.smithi174.stdout:1/866: read d11/d1f/d27/f5d [1158827,124206] 0 2024-05-06T14:04:23.509 INFO:tasks.workunit.client.1.smithi174.stdout:3/761: dwrite df/d10/faa [45056,110592] 0 2024-05-06T14:04:23.509 INFO:tasks.workunit.client.1.smithi174.stdout:7/746: dwrite d0/d1d/da4/d61/d19/d39/d9e/fe1 [471040,12288] 0 2024-05-06T14:04:23.509 INFO:tasks.workunit.client.1.smithi174.stdout:3/762: link df/d10/d1b/d7e/f75 df/d2d/d4e/d81/ff1 0 2024-05-06T14:04:23.510 INFO:tasks.workunit.client.1.smithi174.stdout:3/763: rmdir df/d2d/d4e 39 2024-05-06T14:04:23.510 INFO:tasks.workunit.client.1.smithi174.stdout:7/747: getdents d0/d1d/d9c/dad/dda/de5/dfa 0 2024-05-06T14:04:23.510 INFO:tasks.workunit.client.1.smithi174.stdout:9/834: dwrite dc/de/f2e [2621440,77824] 0 2024-05-06T14:04:23.510 INFO:tasks.workunit.client.1.smithi174.stdout:9/835: getdents dc/d17/d4c 0 2024-05-06T14:04:23.510 INFO:tasks.workunit.client.1.smithi174.stdout:9/836: unlink dc/d27/l7a 0 2024-05-06T14:04:23.510 INFO:tasks.workunit.client.1.smithi174.stdout:9/837: dread dc/d17/d3a/dcb/daf/d43/d8e/f10b [225280,118784] 0 2024-05-06T14:04:23.539 INFO:tasks.workunit.client.1.smithi174.stdout:0/887: fsync d0/d16/fcc 0 2024-05-06T14:04:23.539 INFO:tasks.workunit.client.1.smithi174.stdout:0/888: dread d0/d36/d45/fc5 [798720,49152] 0 2024-05-06T14:04:23.539 INFO:tasks.workunit.client.1.smithi174.stdout:3/764: fdatasync df/d10/d1b/d7e/d5a/f99 0 2024-05-06T14:04:23.540 INFO:tasks.workunit.client.1.smithi174.stdout:9/838: fdatasync dc/de/f4f 0 2024-05-06T14:04:23.540 INFO:tasks.workunit.client.1.smithi174.stdout:3/765: write df/d2d/d4e/fdf [470412,12194] 0 2024-05-06T14:04:23.540 INFO:tasks.workunit.client.1.smithi174.stdout:3/766: truncate df/d2d/d4d/da5/fb0 681764 0 2024-05-06T14:04:23.540 INFO:tasks.workunit.client.1.smithi174.stdout:3/767: chown df/d10/d1b/f56 388 1 2024-05-06T14:04:23.540 INFO:tasks.workunit.client.1.smithi174.stdout:0/889: write d0/d4/d80/d93/f113 [884965,117897] 0 2024-05-06T14:04:23.540 INFO:tasks.workunit.client.1.smithi174.stdout:3/768: write df/f90 [809896,64127] 0 2024-05-06T14:04:23.540 INFO:tasks.workunit.client.1.smithi174.stdout:3/769: write df/d2d/d5b/f71 [1333493,85301] 0 2024-05-06T14:04:23.545 INFO:tasks.workunit.client.1.smithi174.stdout:7/748: dwrite d0/d1d/da4/d61/d28/d59/f3f [1298432,118784] 0 2024-05-06T14:04:23.545 INFO:tasks.workunit.client.1.smithi174.stdout:1/867: dwrite d11/d1f/d27/f45 [548864,24576] 0 2024-05-06T14:04:23.545 INFO:tasks.workunit.client.1.smithi174.stdout:3/770: truncate df/d2d/d4e/fdf 416799 0 2024-05-06T14:04:23.545 INFO:tasks.workunit.client.1.smithi174.stdout:1/868: dread - d11/d1f/d27/d32/d92/dbc/ff1 zero size 2024-05-06T14:04:23.545 INFO:tasks.workunit.client.1.smithi174.stdout:7/749: write d0/d1d/da4/f4b [3444578,16846] 0 2024-05-06T14:04:23.545 INFO:tasks.workunit.client.1.smithi174.stdout:3/771: creat df/d10/d1b/d7e/ff2 x:0 0 0 2024-05-06T14:04:23.546 INFO:tasks.workunit.client.1.smithi174.stdout:3/772: symlink df/d2d/d4e/d81/de3/lf3 0 2024-05-06T14:04:23.546 INFO:tasks.workunit.client.1.smithi174.stdout:3/773: write df/d10/f3f [1805324,109298] 0 2024-05-06T14:04:23.546 INFO:tasks.workunit.client.1.smithi174.stdout:3/774: mkdir df/d2d/d87/df4 0 2024-05-06T14:04:23.546 INFO:tasks.workunit.client.1.smithi174.stdout:3/775: dread df/d2d/d4d/da5/fd7 [118784,122880] 0 2024-05-06T14:04:23.546 INFO:tasks.workunit.client.1.smithi174.stdout:9/839: write dc/d17/d3a/dcb/ff1 [2582555,113698] 0 2024-05-06T14:04:23.546 INFO:tasks.workunit.client.1.smithi174.stdout:3/776: creat df/d10/dcb/ff5 x:0 0 0 2024-05-06T14:04:23.547 INFO:tasks.workunit.client.1.smithi174.stdout:9/840: symlink dc/d17/d3a/dcb/daf/d43/l123 0 2024-05-06T14:04:23.547 INFO:tasks.workunit.client.1.smithi174.stdout:0/890: dwrite d0/d4/d8/d25/f63 [987136,94208] 0 2024-05-06T14:04:23.624 INFO:tasks.workunit.client.1.smithi174.stdout:2/830: sync 2024-05-06T14:04:23.624 INFO:tasks.workunit.client.1.smithi174.stdout:6/999: sync 2024-05-06T14:04:23.624 INFO:tasks.workunit.client.1.smithi174.stdout:0/891: truncate d0/d36/f3b 411487 0 2024-05-06T14:04:23.625 INFO:tasks.workunit.client.1.smithi174.stdout:2/831: creat d0/d24/d77/f101 x:0 0 0 2024-05-06T14:04:23.625 INFO:tasks.workunit.client.1.smithi174.stdout:0/892: creat d0/d4/d8/d25/f12e x:0 0 0 2024-05-06T14:04:23.625 INFO:tasks.workunit.client.1.smithi174.stdout:0/893: write d0/f59 [2696800,43130] 0 2024-05-06T14:04:23.625 INFO:tasks.workunit.client.1.smithi174.stdout:0/894: symlink d0/d4/d8/d25/d5c/d44/db9/l12f 0 2024-05-06T14:04:23.625 INFO:tasks.workunit.client.1.smithi174.stdout:0/895: unlink d0/d4/d8/d25/d5c/d44/dd5/d83/f12b 0 2024-05-06T14:04:23.625 INFO:tasks.workunit.client.1.smithi174.stdout:0/896: mkdir d0/d4/d80/d93/dbe/d130 0 2024-05-06T14:04:23.648 INFO:tasks.workunit.client.1.smithi174.stdout:9/841: fdatasync dc/d27/d6d/ff0 0 2024-05-06T14:04:23.649 INFO:tasks.workunit.client.1.smithi174.stdout:3/777: fsync df/f1f 0 2024-05-06T14:04:23.649 INFO:tasks.workunit.client.1.smithi174.stdout:1/869: fsync d11/d1f/d27/d32/d84/ddc/fe1 0 2024-05-06T14:04:23.649 INFO:tasks.workunit.client.1.smithi174.stdout:3/778: chown df/d10/d1b/d7e/lcd 498 1 2024-05-06T14:04:23.649 INFO:tasks.workunit.client.1.smithi174.stdout:3/779: chown l1 133 1 2024-05-06T14:04:23.649 INFO:tasks.workunit.client.1.smithi174.stdout:1/870: rmdir d11/d1f/d27/d32/d84/d8c/dee 39 2024-05-06T14:04:23.649 INFO:tasks.workunit.client.1.smithi174.stdout:1/871: unlink d11/d41/cdb 0 2024-05-06T14:04:23.649 INFO:tasks.workunit.client.1.smithi174.stdout:3/780: creat df/d2d/d4e/d81/de3/ff6 x:0 0 0 2024-05-06T14:04:23.650 INFO:tasks.workunit.client.1.smithi174.stdout:9/842: mkdir dc/de/df3/d124 0 2024-05-06T14:04:23.650 INFO:tasks.workunit.client.1.smithi174.stdout:3/781: dread df/f90 [221184,61440] 0 2024-05-06T14:04:23.650 INFO:tasks.workunit.client.1.smithi174.stdout:1/872: unlink d11/f5a 0 2024-05-06T14:04:23.650 INFO:tasks.workunit.client.1.smithi174.stdout:1/873: chown d11/d1f/d27/fcf 32246 1 2024-05-06T14:04:23.650 INFO:tasks.workunit.client.1.smithi174.stdout:3/782: unlink df/d10/d1b/d7e/d5a/f6a 0 2024-05-06T14:04:23.650 INFO:tasks.workunit.client.1.smithi174.stdout:0/897: fsync d0/d4/d8/d25/d5c/d44/f69 0 2024-05-06T14:04:23.651 INFO:tasks.workunit.client.1.smithi174.stdout:0/898: mkdir d0/d16/d131 0 2024-05-06T14:04:23.651 INFO:tasks.workunit.client.1.smithi174.stdout:0/899: mkdir d0/d4/d80/d93/dbe/d132 0 2024-05-06T14:04:23.651 INFO:tasks.workunit.client.1.smithi174.stdout:0/900: rmdir d0/d36/d3f/d7a 39 2024-05-06T14:04:23.653 INFO:tasks.workunit.client.1.smithi174.stdout:2/832: dwrite d0/d1/d2/d4/d18/f64 [327680,20480] 0 2024-05-06T14:04:23.653 INFO:tasks.workunit.client.1.smithi174.stdout:2/833: dread d0/d1/d2/d4/d6/fcd [913408,45056] 0 2024-05-06T14:04:23.653 INFO:tasks.workunit.client.1.smithi174.stdout:2/834: stat d0/db/d72/c8d 0 2024-05-06T14:04:23.653 INFO:tasks.workunit.client.1.smithi174.stdout:2/835: rmdir d0/db/d15 39 2024-05-06T14:04:23.654 INFO:tasks.workunit.client.1.smithi174.stdout:2/836: getdents d0/d24/d77/d93/d9a/dfd/da2/db6 0 2024-05-06T14:04:23.654 INFO:tasks.workunit.client.1.smithi174.stdout:2/837: read - d0/d1/d2/d4/d18/d2d/d32/f8b zero size 2024-05-06T14:04:23.654 INFO:tasks.workunit.client.1.smithi174.stdout:2/838: write d0/d16/f85 [1603119,8353] 0 2024-05-06T14:04:23.654 INFO:tasks.workunit.client.1.smithi174.stdout:2/839: chown d0/d1/d2/d4/fb4 143577 1 2024-05-06T14:04:23.654 INFO:tasks.workunit.client.1.smithi174.stdout:2/840: rename d0/d1/fcb to d0/d1/d2/d4/d18/d2d/f102 0 2024-05-06T14:04:23.654 INFO:tasks.workunit.client.1.smithi174.stdout:2/841: write d0/d1/d2/d4/d18/fa0 [549325,80287] 0 2024-05-06T14:04:23.654 INFO:tasks.workunit.client.1.smithi174.stdout:2/842: dread d0/da/f74 [155648,98304] 0 2024-05-06T14:04:23.654 INFO:tasks.workunit.client.1.smithi174.stdout:2/843: creat d0/da/d3f/d67/f103 x:0 0 0 2024-05-06T14:04:23.655 INFO:tasks.workunit.client.1.smithi174.stdout:2/844: rmdir d0/d1/d2/d4/d51 39 2024-05-06T14:04:23.655 INFO:tasks.workunit.client.1.smithi174.stdout:3/783: dwrite df/d10/f16 [950272,32768] 0 2024-05-06T14:04:23.655 INFO:tasks.workunit.client.1.smithi174.stdout:3/784: chown df/d2d/d4e/lb2 0 1 2024-05-06T14:04:23.655 INFO:tasks.workunit.client.1.smithi174.stdout:3/785: dread df/d10/f3f [294912,106496] 0 2024-05-06T14:04:23.655 INFO:tasks.workunit.client.1.smithi174.stdout:3/786: write df/d10/d1b/fe5 [442341,63846] 0 2024-05-06T14:04:23.658 INFO:tasks.workunit.client.1.smithi174.stdout:9/843: dread dc/de/f68 [151552,65536] 0 2024-05-06T14:04:23.666 INFO:tasks.workunit.client.1.smithi174.stdout:1/874: dread d11/d1f/d27/d2d/f3a [544768,12288] 0 2024-05-06T14:04:23.666 INFO:tasks.workunit.client.1.smithi174.stdout:1/875: dread d11/d1f/d27/d2d/f52 [1699840,45056] 0 2024-05-06T14:04:23.731 INFO:tasks.workunit.client.1.smithi174.stdout:2/845: fsync d0/d1/d2/d4/fb4 0 2024-05-06T14:04:23.731 INFO:tasks.workunit.client.1.smithi174.stdout:2/846: chown d0/d1/d2/d4/d6/lc9 6600 1 2024-05-06T14:04:23.734 INFO:tasks.workunit.client.1.smithi174.stdout:0/901: dwrite d0/d36/d3f/d7a/f9c [602112,24576] 0 2024-05-06T14:04:23.734 INFO:tasks.workunit.client.1.smithi174.stdout:2/847: creat d0/d1/f104 x:0 0 0 2024-05-06T14:04:23.734 INFO:tasks.workunit.client.1.smithi174.stdout:3/787: dwrite df/d2d/d4d/f4f [380928,49152] 0 2024-05-06T14:04:23.734 INFO:tasks.workunit.client.1.smithi174.stdout:0/902: mknod d0/d16/d131/c133 0 2024-05-06T14:04:23.735 INFO:tasks.workunit.client.1.smithi174.stdout:2/848: mkdir d0/d1/d2/d4/d6/d105 0 2024-05-06T14:04:23.735 INFO:tasks.workunit.client.1.smithi174.stdout:3/788: creat df/d2d/d4d/da5/ff7 x:0 0 0 2024-05-06T14:04:23.735 INFO:tasks.workunit.client.1.smithi174.stdout:3/789: link df/d10/d1b/d7e/l79 df/dbc/lf8 0 2024-05-06T14:04:23.735 INFO:tasks.workunit.client.1.smithi174.stdout:3/790: chown df/l9b 6 1 2024-05-06T14:04:23.735 INFO:tasks.workunit.client.1.smithi174.stdout:0/903: mkdir d0/d4/d8/d25/d5c/dde/d134 0 2024-05-06T14:04:23.735 INFO:tasks.workunit.client.1.smithi174.stdout:3/791: creat df/d2d/d4e/db6/db8/dd9/ff9 x:0 0 0 2024-05-06T14:04:23.735 INFO:tasks.workunit.client.1.smithi174.stdout:3/792: write df/d2d/f53 [1216506,29976] 0 2024-05-06T14:04:23.735 INFO:tasks.workunit.client.1.smithi174.stdout:3/793: dread df/d10/d1b/d7e/f83 [229376,73728] 0 2024-05-06T14:04:23.736 INFO:tasks.workunit.client.1.smithi174.stdout:3/794: chown df/d10/d1b/d59/c5e 583702 1 2024-05-06T14:04:23.736 INFO:tasks.workunit.client.1.smithi174.stdout:3/795: mknod df/d2d/d4d/da5/cfa 0 2024-05-06T14:04:23.736 INFO:tasks.workunit.client.1.smithi174.stdout:1/876: dwrite d11/f20 [618496,110592] 0 2024-05-06T14:04:23.736 INFO:tasks.workunit.client.1.smithi174.stdout:1/877: stat d11/d57/d98/daf/db2/fb7 0 2024-05-06T14:04:23.747 INFO:tasks.workunit.client.1.smithi174.stdout:9/844: dread dc/f25 [520192,53248] 0 2024-05-06T14:04:23.747 INFO:tasks.workunit.client.1.smithi174.stdout:9/845: chown dc/d9b/dd4/fe4 43026 1 2024-05-06T14:04:23.766 INFO:tasks.workunit.client.1.smithi174.stdout:3/796: dwrite df/d10/f19 [1773568,20480] 0 2024-05-06T14:04:23.767 INFO:tasks.workunit.client.1.smithi174.stdout:3/797: dread df/d10/d1b/f56 [159744,8192] 0 2024-05-06T14:04:23.769 INFO:tasks.workunit.client.1.smithi174.stdout:1/878: write d11/f24 [960501,113208] 0 2024-05-06T14:04:23.771 INFO:tasks.workunit.client.1.smithi174.stdout:9/846: dwrite dc/d27/f39 [2912256,110592] 0 2024-05-06T14:04:23.771 INFO:tasks.workunit.client.1.smithi174.stdout:9/847: getdents dc/d17/db8 0 2024-05-06T14:04:23.771 INFO:tasks.workunit.client.1.smithi174.stdout:9/848: dread dc/d17/d3a/dcb/daf/fb5 [806912,45056] 0 2024-05-06T14:04:23.785 INFO:tasks.workunit.client.1.smithi174.stdout:0/904: dread d0/d4/d80/d93/f122 [0,90112] 0 2024-05-06T14:04:23.785 INFO:tasks.workunit.client.1.smithi174.stdout:0/905: creat d0/d3/dad/d119/f135 x:0 0 0 2024-05-06T14:04:23.785 INFO:tasks.workunit.client.1.smithi174.stdout:0/906: dread d0/d4/d8/d25/d5c/fa0 [847872,45056] 0 2024-05-06T14:04:23.785 INFO:tasks.workunit.client.1.smithi174.stdout:0/907: write d0/d4/d8/d25/d5c/d44/db9/fd9 [349974,120444] 0 2024-05-06T14:04:23.785 INFO:tasks.workunit.client.1.smithi174.stdout:0/908: dread - d0/d36/d45/d114/f12a zero size 2024-05-06T14:04:23.786 INFO:tasks.workunit.client.1.smithi174.stdout:0/909: write d0/d36/d3f/d7a/ff7 [407692,9604] 0 2024-05-06T14:04:23.786 INFO:tasks.workunit.client.1.smithi174.stdout:0/910: readlink d0/d3/dfc/l11a 0 2024-05-06T14:04:23.833 INFO:tasks.workunit.client.1.smithi174.stdout:3/798: fdatasync f7 0 2024-05-06T14:04:23.834 INFO:tasks.workunit.client.1.smithi174.stdout:1/879: dwrite d11/d1f/d27/d2d/ddd/f121 [49152,49152] 0 2024-05-06T14:04:23.834 INFO:tasks.workunit.client.1.smithi174.stdout:1/880: read d11/d41/d4a/d5e/f6f [265651,7514] 0 2024-05-06T14:04:23.834 INFO:tasks.workunit.client.1.smithi174.stdout:1/881: readlink d11/d1f/d27/d32/d84/d8c/d94/db0/l5f 0 2024-05-06T14:04:23.836 INFO:tasks.workunit.client.1.smithi174.stdout:9/849: unlink dc/d27/dc9/c122 0 2024-05-06T14:04:23.836 INFO:tasks.workunit.client.1.smithi174.stdout:9/850: mknod dc/d27/d6d/dd7/c125 0 2024-05-06T14:04:23.836 INFO:tasks.workunit.client.1.smithi174.stdout:9/851: creat dc/de/df3/d124/f126 x:0 0 0 2024-05-06T14:04:23.836 INFO:tasks.workunit.client.1.smithi174.stdout:9/852: chown dc/de/d7f/da4/fc4 167035 1 2024-05-06T14:04:23.836 INFO:tasks.workunit.client.1.smithi174.stdout:9/853: mkdir dc/de/d7f/d93/d127 0 2024-05-06T14:04:23.837 INFO:tasks.workunit.client.1.smithi174.stdout:9/854: mkdir dc/d17/db8/d128 0 2024-05-06T14:04:23.837 INFO:tasks.workunit.client.1.smithi174.stdout:9/855: creat dc/de/d6b/f129 x:0 0 0 2024-05-06T14:04:23.837 INFO:tasks.workunit.client.1.smithi174.stdout:9/856: link dc/f42 dc/de/d81/f12a 0 2024-05-06T14:04:23.837 INFO:tasks.workunit.client.1.smithi174.stdout:9/857: mknod dc/d17/d3a/dcb/daf/d43/d8e/dd2/c12b 0 2024-05-06T14:04:23.837 INFO:tasks.workunit.client.1.smithi174.stdout:3/799: dwrite df/f90 [2002944,86016] 0 2024-05-06T14:04:23.837 INFO:tasks.workunit.client.1.smithi174.stdout:3/800: dread - df/d2d/d87/fc4 zero size 2024-05-06T14:04:23.837 INFO:tasks.workunit.client.1.smithi174.stdout:3/801: chown df/d2d/d4e/db6 667612 1 2024-05-06T14:04:23.837 INFO:tasks.workunit.client.1.smithi174.stdout:3/802: write df/d10/d1b/d7e/d57/f80 [1932994,17082] 0 2024-05-06T14:04:23.838 INFO:tasks.workunit.client.1.smithi174.stdout:3/803: creat df/d10/d1b/d7e/d57/ffb x:0 0 0 2024-05-06T14:04:23.838 INFO:tasks.workunit.client.1.smithi174.stdout:3/804: read df/d10/d1b/f2b [124789,127507] 0 2024-05-06T14:04:23.867 INFO:tasks.workunit.client.1.smithi174.stdout:1/882: fsync d11/d57/d77/f10e 0 2024-05-06T14:04:23.867 INFO:tasks.workunit.client.1.smithi174.stdout:1/883: creat d11/d1f/d27/d32/d84/df3/f126 x:0 0 0 2024-05-06T14:04:23.868 INFO:tasks.workunit.client.1.smithi174.stdout:1/884: mknod d11/d1f/d27/d32/d84/df3/c127 0 2024-05-06T14:04:23.868 INFO:tasks.workunit.client.1.smithi174.stdout:1/885: write d11/d41/f5c [758208,115322] 0 2024-05-06T14:04:23.868 INFO:tasks.workunit.client.1.smithi174.stdout:1/886: link d11/d41/dc9/d6c/f11f d11/d1f/d27/d32/d92/f128 0 2024-05-06T14:04:23.868 INFO:tasks.workunit.client.1.smithi174.stdout:1/887: creat d11/d1f/d27/d32/d84/d8c/d94/db0/d123/f129 x:0 0 0 2024-05-06T14:04:23.868 INFO:tasks.workunit.client.1.smithi174.stdout:9/858: dwrite f7 [180224,12288] 0 2024-05-06T14:04:23.868 INFO:tasks.workunit.client.1.smithi174.stdout:9/859: write dc/d17/d4c/f72 [1690206,111971] 0 2024-05-06T14:04:23.868 INFO:tasks.workunit.client.1.smithi174.stdout:9/860: write dc/d17/d3a/dcb/f6a [94496,102884] 0 2024-05-06T14:04:23.869 INFO:tasks.workunit.client.1.smithi174.stdout:9/861: creat dc/d17/d3a/dcb/daf/d43/d8e/dd2/f12c x:0 0 0 2024-05-06T14:04:23.869 INFO:tasks.workunit.client.1.smithi174.stdout:9/862: read dc/d27/d6d/f6f [206834,65225] 0 2024-05-06T14:04:23.869 INFO:tasks.workunit.client.1.smithi174.stdout:9/863: dread dc/f3b [335872,65536] 0 2024-05-06T14:04:23.869 INFO:tasks.workunit.client.1.smithi174.stdout:9/864: creat dc/d9b/dd4/f12d x:0 0 0 2024-05-06T14:04:23.875 INFO:tasks.workunit.client.1.smithi174.stdout:3/805: dread df/d10/d1b/d7e/d5a/f69 [839680,69632] 0 2024-05-06T14:04:23.875 INFO:tasks.workunit.client.1.smithi174.stdout:3/806: write df/d10/d1b/d7e/fa1 [750248,10601] 0 2024-05-06T14:04:23.875 INFO:tasks.workunit.client.1.smithi174.stdout:3/807: rename df/d2d/d4d/da5/ff7 to df/dbc/ffc 0 2024-05-06T14:04:23.876 INFO:tasks.workunit.client.1.smithi174.stdout:3/808: mknod df/d10/d1b/d7e/d5a/cfd 0 2024-05-06T14:04:23.971 INFO:tasks.workunit.client.1.smithi174.stdout:3/809: fsync df/d10/f52 0 2024-05-06T14:04:23.971 INFO:tasks.workunit.client.1.smithi174.stdout:3/810: dread - df/d10/dcb/ff5 zero size 2024-05-06T14:04:23.972 INFO:tasks.workunit.client.1.smithi174.stdout:3/811: rename fe to df/d10/d1b/d59/ffe 0 2024-05-06T14:04:23.972 INFO:tasks.workunit.client.1.smithi174.stdout:3/812: getdents df/d2d/d4d 0 2024-05-06T14:04:23.972 INFO:tasks.workunit.client.1.smithi174.stdout:3/813: readlink l3 0 2024-05-06T14:04:23.972 INFO:tasks.workunit.client.1.smithi174.stdout:3/814: rmdir df/d2d/d5b 39 2024-05-06T14:04:23.972 INFO:tasks.workunit.client.1.smithi174.stdout:3/815: symlink df/d10/d1b/d7e/d57/lff 0 2024-05-06T14:04:23.972 INFO:tasks.workunit.client.1.smithi174.stdout:3/816: chown df/d10/d1b/d7e/d5a/ca6 18606 1 2024-05-06T14:04:23.972 INFO:tasks.workunit.client.1.smithi174.stdout:3/817: truncate df/d10/d1b/d7e/d57/fe2 446236 0 2024-05-06T14:04:23.972 INFO:tasks.workunit.client.1.smithi174.stdout:3/818: getdents df/d2d/d4e/db6/db9 0 2024-05-06T14:04:23.973 INFO:tasks.workunit.client.1.smithi174.stdout:3/819: write df/d10/d1b/d59/fa9 [865059,34576] 0 2024-05-06T14:04:23.973 INFO:tasks.workunit.client.1.smithi174.stdout:3/820: dread df/d10/d1b/f2b [430080,4096] 0 2024-05-06T14:04:23.973 INFO:tasks.workunit.client.1.smithi174.stdout:3/821: creat df/d2d/d4e/d81/de3/f100 x:0 0 0 2024-05-06T14:04:23.973 INFO:tasks.workunit.client.1.smithi174.stdout:3/822: chown df/d10/d1b/d7e 1616464247 1 2024-05-06T14:04:23.974 INFO:tasks.workunit.client.1.smithi174.stdout:7/750: sync 2024-05-06T14:04:24.027 INFO:tasks.workunit.client.1.smithi174.stdout:9/865: fsync dc/f42 0 2024-05-06T14:04:24.028 INFO:tasks.workunit.client.1.smithi174.stdout:9/866: rmdir dc/d27/dc9 39 2024-05-06T14:04:24.028 INFO:tasks.workunit.client.1.smithi174.stdout:7/751: fsync d0/d1d/da4/d61/d19/d24/d47/dc6/fe3 0 2024-05-06T14:04:24.029 INFO:tasks.workunit.client.1.smithi174.stdout:9/867: dwrite dc/d17/d3a/dcb/daf/f16 [176128,32768] 0 2024-05-06T14:04:24.029 INFO:tasks.workunit.client.1.smithi174.stdout:9/868: rename dc/de/d7f/c95 to dc/d9b/de0/d118/c12e 0 2024-05-06T14:04:24.031 INFO:tasks.workunit.client.1.smithi174.stdout:7/752: dwrite d0/d1d/da4/d61/d28/d59/da1/dcf/fd5 [536576,61440] 0 2024-05-06T14:04:24.033 INFO:tasks.workunit.client.1.smithi174.stdout:7/753: creat d0/d1d/d9c/dad/dda/de5/dfa/ffd x:0 0 0 2024-05-06T14:04:24.034 INFO:tasks.workunit.client.1.smithi174.stdout:3/823: write df/d10/faa [71510,8788] 0 2024-05-06T14:04:24.034 INFO:tasks.workunit.client.1.smithi174.stdout:3/824: chown df/f1f 769 1 2024-05-06T14:04:24.034 INFO:tasks.workunit.client.1.smithi174.stdout:3/825: truncate df/d2d/d4e/d81/ff1 1289962 0 2024-05-06T14:04:24.034 INFO:tasks.workunit.client.1.smithi174.stdout:7/754: symlink d0/d1d/d9c/dad/lfe 0 2024-05-06T14:04:24.034 INFO:tasks.workunit.client.1.smithi174.stdout:7/755: chown d0/d1d/da4/fc3 1690732 1 2024-05-06T14:04:24.034 INFO:tasks.workunit.client.1.smithi174.stdout:7/756: chown d0/d1d/da4/d61/d28/d59/da1/faf 329372 1 2024-05-06T14:04:24.034 INFO:tasks.workunit.client.1.smithi174.stdout:3/826: write df/d10/d1b/d7e/d57/f80 [2356352,47455] 0 2024-05-06T14:04:24.035 INFO:tasks.workunit.client.1.smithi174.stdout:3/827: chown df/d10/d1b/d7e/ff2 265 1 2024-05-06T14:04:24.035 INFO:tasks.workunit.client.1.smithi174.stdout:3/828: getdents df/dbc 0 2024-05-06T14:04:24.035 INFO:tasks.workunit.client.1.smithi174.stdout:3/829: mknod df/d2d/d4e/d81/c101 0 2024-05-06T14:04:24.035 INFO:tasks.workunit.client.1.smithi174.stdout:3/830: mknod df/d2d/d87/c102 0 2024-05-06T14:04:24.035 INFO:tasks.workunit.client.1.smithi174.stdout:3/831: getdents df/d2d/d4d/da5 0 2024-05-06T14:04:24.035 INFO:tasks.workunit.client.1.smithi174.stdout:3/832: mknod df/d2d/d87/df4/c103 0 2024-05-06T14:04:24.035 INFO:tasks.workunit.client.1.smithi174.stdout:3/833: dread df/f55 [200704,69632] 0 2024-05-06T14:04:24.035 INFO:tasks.workunit.client.1.smithi174.stdout:3/834: dread df/d10/d1b/d7e/fa1 [77824,61440] 0 2024-05-06T14:04:24.036 INFO:tasks.workunit.client.1.smithi174.stdout:3/835: chown df/d2d/d87/fc4 1 1 2024-05-06T14:04:24.036 INFO:tasks.workunit.client.1.smithi174.stdout:9/869: dwrite f7 [258048,53248] 0 2024-05-06T14:04:24.036 INFO:tasks.workunit.client.1.smithi174.stdout:9/870: write dc/d27/d6d/f6f [22951,59863] 0 2024-05-06T14:04:24.036 INFO:tasks.workunit.client.1.smithi174.stdout:9/871: write dc/d1c/f7d [398883,21566] 0 2024-05-06T14:04:24.036 INFO:tasks.workunit.client.1.smithi174.stdout:9/872: dread dc/d1c/f56 [1490944,53248] 0 2024-05-06T14:04:24.036 INFO:tasks.workunit.client.1.smithi174.stdout:9/873: creat dc/de/d7f/d93/d127/f12f x:0 0 0 2024-05-06T14:04:24.036 INFO:tasks.workunit.client.1.smithi174.stdout:9/874: link dc/de/d7f/d93/d127/f12f dc/de/d7f/da4/ded/f130 0 2024-05-06T14:04:24.037 INFO:tasks.workunit.client.1.smithi174.stdout:9/875: chown dc/df/f11 669978413 1 2024-05-06T14:04:24.037 INFO:tasks.workunit.client.1.smithi174.stdout:9/876: creat dc/d17/d3a/dcb/daf/d43/f131 x:0 0 0 2024-05-06T14:04:24.037 INFO:tasks.workunit.client.1.smithi174.stdout:9/877: rmdir dc/d17/db8/d128 0 2024-05-06T14:04:24.037 INFO:tasks.workunit.client.1.smithi174.stdout:9/878: readlink dc/d27/d6d/l6e 0 2024-05-06T14:04:24.097 INFO:tasks.workunit.client.1.smithi174.stdout:7/757: dwrite d0/d1d/da4/d61/d19/d24/d47/fbd [172032,49152] 0 2024-05-06T14:04:24.097 INFO:tasks.workunit.client.1.smithi174.stdout:7/758: link d0/d1d/da4/d61/d19/d24/d47/c6b d0/d1d/d9c/dad/dda/de5/cff 0 2024-05-06T14:04:24.097 INFO:tasks.workunit.client.1.smithi174.stdout:7/759: creat d0/d3a/dd7/f100 x:0 0 0 2024-05-06T14:04:24.097 INFO:tasks.workunit.client.1.smithi174.stdout:7/760: write d0/d1d/da4/d61/d28/fec [883340,114069] 0 2024-05-06T14:04:24.098 INFO:tasks.workunit.client.1.smithi174.stdout:7/761: write d0/d1d/d9c/dad/dda/de5/dfa/ffd [61434,33809] 0 2024-05-06T14:04:24.098 INFO:tasks.workunit.client.1.smithi174.stdout:9/879: dwrite f7 [1261568,81920] 0 2024-05-06T14:04:24.098 INFO:tasks.workunit.client.1.smithi174.stdout:7/762: mkdir d0/d1d/da4/d61/d19/d39/d90/da6/d101 0 2024-05-06T14:04:24.098 INFO:tasks.workunit.client.1.smithi174.stdout:7/763: creat d0/d1d/da4/d61/d19/d24/d47/d70/d67/f102 x:0 0 0 2024-05-06T14:04:24.098 INFO:tasks.workunit.client.1.smithi174.stdout:9/880: getdents dc/de/d7f/da4 0 2024-05-06T14:04:24.098 INFO:tasks.workunit.client.1.smithi174.stdout:7/764: mknod d0/d1d/da4/d61/d19/d24/d14/d52/c103 0 2024-05-06T14:04:24.099 INFO:tasks.workunit.client.1.smithi174.stdout:9/881: readlink dc/d27/l5e 0 2024-05-06T14:04:24.099 INFO:tasks.workunit.client.1.smithi174.stdout:7/765: dread - d0/d1d/da4/d61/d19/d24/d47/d64/fa9 zero size 2024-05-06T14:04:24.099 INFO:tasks.workunit.client.1.smithi174.stdout:9/882: chown dc/d1c/feb 1623 1 2024-05-06T14:04:24.099 INFO:tasks.workunit.client.1.smithi174.stdout:9/883: rmdir dc/de/df3 39 2024-05-06T14:04:24.099 INFO:tasks.workunit.client.1.smithi174.stdout:7/766: link d0/d1d/da4/d61/d19/d24/d14/d52/f8c d0/d1d/d9c/dad/dda/de5/f104 0 2024-05-06T14:04:24.099 INFO:tasks.workunit.client.1.smithi174.stdout:9/884: read dc/de/f68 [206595,59143] 0 2024-05-06T14:04:24.100 INFO:tasks.workunit.client.1.smithi174.stdout:7/767: symlink d0/d1d/da4/d61/d28/d37/l105 0 2024-05-06T14:04:24.100 INFO:tasks.workunit.client.1.smithi174.stdout:7/768: write d0/d1d/da4/d61/fb9 [522058,123236] 0 2024-05-06T14:04:24.100 INFO:tasks.workunit.client.1.smithi174.stdout:7/769: mkdir d0/d1d/da4/d61/d19/d24/d47/dc6/d106 0 2024-05-06T14:04:24.100 INFO:tasks.workunit.client.1.smithi174.stdout:7/770: creat d0/d1d/da4/d61/d19/d24/d47/dc6/f107 x:0 0 0 2024-05-06T14:04:24.100 INFO:tasks.workunit.client.1.smithi174.stdout:7/771: write d0/d1d/da4/d61/d19/d39/d46/f81 [480545,114351] 0 2024-05-06T14:04:24.100 INFO:tasks.workunit.client.1.smithi174.stdout:7/772: write d0/d1d/da4/d61/d28/f6e [244313,26079] 0 2024-05-06T14:04:24.101 INFO:tasks.workunit.client.1.smithi174.stdout:7/773: chown d0/d1d 598 1 2024-05-06T14:04:24.101 INFO:tasks.workunit.client.1.smithi174.stdout:7/774: read d0/d1d/da4/d61/d19/d39/f78 [618406,1319] 0 2024-05-06T14:04:24.101 INFO:tasks.workunit.client.1.smithi174.stdout:7/775: chown d0/d1d/da4/d61/d28/db1/deb 0 1 2024-05-06T14:04:24.119 INFO:tasks.workunit.client.1.smithi174.stdout:9/885: fsync dc/d17/d3a/dcb/daf/d43/d8e/f10b 0 2024-05-06T14:04:24.119 INFO:tasks.workunit.client.1.smithi174.stdout:7/776: fsync d0/d1d/da4/d61/d19/d24/d47/dc6/fe3 0 2024-05-06T14:04:24.119 INFO:tasks.workunit.client.1.smithi174.stdout:7/777: write d0/d1d/da4/d61/d19/d24/d14/f33 [1336551,95382] 0 2024-05-06T14:04:24.129 INFO:tasks.workunit.client.1.smithi174.stdout:3/836: fsync df/d10/d1b/d7e/d57/fe2 0 2024-05-06T14:04:24.131 INFO:tasks.workunit.client.1.smithi174.stdout:7/778: mknod d0/d1d/da4/d61/d28/d59/da1/dcf/c108 0 2024-05-06T14:04:24.131 INFO:tasks.workunit.client.1.smithi174.stdout:9/886: creat dc/d9b/dd4/f132 x:0 0 0 2024-05-06T14:04:24.131 INFO:tasks.workunit.client.1.smithi174.stdout:9/887: dread - dc/d1c/fb7 zero size 2024-05-06T14:04:24.131 INFO:tasks.workunit.client.1.smithi174.stdout:7/779: creat d0/d1d/da4/d61/d19/d39/d9e/f109 x:0 0 0 2024-05-06T14:04:24.131 INFO:tasks.workunit.client.1.smithi174.stdout:7/780: write d0/d1d/da4/d61/d28/d37/f60 [270639,109339] 0 2024-05-06T14:04:24.132 INFO:tasks.workunit.client.1.smithi174.stdout:7/781: dread - d0/d1d/da4/d61/d19/d39/d46/fab zero size 2024-05-06T14:04:24.132 INFO:tasks.workunit.client.1.smithi174.stdout:7/782: creat d0/d1d/da4/d61/d28/d37/f10a x:0 0 0 2024-05-06T14:04:24.132 INFO:tasks.workunit.client.1.smithi174.stdout:9/888: write dc/d27/d63/fc5 [855922,122547] 0 2024-05-06T14:04:24.132 INFO:tasks.workunit.client.1.smithi174.stdout:9/889: stat dc/d27/d51/da5/c11b 0 2024-05-06T14:04:24.132 INFO:tasks.workunit.client.1.smithi174.stdout:7/783: mkdir d0/d1d/da4/d61/d19/d39/d90/d10b 0 2024-05-06T14:04:24.132 INFO:tasks.workunit.client.1.smithi174.stdout:7/784: write d0/d3a/f6a [2760537,42568] 0 2024-05-06T14:04:24.132 INFO:tasks.workunit.client.1.smithi174.stdout:7/785: rename d0/d1d/da4/d61/d19/d39/d9e to d0/d1d/da4/d61/d19/d24/d47/d64/d10c 0 2024-05-06T14:04:24.140 INFO:tasks.workunit.client.1.smithi174.stdout:3/837: dread df/d10/d1b/f22 [40960,69632] 0 2024-05-06T14:04:24.140 INFO:tasks.workunit.client.1.smithi174.stdout:3/838: rename df/d10/d1b/d59/ca0 to df/d2d/d4d/ded/c104 0 2024-05-06T14:04:24.141 INFO:tasks.workunit.client.1.smithi174.stdout:3/839: rename df/d2d/d5b/fef to df/d2d/d4e/d81/f105 0 2024-05-06T14:04:24.158 INFO:tasks.workunit.client.1.smithi174.stdout:9/890: dwrite dc/f4e [622592,24576] 0 2024-05-06T14:04:24.236 INFO:tasks.workunit.client.1.smithi174.stdout:9/891: dwrite dc/d17/f100 [913408,20480] 0 2024-05-06T14:04:24.238 INFO:tasks.workunit.client.1.smithi174.stdout:9/892: dwrite dc/d17/d3a/dcb/daf/d43/d8e/dd2/fe1 [286720,118784] 0 2024-05-06T14:04:24.318 INFO:tasks.workunit.client.1.smithi174.stdout:9/893: dwrite dc/d1c/f38 [1122304,77824] 0 2024-05-06T14:04:24.318 INFO:tasks.workunit.client.1.smithi174.stdout:9/894: write dc/de/d7f/f103 [709091,67581] 0 2024-05-06T14:04:24.318 INFO:tasks.workunit.client.1.smithi174.stdout:9/895: read dc/de/f26 [1109786,117386] 0 2024-05-06T14:04:24.355 INFO:tasks.workunit.client.1.smithi174.stdout:7/786: fsync d0/d1d/d9c/dad/dda/de5/dfa/ffd 0 2024-05-06T14:04:24.355 INFO:tasks.workunit.client.1.smithi174.stdout:7/787: rename d0/d1d to d0/d1d/da4/d61/d28/d59/da1/d10d 22 2024-05-06T14:04:24.355 INFO:tasks.workunit.client.1.smithi174.stdout:7/788: rmdir d0/d3a/dd7 39 2024-05-06T14:04:24.355 INFO:tasks.workunit.client.1.smithi174.stdout:7/789: chown d0/d1d/d9c/dad/fb4 84629088 1 2024-05-06T14:04:24.359 INFO:tasks.workunit.client.1.smithi174.stdout:9/896: dwrite dc/d27/d6d/dd7/ffa [1191936,32768] 0 2024-05-06T14:04:24.359 INFO:tasks.workunit.client.1.smithi174.stdout:9/897: mknod dc/c133 0 2024-05-06T14:04:24.359 INFO:tasks.workunit.client.1.smithi174.stdout:9/898: write dc/d27/f2a [1389866,62612] 0 2024-05-06T14:04:24.396 INFO:tasks.workunit.client.1.smithi174.stdout:7/790: fsync d0/d1d/da4/d61/d28/d37/f60 0 2024-05-06T14:04:24.396 INFO:tasks.workunit.client.1.smithi174.stdout:7/791: creat d0/d1d/da4/d61/d19/db7/f10e x:0 0 0 2024-05-06T14:04:24.396 INFO:tasks.workunit.client.1.smithi174.stdout:7/792: write d0/d1d/d9c/dad/dda/de5/dfa/ffd [1075313,33195] 0 2024-05-06T14:04:24.396 INFO:tasks.workunit.client.1.smithi174.stdout:7/793: creat d0/d1d/da4/d61/d28/db1/deb/f10f x:0 0 0 2024-05-06T14:04:24.399 INFO:tasks.workunit.client.1.smithi174.stdout:9/899: dwrite dc/d27/d6d/dd7/fdd [139264,49152] 0 2024-05-06T14:04:24.399 INFO:tasks.workunit.client.1.smithi174.stdout:9/900: getdents dc/de/d7f/d93/d127 0 2024-05-06T14:04:24.399 INFO:tasks.workunit.client.1.smithi174.stdout:7/794: creat d0/d1d/da4/d61/d19/d39/d90/da6/d101/f110 x:0 0 0 2024-05-06T14:04:24.399 INFO:tasks.workunit.client.1.smithi174.stdout:9/901: creat dc/d17/d3a/d8d/f134 x:0 0 0 2024-05-06T14:04:24.399 INFO:tasks.workunit.client.1.smithi174.stdout:7/795: mknod d0/d1d/da4/d61/d28/db1/c111 0 2024-05-06T14:04:24.401 INFO:tasks.workunit.client.1.smithi174.stdout:9/902: mkdir dc/d135 0 2024-05-06T14:04:24.403 INFO:tasks.workunit.client.1.smithi174.stdout:9/903: dwrite dc/d1c/f7d [892928,73728] 0 2024-05-06T14:04:24.403 INFO:tasks.workunit.client.1.smithi174.stdout:9/904: dread - dc/d17/d3a/db2/ff6 zero size 2024-05-06T14:04:24.403 INFO:tasks.workunit.client.1.smithi174.stdout:9/905: getdents dc/de/d7f/da4 0 2024-05-06T14:04:24.403 INFO:tasks.workunit.client.1.smithi174.stdout:9/906: creat dc/de/f136 x:0 0 0 2024-05-06T14:04:24.475 INFO:tasks.workunit.client.1.smithi174.stdout:1/888: sync 2024-05-06T14:04:24.475 INFO:tasks.workunit.client.1.smithi174.stdout:3/840: sync 2024-05-06T14:04:24.475 INFO:tasks.workunit.client.1.smithi174.stdout:3/841: chown df/f9e 3010816 1 2024-05-06T14:04:24.475 INFO:tasks.workunit.client.1.smithi174.stdout:3/842: chown df/d10/d1b/d7e/d57/fe2 988 1 2024-05-06T14:04:24.475 INFO:tasks.workunit.client.1.smithi174.stdout:2/849: sync 2024-05-06T14:04:24.476 INFO:tasks.workunit.client.1.smithi174.stdout:3/843: truncate df/d10/faa 1150329 0 2024-05-06T14:04:24.476 INFO:tasks.workunit.client.1.smithi174.stdout:0/911: sync 2024-05-06T14:04:24.476 INFO:tasks.workunit.client.1.smithi174.stdout:1/889: mknod d11/d57/d83/c12a 0 2024-05-06T14:04:24.476 INFO:tasks.workunit.client.1.smithi174.stdout:2/850: chown d0/d16/f19 5919 1 2024-05-06T14:04:24.476 INFO:tasks.workunit.client.1.smithi174.stdout:1/890: chown d11/d1f/d27/d32/d84/d8c/d94/db0/d123 0 1 2024-05-06T14:04:24.476 INFO:tasks.workunit.client.1.smithi174.stdout:0/912: read - d0/d4/d8/d25/d5c/d4a/da7/fb8 zero size 2024-05-06T14:04:24.476 INFO:tasks.workunit.client.1.smithi174.stdout:0/913: dread - d0/d4/d8/d25/d5c/d4a/da7/de0/fff zero size 2024-05-06T14:04:24.476 INFO:tasks.workunit.client.1.smithi174.stdout:2/851: symlink d0/d24/d84/l106 0 2024-05-06T14:04:24.477 INFO:tasks.workunit.client.1.smithi174.stdout:2/852: symlink d0/d1/d2/d4/d18/d97/l107 0 2024-05-06T14:04:24.477 INFO:tasks.workunit.client.1.smithi174.stdout:2/853: rmdir d0/db/d15 39 2024-05-06T14:04:24.477 INFO:tasks.workunit.client.1.smithi174.stdout:9/907: dwrite dc/df/f12 [172032,24576] 0 2024-05-06T14:04:24.477 INFO:tasks.workunit.client.1.smithi174.stdout:9/908: readlink dc/d17/d3a/dcb/daf/d43/lfc 0 2024-05-06T14:04:24.534 INFO:tasks.workunit.client.1.smithi174.stdout:3/844: fdatasync df/d10/d1b/d7e/d57/f8f 0 2024-05-06T14:04:24.534 INFO:tasks.workunit.client.1.smithi174.stdout:3/845: stat df/f1f 0 2024-05-06T14:04:24.534 INFO:tasks.workunit.client.1.smithi174.stdout:3/846: creat df/d2d/d4e/db6/db8/dd9/f106 x:0 0 0 2024-05-06T14:04:24.535 INFO:tasks.workunit.client.1.smithi174.stdout:3/847: rmdir df/d2d/d5b 39 2024-05-06T14:04:24.535 INFO:tasks.workunit.client.1.smithi174.stdout:3/848: mkdir df/d2d/d4e/db6/db8/d107 0 2024-05-06T14:04:24.535 INFO:tasks.workunit.client.1.smithi174.stdout:3/849: creat df/d10/d1b/d7e/d5a/f108 x:0 0 0 2024-05-06T14:04:24.535 INFO:tasks.workunit.client.1.smithi174.stdout:3/850: dread df/d2d/d4d/da5/fb0 [405504,61440] 0 2024-05-06T14:04:24.537 INFO:tasks.workunit.client.1.smithi174.stdout:3/851: dwrite df/d10/f2f [2486272,77824] 0 2024-05-06T14:04:24.537 INFO:tasks.workunit.client.1.smithi174.stdout:3/852: chown df/d2d/d84/cd8 11082 1 2024-05-06T14:04:24.537 INFO:tasks.workunit.client.1.smithi174.stdout:3/853: write df/d10/d1b/d7e/d57/f63 [928959,43171] 0 2024-05-06T14:04:24.538 INFO:tasks.workunit.client.1.smithi174.stdout:3/854: getdents df/d2d/d87 0 2024-05-06T14:04:24.538 INFO:tasks.workunit.client.1.smithi174.stdout:3/855: dread df/d10/f52 [270336,57344] 0 2024-05-06T14:04:24.538 INFO:tasks.workunit.client.1.smithi174.stdout:3/856: creat df/d2d/d4e/db6/f109 x:0 0 0 2024-05-06T14:04:24.538 INFO:tasks.workunit.client.1.smithi174.stdout:3/857: write df/d10/f1c [3366512,83330] 0 2024-05-06T14:04:24.538 INFO:tasks.workunit.client.1.smithi174.stdout:3/858: write df/d2d/d4e/fac [140024,28508] 0 2024-05-06T14:04:24.538 INFO:tasks.workunit.client.1.smithi174.stdout:3/859: mknod df/d10/d1b/d7e/d5a/c10a 0 2024-05-06T14:04:24.541 INFO:tasks.workunit.client.1.smithi174.stdout:1/891: write d11/d1f/d27/d32/f59 [2078591,94102] 0 2024-05-06T14:04:24.542 INFO:tasks.workunit.client.1.smithi174.stdout:1/892: dread - d11/d57/d77/dea/ffb zero size 2024-05-06T14:04:24.542 INFO:tasks.workunit.client.1.smithi174.stdout:1/893: write d11/d1f/d27/d32/d84/d8c/fa4 [692419,98860] 0 2024-05-06T14:04:24.542 INFO:tasks.workunit.client.1.smithi174.stdout:1/894: dread - d11/fbb zero size 2024-05-06T14:04:24.542 INFO:tasks.workunit.client.1.smithi174.stdout:1/895: dread - d11/d1f/d27/d2d/d9c/fca zero size 2024-05-06T14:04:24.542 INFO:tasks.workunit.client.1.smithi174.stdout:1/896: getdents d11/d1f/d27/d32 0 2024-05-06T14:04:24.542 INFO:tasks.workunit.client.1.smithi174.stdout:1/897: truncate d11/d1f/d27/d32/d84/d8c/d94/db0/fe3 1595250 0 2024-05-06T14:04:24.543 INFO:tasks.workunit.client.1.smithi174.stdout:9/909: dread dc/de/f2e [3866624,98304] 0 2024-05-06T14:04:24.543 INFO:tasks.workunit.client.1.smithi174.stdout:9/910: write dc/d17/d3a/dcb/daf/d43/d8e/dd2/f12c [677730,98844] 0 2024-05-06T14:04:24.544 INFO:tasks.workunit.client.1.smithi174.stdout:9/911: creat dc/d27/d6d/f137 x:0 0 0 2024-05-06T14:04:24.544 INFO:tasks.workunit.client.1.smithi174.stdout:9/912: mkdir dc/de/d81/da6/d138 0 2024-05-06T14:04:24.544 INFO:tasks.workunit.client.1.smithi174.stdout:9/913: creat dc/d27/d51/df5/f139 x:0 0 0 2024-05-06T14:04:24.544 INFO:tasks.workunit.client.1.smithi174.stdout:9/914: truncate dc/d27/dc9/fe7 831008 0 2024-05-06T14:04:24.546 INFO:tasks.workunit.client.1.smithi174.stdout:2/854: dread d0/db/d15/f9e [286720,24576] 0 2024-05-06T14:04:24.546 INFO:tasks.workunit.client.1.smithi174.stdout:2/855: truncate d0/d1/d2/d2a/fa9 615175 0 2024-05-06T14:04:24.546 INFO:tasks.workunit.client.1.smithi174.stdout:2/856: truncate d0/d1/d2/d4/d6/f44 1144077 0 2024-05-06T14:04:24.546 INFO:tasks.workunit.client.1.smithi174.stdout:2/857: chown d0/d24/d84/ld2 26 1 2024-05-06T14:04:24.546 INFO:tasks.workunit.client.1.smithi174.stdout:2/858: rename d0/db to d0/da/d3f/d67/d108 0 2024-05-06T14:04:24.546 INFO:tasks.workunit.client.1.smithi174.stdout:2/859: creat d0/da/d3f/d67/d108/d15/f109 x:0 0 0 2024-05-06T14:04:24.571 INFO:tasks.workunit.client.1.smithi174.stdout:3/860: dwrite df/d10/d1b/f33 [270336,32768] 0 2024-05-06T14:04:24.572 INFO:tasks.workunit.client.1.smithi174.stdout:3/861: dread df/d10/fc0 [397312,98304] 0 2024-05-06T14:04:24.572 INFO:tasks.workunit.client.1.smithi174.stdout:3/862: mkdir df/d2d/d84/d10b 0 2024-05-06T14:04:24.572 INFO:tasks.workunit.client.1.smithi174.stdout:3/863: write df/f44 [128406,111751] 0 2024-05-06T14:04:24.572 INFO:tasks.workunit.client.1.smithi174.stdout:3/864: write df/d2d/d4d/f68 [491075,25412] 0 2024-05-06T14:04:24.572 INFO:tasks.workunit.client.1.smithi174.stdout:3/865: link df/d2d/f6c df/d2d/d5b/f10c 0 2024-05-06T14:04:24.572 INFO:tasks.workunit.client.1.smithi174.stdout:1/898: dwrite d11/fbb [557056,12288] 0 2024-05-06T14:04:24.572 INFO:tasks.workunit.client.1.smithi174.stdout:1/899: chown d11/l3e 1 1 2024-05-06T14:04:24.573 INFO:tasks.workunit.client.1.smithi174.stdout:1/900: unlink d11/d1f/d27/f45 0 2024-05-06T14:04:24.573 INFO:tasks.workunit.client.1.smithi174.stdout:1/901: creat d11/d1f/d27/d32/d84/d8c/d11b/f12b x:0 0 0 2024-05-06T14:04:24.573 INFO:tasks.workunit.client.1.smithi174.stdout:1/902: chown d11/d1f/c28 46163 1 2024-05-06T14:04:24.573 INFO:tasks.workunit.client.1.smithi174.stdout:1/903: truncate d11/d1f/d27/d32/d84/fe5 445895 0 2024-05-06T14:04:24.573 INFO:tasks.workunit.client.1.smithi174.stdout:2/860: dwrite d0/da/d3f/d67/d108/f86 [1015808,61440] 0 2024-05-06T14:04:24.573 INFO:tasks.workunit.client.1.smithi174.stdout:2/861: rename d0/d24/d77/d93/d9a/dfd to d0/d1/d2/d1b/d10a 0 2024-05-06T14:04:24.573 INFO:tasks.workunit.client.1.smithi174.stdout:2/862: dread - d0/da/d3f/d67/fd3 zero size 2024-05-06T14:04:24.574 INFO:tasks.workunit.client.1.smithi174.stdout:2/863: link d0/d1/d2/d4/d18/d2d/d32/f8b d0/d24/d77/d93/d9a/f10b 0 2024-05-06T14:04:24.574 INFO:tasks.workunit.client.1.smithi174.stdout:2/864: getdents d0/d1/d2/d4/d43 0 2024-05-06T14:04:24.574 INFO:tasks.workunit.client.1.smithi174.stdout:2/865: mknod d0/d24/c10c 0 2024-05-06T14:04:24.590 INFO:tasks.workunit.client.1.smithi174.stdout:9/915: fdatasync dc/d17/d3a/dcb/ff1 0 2024-05-06T14:04:24.590 INFO:tasks.workunit.client.1.smithi174.stdout:9/916: mknod dc/d27/d6d/dd7/c13a 0 2024-05-06T14:04:24.590 INFO:tasks.workunit.client.1.smithi174.stdout:9/917: chown dc/d27/d6d/dd7/fec 376 1 2024-05-06T14:04:24.599 INFO:tasks.workunit.client.1.smithi174.stdout:9/918: truncate dc/de/f2e 5650163 0 2024-05-06T14:04:24.599 INFO:tasks.workunit.client.1.smithi174.stdout:3/866: dwrite df/dbc/ffc [73728,94208] 0 2024-05-06T14:04:24.599 INFO:tasks.workunit.client.1.smithi174.stdout:2/866: dwrite d0/da/f56 [339968,20480] 0 2024-05-06T14:04:24.599 INFO:tasks.workunit.client.1.smithi174.stdout:1/904: dwrite d11/d41/d4a/fa2 [1388544,86016] 0 2024-05-06T14:04:24.600 INFO:tasks.workunit.client.1.smithi174.stdout:9/919: symlink dc/de/d117/l13b 0 2024-05-06T14:04:24.600 INFO:tasks.workunit.client.1.smithi174.stdout:9/920: chown l6 427367 1 2024-05-06T14:04:24.600 INFO:tasks.workunit.client.1.smithi174.stdout:1/905: creat d11/d1f/d27/d32/d84/d8c/d11b/f12c x:0 0 0 2024-05-06T14:04:24.600 INFO:tasks.workunit.client.1.smithi174.stdout:3/867: mkdir df/d2d/d4d/ded/d10d 0 2024-05-06T14:04:24.600 INFO:tasks.workunit.client.1.smithi174.stdout:2/867: creat d0/d1/d2/d4/d18/d2d/f10d x:0 0 0 2024-05-06T14:04:24.600 INFO:tasks.workunit.client.1.smithi174.stdout:3/868: chown df/d10/d1b/lb3 26 1 2024-05-06T14:04:24.600 INFO:tasks.workunit.client.1.smithi174.stdout:1/906: mkdir d11/d1f/d27/d2d/d9c/d12d 0 2024-05-06T14:04:24.601 INFO:tasks.workunit.client.1.smithi174.stdout:3/869: chown df/d10/d1b/lb3 629667342 1 2024-05-06T14:04:24.601 INFO:tasks.workunit.client.1.smithi174.stdout:3/870: chown df/l9b 730254 1 2024-05-06T14:04:24.601 INFO:tasks.workunit.client.1.smithi174.stdout:3/871: stat df/d2d 0 2024-05-06T14:04:24.601 INFO:tasks.workunit.client.1.smithi174.stdout:1/907: write d11/d57/d98/daf/fa1 [1566120,41719] 0 2024-05-06T14:04:24.601 INFO:tasks.workunit.client.1.smithi174.stdout:2/868: creat d0/d1/d2/d1b/d10a/da2/db6/f10e x:0 0 0 2024-05-06T14:04:24.601 INFO:tasks.workunit.client.1.smithi174.stdout:3/872: write df/d2d/d4e/db6/fc1 [1511202,999] 0 2024-05-06T14:04:24.601 INFO:tasks.workunit.client.1.smithi174.stdout:2/869: stat d0/d1/d2/d2a/fa9 0 2024-05-06T14:04:24.601 INFO:tasks.workunit.client.1.smithi174.stdout:9/921: truncate dc/d17/d3a/dcb/daf/d43/d8e/dd2/fe1 20470 0 2024-05-06T14:04:24.602 INFO:tasks.workunit.client.1.smithi174.stdout:9/922: creat dc/d17/f13c x:0 0 0 2024-05-06T14:04:24.602 INFO:tasks.workunit.client.1.smithi174.stdout:9/923: stat dc/df/f5a 0 2024-05-06T14:04:24.602 INFO:tasks.workunit.client.1.smithi174.stdout:9/924: stat f2 0 2024-05-06T14:04:24.602 INFO:tasks.workunit.client.1.smithi174.stdout:9/925: readlink dc/de/d7f/da4/ded/l108 0 2024-05-06T14:04:24.602 INFO:tasks.workunit.client.1.smithi174.stdout:9/926: creat dc/d27/d51/f13d x:0 0 0 2024-05-06T14:04:24.602 INFO:tasks.workunit.client.1.smithi174.stdout:9/927: link dc/d17/d3a/dcb/daf/d43/lfc dc/d27/d6d/l13e 0 2024-05-06T14:04:24.603 INFO:tasks.workunit.client.1.smithi174.stdout:7/796: sync 2024-05-06T14:04:24.603 INFO:tasks.workunit.client.1.smithi174.stdout:2/870: truncate d0/d24/d77/d93/d9a/fe5 2239364 0 2024-05-06T14:04:24.603 INFO:tasks.workunit.client.1.smithi174.stdout:7/797: creat d0/d1d/da4/d61/d19/db7/f112 x:0 0 0 2024-05-06T14:04:24.603 INFO:tasks.workunit.client.1.smithi174.stdout:7/798: write d0/d1d/da4/d61/d28/d59/f3f [2049398,45932] 0 2024-05-06T14:04:24.603 INFO:tasks.workunit.client.1.smithi174.stdout:7/799: dread d0/d1d/da4/d61/d19/d39/f8b [86016,53248] 0 2024-05-06T14:04:24.711 INFO:tasks.workunit.client.1.smithi174.stdout:1/908: dwrite d11/d1f/d27/d32/d84/d8c/d94/fe9 [634880,61440] 0 2024-05-06T14:04:24.712 INFO:tasks.workunit.client.1.smithi174.stdout:1/909: truncate d11/d1f/d27/d32/d84/d8c/d94/db0/fe3 1001957 0 2024-05-06T14:04:24.712 INFO:tasks.workunit.client.1.smithi174.stdout:1/910: dread d11/d57/d98/daf/db2/f10f [380928,102400] 0 2024-05-06T14:04:24.716 INFO:tasks.workunit.client.1.smithi174.stdout:2/871: dwrite d0/da/d3f/d67/d108/f86 [1302528,16384] 0 2024-05-06T14:04:24.717 INFO:tasks.workunit.client.1.smithi174.stdout:2/872: write d0/d1/f104 [944797,19439] 0 2024-05-06T14:04:24.717 INFO:tasks.workunit.client.1.smithi174.stdout:2/873: dread - d0/f78 zero size 2024-05-06T14:04:24.717 INFO:tasks.workunit.client.1.smithi174.stdout:9/928: dread dc/d27/d63/fc5 [933888,40960] 0 2024-05-06T14:04:24.717 INFO:tasks.workunit.client.1.smithi174.stdout:2/874: write d0/d16/f96 [978697,24498] 0 2024-05-06T14:04:24.717 INFO:tasks.workunit.client.1.smithi174.stdout:2/875: write d0/d24/d77/d93/f9c [2603628,26704] 0 2024-05-06T14:04:24.717 INFO:tasks.workunit.client.1.smithi174.stdout:2/876: rmdir d0/d1/d2/d4/d43 39 2024-05-06T14:04:24.717 INFO:tasks.workunit.client.1.smithi174.stdout:9/929: write dc/d17/d3a/dcb/daf/d43/d8e/f10b [875558,65596] 0 2024-05-06T14:04:24.718 INFO:tasks.workunit.client.1.smithi174.stdout:2/877: link d0/d1/d2/d4/d43/lf7 d0/da/dcf/l10f 0 2024-05-06T14:04:24.718 INFO:tasks.workunit.client.1.smithi174.stdout:9/930: creat dc/de/d117/f13f x:0 0 0 2024-05-06T14:04:24.718 INFO:tasks.workunit.client.1.smithi174.stdout:9/931: dread - dc/d27/d51/da5/f101 zero size 2024-05-06T14:04:24.723 INFO:tasks.workunit.client.1.smithi174.stdout:3/873: dread f7 [774144,86016] 0 2024-05-06T14:04:24.723 INFO:tasks.workunit.client.1.smithi174.stdout:3/874: write df/d10/d1b/d7e/d57/fe2 [709473,128552] 0 2024-05-06T14:04:24.723 INFO:tasks.workunit.client.1.smithi174.stdout:3/875: creat df/d10/d1b/d7e/f10e x:0 0 0 2024-05-06T14:04:24.723 INFO:tasks.workunit.client.1.smithi174.stdout:3/876: creat df/d2d/d84/f10f x:0 0 0 2024-05-06T14:04:24.724 INFO:tasks.workunit.client.1.smithi174.stdout:3/877: chown df/d2d/d4e 1927 1 2024-05-06T14:04:24.724 INFO:tasks.workunit.client.1.smithi174.stdout:3/878: rmdir df/d10/d1b/d7e/d5a 39 2024-05-06T14:04:24.738 INFO:tasks.workunit.client.1.smithi174.stdout:1/911: dread d11/d57/d83/f97 [405504,106496] 0 2024-05-06T14:04:24.809 INFO:tasks.workunit.client.1.smithi174.stdout:1/912: fsync d11/d1f/d27/d2d/d9c/ff0 0 2024-05-06T14:04:24.809 INFO:tasks.workunit.client.1.smithi174.stdout:1/913: chown d11/d1f/d27/d32/d84/d8c/d94/db0 27203860 1 2024-05-06T14:04:24.817 INFO:tasks.workunit.client.1.smithi174.stdout:0/914: sync 2024-05-06T14:04:24.819 INFO:tasks.workunit.client.1.smithi174.stdout:0/915: mknod d0/d4/d8/d25/d5c/d44/dd5/d118/c136 0 2024-05-06T14:04:24.819 INFO:tasks.workunit.client.1.smithi174.stdout:2/878: dwrite d0/da/d3f/d67/f103 [483328,32768] 0 2024-05-06T14:04:24.820 INFO:tasks.workunit.client.1.smithi174.stdout:9/932: dwrite dc/d27/d63/f9e [1847296,110592] 0 2024-05-06T14:04:24.820 INFO:tasks.workunit.client.1.smithi174.stdout:0/916: rename d0/d4/d8/d25/d5c/f10d to d0/d4/d8/d25/d5c/d44/dd5/d38/f137 0 2024-05-06T14:04:24.820 INFO:tasks.workunit.client.1.smithi174.stdout:0/917: creat d0/d4/d80/d93/dbe/d130/f138 x:0 0 0 2024-05-06T14:04:24.820 INFO:tasks.workunit.client.1.smithi174.stdout:2/879: write d0/d1/d2/d4/d6/f88 [1015537,24730] 0 2024-05-06T14:04:24.820 INFO:tasks.workunit.client.1.smithi174.stdout:0/918: dread d0/d36/d3f/d7a/f9c [540672,24576] 0 2024-05-06T14:04:24.820 INFO:tasks.workunit.client.1.smithi174.stdout:9/933: creat dc/de/d7f/da4/ded/f140 x:0 0 0 2024-05-06T14:04:24.820 INFO:tasks.workunit.client.1.smithi174.stdout:2/880: rename d0/d1/d2/d1b/ce7 to d0/da/d3f/d67/d108/c110 0 2024-05-06T14:04:24.820 INFO:tasks.workunit.client.1.smithi174.stdout:9/934: mknod dc/d27/d51/c141 0 2024-05-06T14:04:24.821 INFO:tasks.workunit.client.1.smithi174.stdout:9/935: chown dc/d17/d3a/dcb/cad 0 1 2024-05-06T14:04:24.821 INFO:tasks.workunit.client.1.smithi174.stdout:2/881: creat d0/d1/d2/d1b/f111 x:0 0 0 2024-05-06T14:04:24.821 INFO:tasks.workunit.client.1.smithi174.stdout:2/882: rename d0/d1/d2/d4/d6/l3d to d0/d92/l112 0 2024-05-06T14:04:24.821 INFO:tasks.workunit.client.1.smithi174.stdout:2/883: link d0/d1/d2/d4/d18/f64 d0/d1/d2/d4/d18/d2d/dd1/f113 0 2024-05-06T14:04:24.821 INFO:tasks.workunit.client.1.smithi174.stdout:2/884: creat d0/d1/d2/d1b/d10a/f114 x:0 0 0 2024-05-06T14:04:24.821 INFO:tasks.workunit.client.1.smithi174.stdout:2/885: rename d0/d1/d2/d4/d18/f6d to d0/d1/d2/d4/d6/d105/f115 0 2024-05-06T14:04:24.822 INFO:tasks.workunit.client.1.smithi174.stdout:1/914: dread d11/d57/d98/daf/d9b/fa0 [135168,69632] 0 2024-05-06T14:04:24.823 INFO:tasks.workunit.client.1.smithi174.stdout:1/915: creat d11/d57/d77/f12e x:0 0 0 2024-05-06T14:04:24.823 INFO:tasks.workunit.client.1.smithi174.stdout:1/916: stat d11/d1f/d27/d2d/d9c/c120 0 2024-05-06T14:04:24.823 INFO:tasks.workunit.client.1.smithi174.stdout:1/917: dread - d11/d57/d98/daf/db2/ffc zero size 2024-05-06T14:04:24.823 INFO:tasks.workunit.client.1.smithi174.stdout:1/918: creat d11/d57/f12f x:0 0 0 2024-05-06T14:04:24.823 INFO:tasks.workunit.client.1.smithi174.stdout:1/919: chown d11/l7c 3838059 1 2024-05-06T14:04:24.823 INFO:tasks.workunit.client.1.smithi174.stdout:1/920: creat d11/d1f/d27/d32/d84/ddc/f130 x:0 0 0 2024-05-06T14:04:24.823 INFO:tasks.workunit.client.1.smithi174.stdout:1/921: readlink d11/l18 0 2024-05-06T14:04:24.824 INFO:tasks.workunit.client.1.smithi174.stdout:1/922: getdents d11/d1f/d27/d32/d84/df3 0 2024-05-06T14:04:24.901 INFO:tasks.workunit.client.1.smithi174.stdout:1/923: dwrite d11/f115 [1961984,65536] 0 2024-05-06T14:04:24.901 INFO:tasks.workunit.client.1.smithi174.stdout:9/936: dwrite dc/d17/d3a/dcb/f6a [192512,53248] 0 2024-05-06T14:04:24.901 INFO:tasks.workunit.client.1.smithi174.stdout:1/924: rename fe to d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/ded/f131 0 2024-05-06T14:04:24.901 INFO:tasks.workunit.client.1.smithi174.stdout:1/925: rename d11/d1f/d27/d32/d84/ddc to d11/d57/d98/daf/db2/d132 0 2024-05-06T14:04:24.901 INFO:tasks.workunit.client.1.smithi174.stdout:9/937: unlink f7 0 2024-05-06T14:04:24.902 INFO:tasks.workunit.client.1.smithi174.stdout:2/886: dwrite d0/da/d3f/d67/d108/fa8 [843776,73728] 0 2024-05-06T14:04:24.902 INFO:tasks.workunit.client.1.smithi174.stdout:2/887: dread - d0/d24/d84/fef zero size 2024-05-06T14:04:24.902 INFO:tasks.workunit.client.1.smithi174.stdout:2/888: link d0/d1/d2/d4/d18/d2d/d32/f8b d0/d24/d77/d93/d9a/f116 0 2024-05-06T14:04:24.902 INFO:tasks.workunit.client.1.smithi174.stdout:2/889: getdents d0/d1/d2/d4/d18/d2d/d32/d89 0 2024-05-06T14:04:24.902 INFO:tasks.workunit.client.1.smithi174.stdout:2/890: stat d0/d1/d2/d4/d18/d2d/d32/f8b 0 2024-05-06T14:04:24.902 INFO:tasks.workunit.client.1.smithi174.stdout:2/891: stat d0/d24/f65 0 2024-05-06T14:04:24.903 INFO:tasks.workunit.client.1.smithi174.stdout:2/892: creat d0/da/d3f/d67/d108/f117 x:0 0 0 2024-05-06T14:04:24.903 INFO:tasks.workunit.client.1.smithi174.stdout:2/893: dread d0/da/d3f/d67/d108/f7d [1282048,24576] 0 2024-05-06T14:04:24.903 INFO:tasks.workunit.client.1.smithi174.stdout:2/894: write d0/d1/faa [1652957,21334] 0 2024-05-06T14:04:24.945 INFO:tasks.workunit.client.1.smithi174.stdout:2/895: dwrite d0/d1/d2/d4/ff3 [163840,90112] 0 2024-05-06T14:04:24.946 INFO:tasks.workunit.client.1.smithi174.stdout:1/926: dwrite d11/d57/d98/daf/f87 [819200,114688] 0 2024-05-06T14:04:24.946 INFO:tasks.workunit.client.1.smithi174.stdout:9/938: dwrite dc/de/d7f/d93/fac [1437696,114688] 0 2024-05-06T14:04:24.946 INFO:tasks.workunit.client.1.smithi174.stdout:9/939: stat dc/d27/d6d/ld5 0 2024-05-06T14:04:24.946 INFO:tasks.workunit.client.1.smithi174.stdout:9/940: chown dc/d9b/dd4 21594 1 2024-05-06T14:04:24.946 INFO:tasks.workunit.client.1.smithi174.stdout:2/896: symlink d0/d1/d2/d4/d18/d97/l118 0 2024-05-06T14:04:24.946 INFO:tasks.workunit.client.1.smithi174.stdout:9/941: dread dc/f76 [294912,36864] 0 2024-05-06T14:04:24.946 INFO:tasks.workunit.client.1.smithi174.stdout:2/897: rename d0/d1/d2/d4/d43/f7c to d0/d1/d2/d4/d6/d105/f119 0 2024-05-06T14:04:24.947 INFO:tasks.workunit.client.1.smithi174.stdout:9/942: creat dc/d17/d3a/d8d/f142 x:0 0 0 2024-05-06T14:04:24.947 INFO:tasks.workunit.client.1.smithi174.stdout:2/898: truncate d0/d1/d2/d4/d6/fe 134352 0 2024-05-06T14:04:24.947 INFO:tasks.workunit.client.1.smithi174.stdout:2/899: unlink d0/d16/c63 0 2024-05-06T14:04:24.947 INFO:tasks.workunit.client.1.smithi174.stdout:9/943: symlink dc/d1c/l143 0 2024-05-06T14:04:24.947 INFO:tasks.workunit.client.1.smithi174.stdout:2/900: write d0/d1/d2/d4/d18/d2d/d32/f53 [1386823,78586] 0 2024-05-06T14:04:24.947 INFO:tasks.workunit.client.1.smithi174.stdout:2/901: creat d0/da/f11a x:0 0 0 2024-05-06T14:04:24.947 INFO:tasks.workunit.client.1.smithi174.stdout:2/902: symlink d0/d24/d77/d93/d9a/l11b 0 2024-05-06T14:04:24.947 INFO:tasks.workunit.client.1.smithi174.stdout:2/903: creat d0/da/f11c x:0 0 0 2024-05-06T14:04:24.948 INFO:tasks.workunit.client.1.smithi174.stdout:2/904: rename d0/da/d3f/d67 to d0/d1/d2/d4/d18/d97/d11d 0 2024-05-06T14:04:24.953 INFO:tasks.workunit.client.1.smithi174.stdout:2/905: dread d0/d16/f96 [155648,86016] 0 2024-05-06T14:04:24.953 INFO:tasks.workunit.client.1.smithi174.stdout:2/906: unlink d0/da/f3b 0 2024-05-06T14:04:24.953 INFO:tasks.workunit.client.1.smithi174.stdout:2/907: chown d0/da 5 1 2024-05-06T14:04:25.045 INFO:tasks.workunit.client.1.smithi174.stdout:1/927: fdatasync d11/d57/d98/f106 0 2024-05-06T14:04:25.046 INFO:tasks.workunit.client.1.smithi174.stdout:9/944: fdatasync dc/df/f5a 0 2024-05-06T14:04:25.046 INFO:tasks.workunit.client.1.smithi174.stdout:1/928: write d11/d41/d4a/f56 [1830418,98667] 0 2024-05-06T14:04:25.046 INFO:tasks.workunit.client.1.smithi174.stdout:9/945: dread - dc/d17/d3a/dcb/f116 zero size 2024-05-06T14:04:25.046 INFO:tasks.workunit.client.1.smithi174.stdout:9/946: symlink dc/d17/l144 0 2024-05-06T14:04:25.047 INFO:tasks.workunit.client.1.smithi174.stdout:7/800: sync 2024-05-06T14:04:25.047 INFO:tasks.workunit.client.1.smithi174.stdout:7/801: rmdir d0/d1d/da4/d61/d19/d24/d47/dc6 39 2024-05-06T14:04:25.048 INFO:tasks.workunit.client.1.smithi174.stdout:7/802: stat d0/d1d/da4/d61/d19/d24/d47/dc6/le6 0 2024-05-06T14:04:25.048 INFO:tasks.workunit.client.1.smithi174.stdout:9/947: dwrite dc/d27/d6d/f8a [49152,12288] 0 2024-05-06T14:04:25.048 INFO:tasks.workunit.client.1.smithi174.stdout:9/948: rmdir dc/d27/d6d 39 2024-05-06T14:04:25.048 INFO:tasks.workunit.client.1.smithi174.stdout:9/949: dread - dc/de/d6b/f129 zero size 2024-05-06T14:04:25.048 INFO:tasks.workunit.client.1.smithi174.stdout:9/950: unlink dc/d27/d6d/dd7/fdd 0 2024-05-06T14:04:25.108 INFO:tasks.workunit.client.1.smithi174.stdout:1/929: fsync d11/d57/d98/daf/fa1 0 2024-05-06T14:04:25.118 INFO:tasks.workunit.client.1.smithi174.stdout:1/930: fdatasync d11/d1f/d27/d2d/ddd/f121 0 2024-05-06T14:04:25.128 INFO:tasks.workunit.client.1.smithi174.stdout:9/951: dwrite dc/d17/d3a/d8d/f8f [962560,102400] 0 2024-05-06T14:04:25.129 INFO:tasks.workunit.client.1.smithi174.stdout:1/931: mkdir d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/d107/d133 0 2024-05-06T14:04:25.129 INFO:tasks.workunit.client.1.smithi174.stdout:3/879: sync 2024-05-06T14:04:25.129 INFO:tasks.workunit.client.1.smithi174.stdout:0/919: sync 2024-05-06T14:04:25.129 INFO:tasks.workunit.client.1.smithi174.stdout:1/932: symlink d11/d57/d98/daf/db2/l134 0 2024-05-06T14:04:25.129 INFO:tasks.workunit.client.1.smithi174.stdout:1/933: chown d11/d41/f85 52103201 1 2024-05-06T14:04:25.129 INFO:tasks.workunit.client.1.smithi174.stdout:9/952: write dc/d27/d51/da5/fb1 [656993,53751] 0 2024-05-06T14:04:25.129 INFO:tasks.workunit.client.1.smithi174.stdout:9/953: readlink dc/de/d7f/da4/ded/l108 0 2024-05-06T14:04:25.130 INFO:tasks.workunit.client.1.smithi174.stdout:9/954: mkdir dc/d17/d3a/db2/d145 0 2024-05-06T14:04:25.130 INFO:tasks.workunit.client.1.smithi174.stdout:9/955: chown dc/d17/d3a/dcb 55329 1 2024-05-06T14:04:25.130 INFO:tasks.workunit.client.1.smithi174.stdout:1/934: write d11/d1f/f7f [253321,80467] 0 2024-05-06T14:04:25.130 INFO:tasks.workunit.client.1.smithi174.stdout:1/935: mknod d11/d1f/d27/d2d/c135 0 2024-05-06T14:04:25.130 INFO:tasks.workunit.client.1.smithi174.stdout:1/936: mkdir d11/d1f/d27/d2d/d9c/d136 0 2024-05-06T14:04:25.130 INFO:tasks.workunit.client.1.smithi174.stdout:1/937: link d11/d57/d98/daf/db2/d132/f130 d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/d107/f137 0 2024-05-06T14:04:25.130 INFO:tasks.workunit.client.1.smithi174.stdout:1/938: write d11/d57/f12f [926924,63218] 0 2024-05-06T14:04:25.131 INFO:tasks.workunit.client.1.smithi174.stdout:1/939: mknod d11/d57/d83/c138 0 2024-05-06T14:04:25.131 INFO:tasks.workunit.client.1.smithi174.stdout:1/940: chown d11/c2e 373236 1 2024-05-06T14:04:25.131 INFO:tasks.workunit.client.1.smithi174.stdout:1/941: truncate d11/d1f/fc4 225665 0 2024-05-06T14:04:25.197 INFO:tasks.workunit.client.1.smithi174.stdout:3/880: dwrite df/d2d/d4e/db6/fc1 [1572864,61440] 0 2024-05-06T14:04:25.197 INFO:tasks.workunit.client.1.smithi174.stdout:3/881: creat df/d2d/d87/f110 x:0 0 0 2024-05-06T14:04:25.197 INFO:tasks.workunit.client.1.smithi174.stdout:3/882: creat df/d10/d1b/d59/f111 x:0 0 0 2024-05-06T14:04:25.198 INFO:tasks.workunit.client.1.smithi174.stdout:3/883: write df/d10/da2/fae [701986,113282] 0 2024-05-06T14:04:25.198 INFO:tasks.workunit.client.1.smithi174.stdout:3/884: write df/d2d/f53 [1025580,121763] 0 2024-05-06T14:04:25.198 INFO:tasks.workunit.client.1.smithi174.stdout:3/885: write df/d10/d1b/d7e/ff2 [414977,108299] 0 2024-05-06T14:04:25.198 INFO:tasks.workunit.client.1.smithi174.stdout:3/886: creat df/f112 x:0 0 0 2024-05-06T14:04:25.199 INFO:tasks.workunit.client.1.smithi174.stdout:3/887: rmdir df/d10/d1b 39 2024-05-06T14:04:25.199 INFO:tasks.workunit.client.1.smithi174.stdout:3/888: dread df/d2d/d4e/d81/ff1 [4096,24576] 0 2024-05-06T14:04:25.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:25.202+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 msgr2=0x7f7190006620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:25.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:25.202+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 0x7f7190006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-05-06T14:04:25.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:25.202+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:25.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:25.202+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-05-06T14:04:25.238 INFO:tasks.workunit.client.1.smithi174.stdout:9/956: fdatasync dc/de/d81/f9f 0 2024-05-06T14:04:25.238 INFO:tasks.workunit.client.1.smithi174.stdout:1/942: fsync d11/d1f/fa7 0 2024-05-06T14:04:25.238 INFO:tasks.workunit.client.1.smithi174.stdout:1/943: chown d11/d1f/d27/d2d/f43 12821026 1 2024-05-06T14:04:25.238 INFO:tasks.workunit.client.1.smithi174.stdout:1/944: rmdir d11/d41/d4a 39 2024-05-06T14:04:25.238 INFO:tasks.workunit.client.1.smithi174.stdout:1/945: getdents d11/d1f/d27/d32/d84/df3 0 2024-05-06T14:04:25.239 INFO:tasks.workunit.client.1.smithi174.stdout:9/957: creat dc/de/d117/f146 x:0 0 0 2024-05-06T14:04:25.239 INFO:tasks.workunit.client.1.smithi174.stdout:1/946: rename d11/d1f/d27/d32/d84/cf8 to d11/d57/c139 0 2024-05-06T14:04:25.239 INFO:tasks.workunit.client.1.smithi174.stdout:1/947: truncate d11/d1f/d27/d32/f6b 1532100 0 2024-05-06T14:04:25.239 INFO:tasks.workunit.client.1.smithi174.stdout:1/948: chown d11/d1f/d27/d2d/l90 6915472 1 2024-05-06T14:04:25.239 INFO:tasks.workunit.client.1.smithi174.stdout:3/889: dread df/f90 [786432,77824] 0 2024-05-06T14:04:25.243 INFO:tasks.workunit.client.1.smithi174.stdout:3/890: symlink df/d2d/d4e/db6/db8/l113 0 2024-05-06T14:04:25.244 INFO:tasks.workunit.client.1.smithi174.stdout:9/958: dwrite dc/de/d7f/d93/fa2 [1609728,36864] 0 2024-05-06T14:04:25.244 INFO:tasks.workunit.client.1.smithi174.stdout:9/959: chown dc/de/cef 390602 1 2024-05-06T14:04:25.244 INFO:tasks.workunit.client.1.smithi174.stdout:9/960: dread dc/de/d7f/da4/fc4 [757760,12288] 0 2024-05-06T14:04:25.244 INFO:tasks.workunit.client.1.smithi174.stdout:9/961: symlink dc/d17/d4c/l147 0 2024-05-06T14:04:25.244 INFO:tasks.workunit.client.1.smithi174.stdout:9/962: mknod dc/d17/d3a/dcb/daf/c148 0 2024-05-06T14:04:25.245 INFO:tasks.workunit.client.1.smithi174.stdout:1/949: dwrite d11/d1f/d27/d2d/f43 [966656,4096] 0 2024-05-06T14:04:25.245 INFO:tasks.workunit.client.1.smithi174.stdout:3/891: dwrite df/d10/d1b/d7e/f51 [2547712,61440] 0 2024-05-06T14:04:25.245 INFO:tasks.workunit.client.1.smithi174.stdout:3/892: chown df/d2d/d4d/da5/ld5 2 1 2024-05-06T14:04:25.245 INFO:tasks.workunit.client.1.smithi174.stdout:3/893: rename df/d10/d1b/lb3 to df/d2d/d84/d10b/l114 0 2024-05-06T14:04:25.245 INFO:tasks.workunit.client.1.smithi174.stdout:9/963: dread dc/d27/d6d/f6f [81920,106496] 0 2024-05-06T14:04:25.311 INFO:tasks.workunit.client.1.smithi174.stdout:1/950: dwrite d11/d57/d98/daf/f101 [884736,45056] 0 2024-05-06T14:04:25.311 INFO:tasks.workunit.client.1.smithi174.stdout:1/951: creat d11/d1f/d27/d32/d92/dbc/f13a x:0 0 0 2024-05-06T14:04:25.311 INFO:tasks.workunit.client.1.smithi174.stdout:1/952: mknod d11/d1f/d27/d32/d84/df3/c13b 0 2024-05-06T14:04:25.313 INFO:tasks.workunit.client.1.smithi174.stdout:9/964: link dc/d27/d6d/f6f dc/d27/d6d/dd7/f149 0 2024-05-06T14:04:25.314 INFO:tasks.workunit.client.1.smithi174.stdout:9/965: mknod dc/de/d117/c14a 0 2024-05-06T14:04:25.314 INFO:tasks.workunit.client.1.smithi174.stdout:9/966: unlink dc/d27/d51/da5/c11b 0 2024-05-06T14:04:25.314 INFO:tasks.workunit.client.1.smithi174.stdout:7/803: sync 2024-05-06T14:04:25.314 INFO:tasks.workunit.client.1.smithi174.stdout:2/908: sync 2024-05-06T14:04:25.314 INFO:tasks.workunit.client.1.smithi174.stdout:7/804: write d0/d1d/da4/d61/f16 [571871,5406] 0 2024-05-06T14:04:25.314 INFO:tasks.workunit.client.1.smithi174.stdout:2/909: symlink d0/d24/d84/l11e 0 2024-05-06T14:04:25.314 INFO:tasks.workunit.client.1.smithi174.stdout:2/910: rename d0/d1/d2/d4/d6/l79 to d0/da/l11f 0 2024-05-06T14:04:25.315 INFO:tasks.workunit.client.1.smithi174.stdout:2/911: creat d0/d1/d2/d4/d18/d2d/f120 x:0 0 0 2024-05-06T14:04:25.315 INFO:tasks.workunit.client.1.smithi174.stdout:3/894: dwrite df/d10/da2/fdc [630784,118784] 0 2024-05-06T14:04:25.315 INFO:tasks.workunit.client.1.smithi174.stdout:3/895: unlink df/f90 0 2024-05-06T14:04:25.367 INFO:tasks.workunit.client.1.smithi174.stdout:1/953: fdatasync d11/d57/d83/f97 0 2024-05-06T14:04:25.367 INFO:tasks.workunit.client.1.smithi174.stdout:1/954: rmdir d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/d107 39 2024-05-06T14:04:25.368 INFO:tasks.workunit.client.1.smithi174.stdout:7/805: fsync d0/d1d/da4/d61/d19/d24/d47/f50 0 2024-05-06T14:04:25.375 INFO:tasks.workunit.client.1.smithi174.stdout:9/967: dwrite dc/d17/d3a/dcb/f116 [196608,81920] 0 2024-05-06T14:04:25.375 INFO:tasks.workunit.client.1.smithi174.stdout:7/806: mknod d0/d1d/da4/d61/d19/d39/c113 0 2024-05-06T14:04:25.431 INFO:tasks.workunit.client.1.smithi174.stdout:9/968: fdatasync dc/df/f12 0 2024-05-06T14:04:25.431 INFO:tasks.workunit.client.1.smithi174.stdout:9/969: chown dc/d17/d3a/d8d/l96 68639 1 2024-05-06T14:04:25.433 INFO:tasks.workunit.client.1.smithi174.stdout:9/970: truncate dc/d17/d3a/f11a 191568 0 2024-05-06T14:04:25.434 INFO:tasks.workunit.client.1.smithi174.stdout:3/896: dwrite df/d2d/d4e/fdf [1015808,45056] 0 2024-05-06T14:04:25.434 INFO:tasks.workunit.client.1.smithi174.stdout:1/955: creat d11/d1f/d27/d2d/f13c x:0 0 0 2024-05-06T14:04:25.434 INFO:tasks.workunit.client.1.smithi174.stdout:2/912: dwrite d0/d24/d77/d93/f9c [983040,77824] 0 2024-05-06T14:04:25.434 INFO:tasks.workunit.client.1.smithi174.stdout:9/971: symlink dc/d17/d3a/dcb/l14b 0 2024-05-06T14:04:25.434 INFO:tasks.workunit.client.1.smithi174.stdout:9/972: read - dc/d17/d3a/dcb/daf/d43/d8e/f92 zero size 2024-05-06T14:04:25.434 INFO:tasks.workunit.client.1.smithi174.stdout:1/956: symlink d11/d1f/d27/d2d/d9c/d12d/l13d 0 2024-05-06T14:04:25.434 INFO:tasks.workunit.client.1.smithi174.stdout:0/920: sync 2024-05-06T14:04:25.435 INFO:tasks.workunit.client.1.smithi174.stdout:0/921: dread d0/d3/dad/f10a [126976,36864] 0 2024-05-06T14:04:25.435 INFO:tasks.workunit.client.1.smithi174.stdout:0/922: creat d0/d3/dfc/f139 x:0 0 0 2024-05-06T14:04:25.435 INFO:tasks.workunit.client.1.smithi174.stdout:9/973: write dc/d17/d3a/d8d/f134 [423751,95245] 0 2024-05-06T14:04:25.435 INFO:tasks.workunit.client.1.smithi174.stdout:9/974: stat dc/de/d7f/cd3 0 2024-05-06T14:04:25.435 INFO:tasks.workunit.client.1.smithi174.stdout:0/923: read d0/d4/d8/d25/d5c/ddb/fe7 [1239455,18697] 0 2024-05-06T14:04:25.435 INFO:tasks.workunit.client.1.smithi174.stdout:9/975: write dc/d17/d3a/dcb/daf/d43/d8e/dd2/f12c [217758,12947] 0 2024-05-06T14:04:25.435 INFO:tasks.workunit.client.1.smithi174.stdout:7/807: dwrite d0/d1d/da4/d61/d19/db7/ff8 [86016,4096] 0 2024-05-06T14:04:25.435 INFO:tasks.workunit.client.1.smithi174.stdout:9/976: mkdir dc/de/df3/d124/d14c 0 2024-05-06T14:04:25.436 INFO:tasks.workunit.client.1.smithi174.stdout:7/808: write d0/d3a/f6a [139298,13297] 0 2024-05-06T14:04:25.436 INFO:tasks.workunit.client.1.smithi174.stdout:9/977: rename dc/de/d6b/cb0 to dc/d27/c14d 0 2024-05-06T14:04:25.465 INFO:tasks.workunit.client.1.smithi174.stdout:2/913: dwrite d0/d1/d2/d1b/d10a/fd5 [458752,8192] 0 2024-05-06T14:04:25.466 INFO:tasks.workunit.client.1.smithi174.stdout:2/914: mknod d0/d1/d2/d4/d18/d97/d11d/d108/d15/c121 0 2024-05-06T14:04:25.469 INFO:tasks.workunit.client.1.smithi174.stdout:7/809: dwrite d0/d3a/fde [651264,102400] 0 2024-05-06T14:04:25.469 INFO:tasks.workunit.client.1.smithi174.stdout:9/978: dwrite dc/d27/d51/da5/f101 [913408,45056] 0 2024-05-06T14:04:25.469 INFO:tasks.workunit.client.1.smithi174.stdout:9/979: chown dc/de/f26 4119954 1 2024-05-06T14:04:25.474 INFO:tasks.workunit.client.1.smithi174.stdout:1/957: read d11/d1f/f89 [482817,78751] 0 2024-05-06T14:04:25.527 INFO:tasks.workunit.client.1.smithi174.stdout:0/924: fdatasync d0/d4/d8/d25/d5c/d44/dd5/f106 0 2024-05-06T14:04:25.528 INFO:tasks.workunit.client.1.smithi174.stdout:2/915: fdatasync d0/f55 0 2024-05-06T14:04:25.528 INFO:tasks.workunit.client.1.smithi174.stdout:0/925: stat d0/d4/d8/d25/d5c/d44/cae 0 2024-05-06T14:04:25.528 INFO:tasks.workunit.client.1.smithi174.stdout:7/810: fdatasync d0/d1d/da4/d61/d28/f6e 0 2024-05-06T14:04:25.528 INFO:tasks.workunit.client.1.smithi174.stdout:9/980: fdatasync dc/d27/f77 0 2024-05-06T14:04:25.535 INFO:tasks.workunit.client.1.smithi174.stdout:1/958: truncate d11/d1f/d27/f5d 1374661 0 2024-05-06T14:04:25.535 INFO:tasks.workunit.client.1.smithi174.stdout:7/811: unlink d0/d1d/da4/d61/d19/d24/f7e 0 2024-05-06T14:04:25.535 INFO:tasks.workunit.client.1.smithi174.stdout:9/981: truncate dc/d9b/dd4/f12d 80843 0 2024-05-06T14:04:25.536 INFO:tasks.workunit.client.1.smithi174.stdout:7/812: write d0/d1d/da4/d61/d19/d39/d46/fea [456018,4622] 0 2024-05-06T14:04:25.536 INFO:tasks.workunit.client.1.smithi174.stdout:9/982: rename dc/d27/d6d/dd7/c13a to dc/de/df3/c14e 0 2024-05-06T14:04:25.536 INFO:tasks.workunit.client.1.smithi174.stdout:7/813: truncate d0/d1d/da4/d61/d19/d24/d47/d70/d67/f102 240073 0 2024-05-06T14:04:25.536 INFO:tasks.workunit.client.1.smithi174.stdout:0/926: fdatasync d0/d16/fcc 0 2024-05-06T14:04:25.536 INFO:tasks.workunit.client.1.smithi174.stdout:0/927: chown d0/d4/d80/d102 0 1 2024-05-06T14:04:25.536 INFO:tasks.workunit.client.1.smithi174.stdout:0/928: rmdir d0/d3/dfc 39 2024-05-06T14:04:25.536 INFO:tasks.workunit.client.1.smithi174.stdout:0/929: truncate d0/d4/d8/d25/d5c/d44/f91 724518 0 2024-05-06T14:04:25.538 INFO:tasks.workunit.client.1.smithi174.stdout:2/916: dwrite d0/d24/f50 [544768,24576] 0 2024-05-06T14:04:25.538 INFO:tasks.workunit.client.1.smithi174.stdout:2/917: stat d0/d1/d2/d4/f22 0 2024-05-06T14:04:25.538 INFO:tasks.workunit.client.1.smithi174.stdout:2/918: getdents d0/da/d3f 0 2024-05-06T14:04:25.538 INFO:tasks.workunit.client.1.smithi174.stdout:2/919: creat d0/d1/d2/d4/d18/d2d/dd1/f122 x:0 0 0 2024-05-06T14:04:25.538 INFO:tasks.workunit.client.1.smithi174.stdout:7/814: creat d0/d1d/da4/d61/d19/d39/d90/f114 x:0 0 0 2024-05-06T14:04:25.538 INFO:tasks.workunit.client.1.smithi174.stdout:0/930: readlink d0/d4/d8/d25/d5c/d44/dd5/d38/l72 0 2024-05-06T14:04:25.538 INFO:tasks.workunit.client.1.smithi174.stdout:2/920: chown d0/d1/d2/d4/d18/d97/d11d/fb8 0 1 2024-05-06T14:04:25.539 INFO:tasks.workunit.client.1.smithi174.stdout:9/983: symlink dc/d27/d51/l14f 0 2024-05-06T14:04:25.539 INFO:tasks.workunit.client.1.smithi174.stdout:1/959: mkdir d11/d1f/d27/d2d/d9c/d136/d13e 0 2024-05-06T14:04:25.539 INFO:tasks.workunit.client.1.smithi174.stdout:7/815: creat d0/d1d/da4/f115 x:0 0 0 2024-05-06T14:04:25.539 INFO:tasks.workunit.client.1.smithi174.stdout:2/921: rename d0/d1/d2/d2a/cf4 to d0/d24/d77/d93/d9a/c123 0 2024-05-06T14:04:25.539 INFO:tasks.workunit.client.1.smithi174.stdout:1/960: creat d11/d41/d4a/d5e/db6/f13f x:0 0 0 2024-05-06T14:04:25.539 INFO:tasks.workunit.client.1.smithi174.stdout:2/922: symlink d0/d16/l124 0 2024-05-06T14:04:25.539 INFO:tasks.workunit.client.1.smithi174.stdout:9/984: mkdir dc/d27/d51/da5/d11e/d150 0 2024-05-06T14:04:25.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/816: mkdir d0/d1d/da4/d61/d19/d24/d47/dc6/d116 0 2024-05-06T14:04:25.540 INFO:tasks.workunit.client.1.smithi174.stdout:2/923: stat d0/da/f11c 0 2024-05-06T14:04:25.540 INFO:tasks.workunit.client.1.smithi174.stdout:1/961: mkdir d11/d1f/d27/d32/d84/d8c/dee/d140 0 2024-05-06T14:04:25.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/817: mkdir d0/d1d/da4/d61/d28/db1/dc8/d117 0 2024-05-06T14:04:25.540 INFO:tasks.workunit.client.1.smithi174.stdout:2/924: mkdir d0/d1/d2/d1b/d10a/dc7/d125 0 2024-05-06T14:04:25.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/818: symlink d0/d1d/da4/d61/d28/db1/dc8/ddb/l118 0 2024-05-06T14:04:25.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/819: symlink d0/d1d/da4/d61/d19/d24/d14/l119 0 2024-05-06T14:04:25.540 INFO:tasks.workunit.client.1.smithi174.stdout:7/820: write d0/d1d/da4/d61/d19/d24/d47/d70/d83/fae [695663,68284] 0 2024-05-06T14:04:25.541 INFO:tasks.workunit.client.1.smithi174.stdout:9/985: dwrite dc/d9b/dd4/f12d [221184,110592] 0 2024-05-06T14:04:25.552 INFO:tasks.workunit.client.1.smithi174.stdout:0/931: dread d0/d3/dad/f10a [258048,110592] 0 2024-05-06T14:04:25.552 INFO:tasks.workunit.client.1.smithi174.stdout:0/932: creat d0/d36/d45/d114/f13a x:0 0 0 2024-05-06T14:04:25.578 INFO:tasks.workunit.client.1.smithi174.stdout:7/821: dwrite d0/fe [3153920,73728] 0 2024-05-06T14:04:25.579 INFO:tasks.workunit.client.1.smithi174.stdout:9/986: dwrite dc/d17/fea [462848,110592] 0 2024-05-06T14:04:25.579 INFO:tasks.workunit.client.1.smithi174.stdout:9/987: read dc/d27/d63/fa3 [94770,11533] 0 2024-05-06T14:04:25.579 INFO:tasks.workunit.client.1.smithi174.stdout:9/988: mknod dc/d17/d3a/db2/d145/c151 0 2024-05-06T14:04:25.580 INFO:tasks.workunit.client.1.smithi174.stdout:9/989: chown dc/de/f2e 16489 1 2024-05-06T14:04:25.580 INFO:tasks.workunit.client.1.smithi174.stdout:9/990: symlink dc/d135/l152 0 2024-05-06T14:04:25.637 INFO:tasks.workunit.client.1.smithi174.stdout:0/933: fsync d0/d3/d104/d17/d2e/f39 0 2024-05-06T14:04:25.640 INFO:tasks.workunit.client.1.smithi174.stdout:7/822: dwrite d0/d1d/da4/d61/d19/f7d [1900544,106496] 0 2024-05-06T14:04:25.645 INFO:tasks.workunit.client.1.smithi174.stdout:7/823: dwrite d0/d1d/da4/d61/d19/d24/f10 [2154496,12288] 0 2024-05-06T14:04:25.646 INFO:tasks.workunit.client.1.smithi174.stdout:0/934: rename d0/d3/dfc/ff6 to d0/d3/dad/f13b 0 2024-05-06T14:04:25.648 INFO:tasks.workunit.client.1.smithi174.stdout:0/935: mknod d0/d3/dad/d119/c13c 0 2024-05-06T14:04:25.649 INFO:tasks.workunit.client.1.smithi174.stdout:7/824: write d0/d1d/da4/d61/d19/d39/d90/f114 [57950,1954] 0 2024-05-06T14:04:25.649 INFO:tasks.workunit.client.1.smithi174.stdout:9/991: dwrite dc/d27/d63/f9a [1695744,110592] 0 2024-05-06T14:04:25.649 INFO:tasks.workunit.client.1.smithi174.stdout:7/825: mkdir d0/d1d/da4/d61/d19/d24/d47/d70/d67/d11a 0 2024-05-06T14:04:25.649 INFO:tasks.workunit.client.1.smithi174.stdout:7/826: truncate d0/d1d/da4/d61/d19/db7/ff8 156714 0 2024-05-06T14:04:25.755 INFO:tasks.workunit.client.1.smithi174.stdout:3/897: sync 2024-05-06T14:04:25.756 INFO:tasks.workunit.client.1.smithi174.stdout:3/898: truncate df/d10/d1b/f56 1084062 0 2024-05-06T14:04:25.756 INFO:tasks.workunit.client.1.smithi174.stdout:9/992: dwrite dc/d17/d3a/d8d/f134 [831488,65536] 0 2024-05-06T14:04:25.756 INFO:tasks.workunit.client.1.smithi174.stdout:9/993: write dc/d17/d3a/dcb/ff1 [1819383,91349] 0 2024-05-06T14:04:25.756 INFO:tasks.workunit.client.1.smithi174.stdout:0/936: dwrite d0/d36/d3f/f12d [974848,36864] 0 2024-05-06T14:04:25.756 INFO:tasks.workunit.client.1.smithi174.stdout:9/994: write dc/de/d7f/f103 [1387882,78394] 0 2024-05-06T14:04:25.756 INFO:tasks.workunit.client.1.smithi174.stdout:9/995: chown dc/d17/lb3 292706 1 2024-05-06T14:04:25.756 INFO:tasks.workunit.client.1.smithi174.stdout:9/996: chown dc/f25 0 1 2024-05-06T14:04:25.763 INFO:tasks.workunit.client.1.smithi174.stdout:7/827: dread d0/d1d/da4/d61/d19/f32 [184320,4096] 0 2024-05-06T14:04:25.763 INFO:tasks.workunit.client.1.smithi174.stdout:7/828: getdents d0/d1d/da4/d61/d19/d39/d90/de9 0 2024-05-06T14:04:25.806 INFO:tasks.workunit.client.1.smithi174.stdout:0/937: dwrite d0/d36/d45/d114/f12a [864256,106496] 0 2024-05-06T14:04:25.807 INFO:tasks.workunit.client.1.smithi174.stdout:3/899: dwrite df/d10/d1b/f7f [1175552,4096] 0 2024-05-06T14:04:25.807 INFO:tasks.workunit.client.1.smithi174.stdout:9/997: dwrite dc/d1c/fcf [266240,94208] 0 2024-05-06T14:04:25.807 INFO:tasks.workunit.client.1.smithi174.stdout:9/998: link dc/d17/db8/ff2 dc/de/d7f/d93/d127/f153 0 2024-05-06T14:04:25.807 INFO:tasks.workunit.client.1.smithi174.stdout:3/900: rename df/d10/d1b/d7e/l8e to df/d2d/d5b/l115 0 2024-05-06T14:04:25.807 INFO:tasks.workunit.client.1.smithi174.stdout:0/938: write d0/d4/d8/d25/d5c/d4a/f95 [2179304,19190] 0 2024-05-06T14:04:25.807 INFO:tasks.workunit.client.1.smithi174.stdout:0/939: chown d0/d3/d104/d17/c2d 44708 1 2024-05-06T14:04:25.807 INFO:tasks.workunit.client.1.smithi174.stdout:0/940: write d0/d4/d8/d25/f12e [780156,18098] 0 2024-05-06T14:04:25.807 INFO:tasks.workunit.client.1.smithi174.stdout:0/941: dread - d0/d3/d104/d17/fd0 zero size 2024-05-06T14:04:25.808 INFO:tasks.workunit.client.1.smithi174.stdout:9/999: truncate dc/f76 357030 0 2024-05-06T14:04:25.808 INFO:tasks.workunit.client.1.smithi174.stdout:0/942: dread d0/d4/d8/d25/fd4 [86016,90112] 0 2024-05-06T14:04:25.808 INFO:tasks.workunit.client.1.smithi174.stdout:0/943: symlink d0/d4/d80/d93/dbe/d130/l13d 0 2024-05-06T14:04:25.808 INFO:tasks.workunit.client.1.smithi174.stdout:0/944: getdents d0/d4/d8/d25/d5c/d4a/da7/d10b 0 2024-05-06T14:04:25.808 INFO:tasks.workunit.client.1.smithi174.stdout:0/945: mkdir d0/d4/d8/d25/d5c/d44/dd5/d38/d13e 0 2024-05-06T14:04:25.808 INFO:tasks.workunit.client.1.smithi174.stdout:0/946: symlink d0/d4/d80/d93/dbe/d130/l13f 0 2024-05-06T14:04:25.808 INFO:tasks.workunit.client.1.smithi174.stdout:0/947: rmdir d0/d4/d8/d25/d5c/d44/dd5/d38/dcd 39 2024-05-06T14:04:25.810 INFO:tasks.workunit.client.1.smithi174.stdout:3/901: dwrite df/d2d/d4e/db6/f109 [995328,98304] 0 2024-05-06T14:04:25.810 INFO:tasks.workunit.client.1.smithi174.stdout:3/902: truncate df/d10/d1b/d7e/f6d 997715 0 2024-05-06T14:04:25.810 INFO:tasks.workunit.client.1.smithi174.stdout:0/948: dwrite d0/d3/dad/d119/f135 [446464,24576] 0 2024-05-06T14:04:25.810 INFO:tasks.workunit.client.1.smithi174.stdout:0/949: read d0/d16/fcc [116570,38875] 0 2024-05-06T14:04:25.810 INFO:tasks.workunit.client.1.smithi174.stdout:0/950: write d0/d4/d8/d25/d5c/d4a/da7/dcb/fe6 [1568561,129450] 0 2024-05-06T14:04:25.810 INFO:tasks.workunit.client.1.smithi174.stdout:0/951: truncate d0/d36/d45/d114/f123 792223 0 2024-05-06T14:04:25.810 INFO:tasks.workunit.client.1.smithi174.stdout:0/952: mkdir d0/d4/d8/d25/d5c/d4a/da7/d140 0 2024-05-06T14:04:25.811 INFO:tasks.workunit.client.1.smithi174.stdout:0/953: truncate d0/d36/f3b 1401531 0 2024-05-06T14:04:25.811 INFO:tasks.workunit.client.1.smithi174.stdout:0/954: stat d0/d36/d3f/d7a/cf9 0 2024-05-06T14:04:25.811 INFO:tasks.workunit.client.1.smithi174.stdout:0/955: chown d0/f92 3624073 1 2024-05-06T14:04:25.812 INFO:tasks.workunit.client.1.smithi174.stdout:7/829: read d0/d1d/da4/d61/d19/d24/f1b [1748409,99563] 0 2024-05-06T14:04:25.913 INFO:tasks.workunit.client.1.smithi174.stdout:3/903: dread df/d2d/d4e/d81/ff1 [331776,98304] 0 2024-05-06T14:04:25.913 INFO:tasks.workunit.client.1.smithi174.stdout:3/904: chown df/d2d/d5b/fe0 11 1 2024-05-06T14:04:25.913 INFO:tasks.workunit.client.1.smithi174.stdout:3/905: rmdir df/d2d/d84 39 2024-05-06T14:04:25.919 INFO:tasks.workunit.client.1.smithi174.stdout:7/830: dread d0/d1d/da4/d61/d19/f9b [98304,12288] 0 2024-05-06T14:04:25.959 INFO:tasks.workunit.client.1.smithi174.stdout:0/956: fsync d0/d4/d8/d25/f6f 0 2024-05-06T14:04:25.959 INFO:tasks.workunit.client.1.smithi174.stdout:3/906: fdatasync df/dbc/ffc 0 2024-05-06T14:04:25.959 INFO:tasks.workunit.client.1.smithi174.stdout:3/907: stat df/d10/d1b/d59/c8d 0 2024-05-06T14:04:25.959 INFO:tasks.workunit.client.1.smithi174.stdout:3/908: chown df/d2d/d4d/f68 461131818 1 2024-05-06T14:04:25.959 INFO:tasks.workunit.client.1.smithi174.stdout:0/957: rmdir d0/d4/d80/d93/dbe/d132 0 2024-05-06T14:04:25.960 INFO:tasks.workunit.client.1.smithi174.stdout:3/909: link df/f28 df/d2d/d4e/db6/db8/f116 0 2024-05-06T14:04:25.960 INFO:tasks.workunit.client.1.smithi174.stdout:3/910: truncate df/d10/d1b/d7e/d57/f80 211184 0 2024-05-06T14:04:25.960 INFO:tasks.workunit.client.1.smithi174.stdout:3/911: unlink df/d2d/d4e/cc6 0 2024-05-06T14:04:25.960 INFO:tasks.workunit.client.1.smithi174.stdout:3/912: chown df/d2d/d4d/da5/fb0 239 1 2024-05-06T14:04:25.960 INFO:tasks.workunit.client.1.smithi174.stdout:3/913: link df/d10/d1b/d7e/d57/lff df/d10/d1b/d59/l117 0 2024-05-06T14:04:25.960 INFO:tasks.workunit.client.1.smithi174.stdout:3/914: link df/d10/d1b/d7e/d57/ca7 df/d2d/d84/c118 0 2024-05-06T14:04:25.961 INFO:tasks.workunit.client.1.smithi174.stdout:1/962: sync 2024-05-06T14:04:25.964 INFO:tasks.workunit.client.1.smithi174.stdout:1/963: dread d11/d41/f5c [864256,81920] 0 2024-05-06T14:04:25.965 INFO:tasks.workunit.client.1.smithi174.stdout:1/964: dread d11/d41/d4a/fa2 [1003520,16384] 0 2024-05-06T14:04:25.966 INFO:tasks.workunit.client.1.smithi174.stdout:2/925: sync 2024-05-06T14:04:25.966 INFO:tasks.workunit.client.1.smithi174.stdout:2/926: read - d0/d1/d2/d4/d18/d97/d11d/d108/fd4 zero size 2024-05-06T14:04:25.968 INFO:tasks.workunit.client.1.smithi174.stdout:1/965: link d11/d1f/d27/d2d/c8d d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/c141 0 2024-05-06T14:04:25.968 INFO:tasks.workunit.client.1.smithi174.stdout:0/958: dwrite d0/d4/d8/d25/d5c/ddb/fe7 [1744896,126976] 0 2024-05-06T14:04:25.968 INFO:tasks.workunit.client.1.smithi174.stdout:2/927: symlink d0/da/d3f/l126 0 2024-05-06T14:04:25.969 INFO:tasks.workunit.client.1.smithi174.stdout:0/959: mkdir d0/d3/dfc/d141 0 2024-05-06T14:04:25.969 INFO:tasks.workunit.client.1.smithi174.stdout:2/928: symlink d0/d16/l127 0 2024-05-06T14:04:25.969 INFO:tasks.workunit.client.1.smithi174.stdout:2/929: rename d0/da/d3f/l126 to d0/d24/d77/l128 0 2024-05-06T14:04:25.969 INFO:tasks.workunit.client.1.smithi174.stdout:1/966: dread d11/d41/f5c [753664,45056] 0 2024-05-06T14:04:25.969 INFO:tasks.workunit.client.1.smithi174.stdout:1/967: symlink d11/d41/l142 0 2024-05-06T14:04:25.969 INFO:tasks.workunit.client.1.smithi174.stdout:1/968: chown d11/c16 58962 1 2024-05-06T14:04:26.071 INFO:tasks.workunit.client.1.smithi174.stdout:3/915: write df/d10/d1b/d7e/d57/f95 [435309,31776] 0 2024-05-06T14:04:26.072 INFO:tasks.workunit.client.1.smithi174.stdout:3/916: stat df/d10/d1b/d7e 0 2024-05-06T14:04:26.072 INFO:tasks.workunit.client.1.smithi174.stdout:3/917: mkdir df/d2d/d4d/d119 0 2024-05-06T14:04:26.072 INFO:tasks.workunit.client.1.smithi174.stdout:3/918: rmdir df/d10/d1b 39 2024-05-06T14:04:26.072 INFO:tasks.workunit.client.1.smithi174.stdout:3/919: dread df/d2d/d4e/fac [53248,16384] 0 2024-05-06T14:04:26.072 INFO:tasks.workunit.client.1.smithi174.stdout:3/920: readlink df/d10/d1b/d7e/d5a/lec 0 2024-05-06T14:04:26.072 INFO:tasks.workunit.client.1.smithi174.stdout:3/921: readlink df/d10/d1b/d7e/d57/lff 0 2024-05-06T14:04:26.079 INFO:tasks.workunit.client.1.smithi174.stdout:1/969: write d11/d1f/d27/f5d [477478,43610] 0 2024-05-06T14:04:26.087 INFO:tasks.workunit.client.1.smithi174.stdout:0/960: fdatasync d0/f92 0 2024-05-06T14:04:26.087 INFO:tasks.workunit.client.1.smithi174.stdout:0/961: dread d0/d3/d104/f6c [1093632,4096] 0 2024-05-06T14:04:26.089 INFO:tasks.workunit.client.1.smithi174.stdout:1/970: dwrite d11/d57/d77/f12e [593920,4096] 0 2024-05-06T14:04:26.089 INFO:tasks.workunit.client.1.smithi174.stdout:3/922: dwrite df/d10/da2/fdc [1044480,98304] 0 2024-05-06T14:04:26.136 INFO:tasks.workunit.client.1.smithi174.stdout:1/971: dwrite d11/d57/d83/f97 [1769472,16384] 0 2024-05-06T14:04:26.136 INFO:tasks.workunit.client.1.smithi174.stdout:1/972: rename d11/d57/d77/dea/l125 to d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/ded/l143 0 2024-05-06T14:04:26.136 INFO:tasks.workunit.client.1.smithi174.stdout:1/973: read - d11/d57/ff6 zero size 2024-05-06T14:04:26.136 INFO:tasks.workunit.client.1.smithi174.stdout:1/974: write d11/d41/d4a/d5e/db6/f13f [151254,73023] 0 2024-05-06T14:04:26.136 INFO:tasks.workunit.client.1.smithi174.stdout:1/975: write d11/d1f/d27/d2d/f13c [698330,20800] 0 2024-05-06T14:04:26.137 INFO:tasks.workunit.client.1.smithi174.stdout:1/976: unlink d11/d1f/d27/d32/d84/lc2 0 2024-05-06T14:04:26.137 INFO:tasks.workunit.client.1.smithi174.stdout:1/977: readlink d11/d41/lc3 0 2024-05-06T14:04:26.137 INFO:tasks.workunit.client.1.smithi174.stdout:1/978: readlink ld 0 2024-05-06T14:04:26.149 INFO:tasks.workunit.client.1.smithi174.stdout:3/923: dread df/f9c [966656,49152] 0 2024-05-06T14:04:26.208 INFO:tasks.workunit.client.1.smithi174.stdout:1/979: dwrite d11/d57/d98/daf/db2/d132/ff2 [655360,4096] 0 2024-05-06T14:04:26.208 INFO:tasks.workunit.client.1.smithi174.stdout:3/924: dwrite df/d2d/d4d/f68 [987136,4096] 0 2024-05-06T14:04:26.208 INFO:tasks.workunit.client.1.smithi174.stdout:1/980: chown d11/d1f/d27/d2d/f31 25775959 1 2024-05-06T14:04:26.209 INFO:tasks.workunit.client.1.smithi174.stdout:3/925: getdents df/d2d/d84/d10b 0 2024-05-06T14:04:26.209 INFO:tasks.workunit.client.1.smithi174.stdout:3/926: rename df/d10/d1b/d7e/l70 to df/d10/d1b/d7e/l11a 0 2024-05-06T14:04:26.209 INFO:tasks.workunit.client.1.smithi174.stdout:1/981: creat d11/d1f/d27/d2d/ddd/f144 x:0 0 0 2024-05-06T14:04:26.209 INFO:tasks.workunit.client.1.smithi174.stdout:1/982: getdents d11/d1f/d27/d32 0 2024-05-06T14:04:26.209 INFO:tasks.workunit.client.1.smithi174.stdout:1/983: chown d11/d1f/f38 13872 1 2024-05-06T14:04:26.209 INFO:tasks.workunit.client.1.smithi174.stdout:3/927: creat df/dbc/f11b x:0 0 0 2024-05-06T14:04:26.209 INFO:tasks.workunit.client.1.smithi174.stdout:3/928: readlink df/d2d/d4e/lb2 0 2024-05-06T14:04:26.209 INFO:tasks.workunit.client.1.smithi174.stdout:3/929: chown df/d10/d1b/d59/cdb 1852622 1 2024-05-06T14:04:26.210 INFO:tasks.workunit.client.1.smithi174.stdout:1/984: creat d11/d1f/d27/d32/d84/d8c/d94/f145 x:0 0 0 2024-05-06T14:04:26.210 INFO:tasks.workunit.client.1.smithi174.stdout:1/985: readlink d11/d41/d4a/d5e/lf7 0 2024-05-06T14:04:26.210 INFO:tasks.workunit.client.1.smithi174.stdout:1/986: truncate d11/d41/d4a/f81 704819 0 2024-05-06T14:04:26.210 INFO:tasks.workunit.client.1.smithi174.stdout:1/987: creat d11/d41/dc9/d6c/f146 x:0 0 0 2024-05-06T14:04:26.210 INFO:tasks.workunit.client.1.smithi174.stdout:1/988: dread - d11/d1f/d27/d32/d92/dbc/f13a zero size 2024-05-06T14:04:26.210 INFO:tasks.workunit.client.1.smithi174.stdout:3/930: write df/d2d/d4e/db6/fde [322017,82146] 0 2024-05-06T14:04:26.210 INFO:tasks.workunit.client.1.smithi174.stdout:1/989: write d11/fbb [1574604,32828] 0 2024-05-06T14:04:26.275 INFO:tasks.workunit.client.1.smithi174.stdout:1/990: dwrite d11/d57/d83/f97 [184320,102400] 0 2024-05-06T14:04:26.276 INFO:tasks.workunit.client.1.smithi174.stdout:1/991: dread - d11/d1f/d27/d32/d84/d8c/d94/db0/d9f/d107/f119 zero size 2024-05-06T14:04:26.276 INFO:tasks.workunit.client.1.smithi174.stdout:1/992: write d11/d1f/d27/d32/d84/df3/f126 [890014,48879] 0 2024-05-06T14:04:26.276 INFO:tasks.workunit.client.1.smithi174.stdout:1/993: stat d11/d1f/d27/d32/d84/d8c/dee/d140 0 2024-05-06T14:04:26.276 INFO:tasks.workunit.client.1.smithi174.stdout:1/994: rename d11/d1f/d27/d32/d84/d8c/d94/f145 to d11/d57/d83/f147 0 2024-05-06T14:04:26.276 INFO:tasks.workunit.client.1.smithi174.stdout:1/995: mkdir d11/d1f/d27/d32/d84/d8c/dee/d148 0 2024-05-06T14:04:26.276 INFO:tasks.workunit.client.1.smithi174.stdout:1/996: creat d11/d1f/dd4/f149 x:0 0 0 2024-05-06T14:04:26.277 INFO:tasks.workunit.client.1.smithi174.stdout:1/997: symlink d11/d1f/d27/d32/d84/d8c/dee/l14a 0 2024-05-06T14:04:26.277 INFO:tasks.workunit.client.1.smithi174.stdout:1/998: stat d11/d1f/d27/d32/d84/d8c/d94/db0/d123 0 2024-05-06T14:04:26.277 INFO:tasks.workunit.client.1.smithi174.stdout:1/999: dread d11/d57/f12f [274432,69632] 0 2024-05-06T14:04:26.277 INFO:tasks.workunit.client.1.smithi174.stdout:2/930: sync 2024-05-06T14:04:26.277 INFO:tasks.workunit.client.1.smithi174.stdout:7/831: sync 2024-05-06T14:04:26.277 INFO:tasks.workunit.client.1.smithi174.stdout:2/931: dread d0/d1/d2/d4/d18/d97/d11d/d108/d72/fdd [380928,106496] 0 2024-05-06T14:04:26.277 INFO:tasks.workunit.client.1.smithi174.stdout:7/832: mkdir d0/d1d/da4/d61/d28/d59/da1/dcf/d11b 0 2024-05-06T14:04:26.326 INFO:tasks.workunit.client.1.smithi174.stdout:3/931: fsync df/d2d/f31 0 2024-05-06T14:04:26.326 INFO:tasks.workunit.client.1.smithi174.stdout:3/932: stat df/d2d/d4d/d119 0 2024-05-06T14:04:26.326 INFO:tasks.workunit.client.1.smithi174.stdout:3/933: symlink df/d2d/d4e/d81/l11c 0 2024-05-06T14:04:26.326 INFO:tasks.workunit.client.1.smithi174.stdout:3/934: link df/d10/d1b/lc3 df/d2d/d4e/d81/de3/l11d 0 2024-05-06T14:04:26.326 INFO:tasks.workunit.client.1.smithi174.stdout:3/935: truncate df/d10/d1b/f5c 1311881 0 2024-05-06T14:04:26.327 INFO:tasks.workunit.client.1.smithi174.stdout:7/833: fdatasync d0/d1d/da4/d61/d19/d24/fd9 0 2024-05-06T14:04:26.327 INFO:tasks.workunit.client.1.smithi174.stdout:3/936: chown df/d10/d1b/d7e/lb7 0 1 2024-05-06T14:04:26.327 INFO:tasks.workunit.client.1.smithi174.stdout:3/937: link df/d2d/f86 df/d2d/d87/f11e 0 2024-05-06T14:04:26.327 INFO:tasks.workunit.client.1.smithi174.stdout:3/938: stat df/dbc/lf8 0 2024-05-06T14:04:26.327 INFO:tasks.workunit.client.1.smithi174.stdout:7/834: readlink d0/d1d/da4/d61/d19/d24/d6f/d88/l72 0 2024-05-06T14:04:26.327 INFO:tasks.workunit.client.1.smithi174.stdout:3/939: link df/d2d/d4e/db6/db9/lbf df/d2d/d4e/db6/db8/l11f 0 2024-05-06T14:04:26.327 INFO:tasks.workunit.client.1.smithi174.stdout:7/835: symlink d0/d1d/d9c/dad/dda/l11c 0 2024-05-06T14:04:26.327 INFO:tasks.workunit.client.1.smithi174.stdout:7/836: symlink d0/l11d 0 2024-05-06T14:04:26.327 INFO:tasks.workunit.client.1.smithi174.stdout:7/837: chown d0/d1d/da4/d61/d19/d39/d46/c74 5484 1 2024-05-06T14:04:26.328 INFO:tasks.workunit.client.1.smithi174.stdout:7/838: mkdir d0/d1d/da4/d61/d19/d39/d11e 0 2024-05-06T14:04:26.328 INFO:tasks.workunit.client.1.smithi174.stdout:2/932: dwrite d0/d1/d2/d4/d6/f7a [954368,98304] 0 2024-05-06T14:04:26.328 INFO:tasks.workunit.client.1.smithi174.stdout:2/933: creat d0/d1/d2/d4/d18/d2d/d32/d89/f129 x:0 0 0 2024-05-06T14:04:26.328 INFO:tasks.workunit.client.1.smithi174.stdout:2/934: rename d0/d1/d2/d4/l39 to d0/d1/d2/d4/d6/dd8/l12a 0 2024-05-06T14:04:26.331 INFO:tasks.workunit.client.1.smithi174.stdout:2/935: write d0/d1/d2/d4/d18/d97/d11d/d108/d72/f8c [552564,120490] 0 2024-05-06T14:04:26.331 INFO:tasks.workunit.client.1.smithi174.stdout:2/936: getdents d0/d1/d2/d4/dde 0 2024-05-06T14:04:26.331 INFO:tasks.workunit.client.1.smithi174.stdout:2/937: creat d0/d1/d2/d4/d51/f12b x:0 0 0 2024-05-06T14:04:26.331 INFO:tasks.workunit.client.1.smithi174.stdout:2/938: link d0/d24/d84/fef d0/d1/d2/d2a/f12c 0 2024-05-06T14:04:26.332 INFO:tasks.workunit.client.1.smithi174.stdout:2/939: creat d0/d1/d2/d4/d18/f12d x:0 0 0 2024-05-06T14:04:26.332 INFO:tasks.workunit.client.1.smithi174.stdout:2/940: creat d0/d1/d2/d4/d6/dd8/f12e x:0 0 0 2024-05-06T14:04:26.332 INFO:tasks.workunit.client.1.smithi174.stdout:2/941: rename d0/d1/d2/d4/d18/f91 to d0/d1/d2/d4/dde/f12f 0 2024-05-06T14:04:26.332 INFO:tasks.workunit.client.1.smithi174.stdout:2/942: creat d0/d1/d2/d4/d18/d97/d11d/f130 x:0 0 0 2024-05-06T14:04:26.332 INFO:tasks.workunit.client.1.smithi174.stdout:2/943: readlink d0/d1/d2/d4/d18/d97/d11d/lbb 0 2024-05-06T14:04:26.332 INFO:tasks.workunit.client.1.smithi174.stdout:2/944: rename d0/d1/d2/d4/d18/d97/d11d/d108 to d0/d1/d2/d4/d18/d97/d11d/d108/d131 22 2024-05-06T14:04:26.332 INFO:tasks.workunit.client.1.smithi174.stdout:2/945: truncate d0/da/d3f/fac 1222482 0 2024-05-06T14:04:26.332 INFO:tasks.workunit.client.1.smithi174.stdout:2/946: creat d0/da/d3f/f132 x:0 0 0 2024-05-06T14:04:26.333 INFO:tasks.workunit.client.1.smithi174.stdout:0/962: sync 2024-05-06T14:04:26.333 INFO:tasks.workunit.client.1.smithi174.stdout:3/940: dwrite df/d2d/d4e/db6/db8/dd9/f106 [122880,36864] 0 2024-05-06T14:04:26.333 INFO:tasks.workunit.client.1.smithi174.stdout:3/941: rmdir df/d2d/d4e/db6/db8/dd9 39 2024-05-06T14:04:26.333 INFO:tasks.workunit.client.1.smithi174.stdout:3/942: mknod df/d2d/d84/c120 0 2024-05-06T14:04:26.333 INFO:tasks.workunit.client.1.smithi174.stdout:3/943: write df/d10/f3f [650915,45605] 0 2024-05-06T14:04:26.333 INFO:tasks.workunit.client.1.smithi174.stdout:3/944: getdents df/d2d/d4d/d119 0 2024-05-06T14:04:26.333 INFO:tasks.workunit.client.1.smithi174.stdout:3/945: dread - df/d10/d1b/d59/f111 zero size 2024-05-06T14:04:26.333 INFO:tasks.workunit.client.1.smithi174.stdout:3/946: chown df/d10/d1b/d7e/d5a/l60 9146867 1 2024-05-06T14:04:26.333 INFO:tasks.workunit.client.1.smithi174.stdout:7/839: write d0/f34 [2204468,104613] 0 2024-05-06T14:04:26.334 INFO:tasks.workunit.client.1.smithi174.stdout:7/840: link d0/d3a/fd8 d0/d1d/d9c/dad/dda/de5/dfa/f11f 0 2024-05-06T14:04:26.335 INFO:tasks.workunit.client.1.smithi174.stdout:3/947: dwrite df/d10/f19 [2293760,4096] 0 2024-05-06T14:04:26.336 INFO:tasks.workunit.client.1.smithi174.stdout:0/963: dwrite d0/d16/f124 [942080,126976] 0 2024-05-06T14:04:26.336 INFO:tasks.workunit.client.1.smithi174.stdout:7/841: mkdir d0/d1d/da4/d61/d19/d24/d120 0 2024-05-06T14:04:26.336 INFO:tasks.workunit.client.1.smithi174.stdout:0/964: readlink d0/d3/dfc/l126 0 2024-05-06T14:04:26.336 INFO:tasks.workunit.client.1.smithi174.stdout:7/842: truncate d0/d3a/dd7/f100 909160 0 2024-05-06T14:04:26.336 INFO:tasks.workunit.client.1.smithi174.stdout:0/965: creat d0/d4/d80/d93/dbe/f142 x:0 0 0 2024-05-06T14:04:26.336 INFO:tasks.workunit.client.1.smithi174.stdout:7/843: mkdir d0/d1d/da4/d61/d19/d39/d11e/d121 0 2024-05-06T14:04:26.336 INFO:tasks.workunit.client.1.smithi174.stdout:0/966: mknod d0/d4/d8/d25/d5c/d4a/c143 0 2024-05-06T14:04:26.336 INFO:tasks.workunit.client.1.smithi174.stdout:0/967: truncate d0/d3/dad/fd8 873468 0 2024-05-06T14:04:26.336 INFO:tasks.workunit.client.1.smithi174.stdout:0/968: symlink d0/d4/d8/d25/d5c/d4a/da7/dcb/l144 0 2024-05-06T14:04:26.337 INFO:tasks.workunit.client.1.smithi174.stdout:0/969: creat d0/d3/d104/d17/d2e/f145 x:0 0 0 2024-05-06T14:04:26.337 INFO:tasks.workunit.client.1.smithi174.stdout:2/947: dread d0/d1/d2/d4/d18/d97/d11d/d108/d72/f8c [638976,28672] 0 2024-05-06T14:04:26.337 INFO:tasks.workunit.client.1.smithi174.stdout:2/948: write d0/d1/d2/d4/d18/d97/d11d/f103 [1133376,19165] 0 2024-05-06T14:04:26.337 INFO:tasks.workunit.client.1.smithi174.stdout:2/949: getdents d0/d1/d2/d4/d6/dd8/df5 0 2024-05-06T14:04:26.421 INFO:tasks.workunit.client.1.smithi174.stdout:3/948: fdatasync df/d10/d1b/d7e/f51 0 2024-05-06T14:04:26.422 INFO:tasks.workunit.client.1.smithi174.stdout:3/949: dread df/d10/d1b/d7e/d57/fe2 [405504,94208] 0 2024-05-06T14:04:26.422 INFO:tasks.workunit.client.1.smithi174.stdout:3/950: chown df/d2d/d4e/fa8 1 1 2024-05-06T14:04:26.422 INFO:tasks.workunit.client.1.smithi174.stdout:3/951: chown df/d10/d1b/c74 1400 1 2024-05-06T14:04:26.422 INFO:tasks.workunit.client.1.smithi174.stdout:3/952: creat df/d2d/d4d/f121 x:0 0 0 2024-05-06T14:04:26.422 INFO:tasks.workunit.client.1.smithi174.stdout:3/953: chown df/d2d/d4e/db6/f109 39788444 1 2024-05-06T14:04:26.423 INFO:tasks.workunit.client.1.smithi174.stdout:3/954: rmdir df/d2d 39 2024-05-06T14:04:26.423 INFO:tasks.workunit.client.1.smithi174.stdout:3/955: dread df/f9e [114688,122880] 0 2024-05-06T14:04:26.423 INFO:tasks.workunit.client.1.smithi174.stdout:7/844: dwrite d0/d1d/da4/d61/d19/d24/f87 [1699840,8192] 0 2024-05-06T14:04:26.423 INFO:tasks.workunit.client.1.smithi174.stdout:7/845: rename d0/d1d/da4/d61/d19/d24/f3c to d0/d1d/d9c/dad/dda/de5/f122 0 2024-05-06T14:04:26.423 INFO:tasks.workunit.client.1.smithi174.stdout:7/846: creat d0/d1d/da4/f123 x:0 0 0 2024-05-06T14:04:26.423 INFO:tasks.workunit.client.1.smithi174.stdout:7/847: unlink d0/d1d/da4/d61/d19/d24/d14/d52/c103 0 2024-05-06T14:04:26.423 INFO:tasks.workunit.client.1.smithi174.stdout:7/848: chown d0/d1d/da4/d61/d19/d24/d47/d70/d67/cdf 503438918 1 2024-05-06T14:04:26.424 INFO:tasks.workunit.client.1.smithi174.stdout:7/849: mkdir d0/d1d/da4/d61/d19/d24/d124 0 2024-05-06T14:04:26.424 INFO:tasks.workunit.client.1.smithi174.stdout:7/850: read d0/d1d/da4/d61/d19/d24/d6f/d88/ff4 [151796,49009] 0 2024-05-06T14:04:26.424 INFO:tasks.workunit.client.1.smithi174.stdout:7/851: mknod d0/d1d/da4/d61/d19/d39/d11e/c125 0 2024-05-06T14:04:26.424 INFO:tasks.workunit.client.1.smithi174.stdout:7/852: creat d0/d1d/da4/d61/d19/d24/f126 x:0 0 0 2024-05-06T14:04:26.424 INFO:tasks.workunit.client.1.smithi174.stdout:7/853: truncate d0/d1d/da4/d61/d28/d59/da1/dcf/fd5 278112 0 2024-05-06T14:04:26.424 INFO:tasks.workunit.client.1.smithi174.stdout:0/970: dwrite d0/d3/f8d [204800,53248] 0 2024-05-06T14:04:26.424 INFO:tasks.workunit.client.1.smithi174.stdout:0/971: dread d0/f59 [90112,53248] 0 2024-05-06T14:04:26.424 INFO:tasks.workunit.client.1.smithi174.stdout:0/972: getdents d0/d3/d104/d17 0 2024-05-06T14:04:26.425 INFO:tasks.workunit.client.1.smithi174.stdout:2/950: dwrite d0/d24/d77/d93/d9a/fa3 [921600,57344] 0 2024-05-06T14:04:26.425 INFO:tasks.workunit.client.1.smithi174.stdout:2/951: rename d0/d1/d2/d4/d18/d97/d11d/d108/d15 to d0/d1/d2/d4/d18/d97/d11d/d108/d72/d133 0 2024-05-06T14:04:26.428 INFO:tasks.workunit.client.1.smithi174.stdout:7/854: dread d0/d1d/da4/d61/d28/d37/f40 [1007616,94208] 0 2024-05-06T14:04:26.428 INFO:tasks.workunit.client.1.smithi174.stdout:7/855: dread d0/d1d/da4/d61/d19/d24/f48 [339968,12288] 0 2024-05-06T14:04:26.449 INFO:tasks.workunit.client.1.smithi174.stdout:3/956: fsync df/f18 0 2024-05-06T14:04:26.449 INFO:tasks.workunit.client.1.smithi174.stdout:3/957: creat df/d10/da2/f122 x:0 0 0 2024-05-06T14:04:26.450 INFO:tasks.workunit.client.1.smithi174.stdout:3/958: dread df/d10/d1b/d7e/d57/f61 [110592,28672] 0 2024-05-06T14:04:26.450 INFO:tasks.workunit.client.1.smithi174.stdout:0/973: fdatasync d0/d4/d8/d25/d5c/f4c 0 2024-05-06T14:04:26.450 INFO:tasks.workunit.client.1.smithi174.stdout:0/974: getdents d0/d4/d8/d25/d5c/d4a/da7/d140 0 2024-05-06T14:04:26.450 INFO:tasks.workunit.client.1.smithi174.stdout:0/975: rmdir d0/d36 39 2024-05-06T14:04:26.450 INFO:tasks.workunit.client.1.smithi174.stdout:0/976: rmdir d0/d4/d8/d25/d5c/dde 39 2024-05-06T14:04:26.450 INFO:tasks.workunit.client.1.smithi174.stdout:0/977: stat d0/d4/d8/d25/d5c/c4e 0 2024-05-06T14:04:26.450 INFO:tasks.workunit.client.1.smithi174.stdout:0/978: chown d0/d36/d45/d114 1 1 2024-05-06T14:04:26.451 INFO:tasks.workunit.client.1.smithi174.stdout:3/959: write df/d2d/d84/f10f [282788,106971] 0 2024-05-06T14:04:26.451 INFO:tasks.workunit.client.1.smithi174.stdout:0/979: rmdir d0/d4/d80 39 2024-05-06T14:04:26.453 INFO:tasks.workunit.client.1.smithi174.stdout:3/960: link df/d10/f3f df/d2d/d4e/db6/f123 0 2024-05-06T14:04:26.453 INFO:tasks.workunit.client.1.smithi174.stdout:3/961: rmdir df/d2d/d4e 39 2024-05-06T14:04:26.453 INFO:tasks.workunit.client.1.smithi174.stdout:7/856: dwrite d0/d1d/da4/d61/d19/d24/d47/dc6/fe3 [28672,110592] 0 2024-05-06T14:04:26.453 INFO:tasks.workunit.client.1.smithi174.stdout:0/980: creat d0/d3/dfc/d141/f146 x:0 0 0 2024-05-06T14:04:26.453 INFO:tasks.workunit.client.1.smithi174.stdout:3/962: write df/d10/d1b/d7e/d57/fe2 [716062,49053] 0 2024-05-06T14:04:26.453 INFO:tasks.workunit.client.1.smithi174.stdout:0/981: mknod d0/d36/d3f/c147 0 2024-05-06T14:04:26.454 INFO:tasks.workunit.client.1.smithi174.stdout:3/963: mknod df/d2d/d4d/c124 0 2024-05-06T14:04:26.454 INFO:tasks.workunit.client.1.smithi174.stdout:0/982: mknod d0/d4/d8/d25/d5c/d44/dd5/d118/c148 0 2024-05-06T14:04:26.454 INFO:tasks.workunit.client.1.smithi174.stdout:3/964: rename df/d2d/d84/cd8 to df/d10/d1b/d7e/c125 0 2024-05-06T14:04:26.454 INFO:tasks.workunit.client.1.smithi174.stdout:3/965: rename df/d10/l23 to df/d2d/d4d/ded/l126 0 2024-05-06T14:04:26.454 INFO:tasks.workunit.client.1.smithi174.stdout:3/966: chown df/ce7 22767 1 2024-05-06T14:04:26.454 INFO:tasks.workunit.client.1.smithi174.stdout:3/967: mknod df/d2d/d84/d10b/c127 0 2024-05-06T14:04:26.454 INFO:tasks.workunit.client.1.smithi174.stdout:3/968: unlink df/d2d/d4d/fb4 0 2024-05-06T14:04:26.454 INFO:tasks.workunit.client.1.smithi174.stdout:3/969: mkdir df/d10/d1b/d7e/d57/d128 0 2024-05-06T14:04:26.455 INFO:tasks.workunit.client.1.smithi174.stdout:3/970: read df/f1f [118440,36012] 0 2024-05-06T14:04:26.455 INFO:tasks.workunit.client.1.smithi174.stdout:3/971: rmdir df/d2d/d4d/da5 39 2024-05-06T14:04:26.455 INFO:tasks.workunit.client.1.smithi174.stdout:3/972: rename df/d2d/d5b/l115 to df/d10/d1b/d7e/l129 0 2024-05-06T14:04:26.455 INFO:tasks.workunit.client.1.smithi174.stdout:3/973: mkdir df/d2d/d84/d10b/d12a 0 2024-05-06T14:04:26.455 INFO:tasks.workunit.client.1.smithi174.stdout:3/974: getdents df/d10/d1b/d7e/d57 0 2024-05-06T14:04:26.455 INFO:tasks.workunit.client.1.smithi174.stdout:3/975: dread df/d10/d1b/f76 [1536000,61440] 0 2024-05-06T14:04:26.455 INFO:tasks.workunit.client.1.smithi174.stdout:3/976: mknod df/d2d/d4d/ded/d10d/c12b 0 2024-05-06T14:04:26.455 INFO:tasks.workunit.client.1.smithi174.stdout:3/977: mknod df/d2d/d87/c12c 0 2024-05-06T14:04:26.456 INFO:tasks.workunit.client.1.smithi174.stdout:3/978: truncate df/d10/da2/fdc 1715859 0 2024-05-06T14:04:26.456 INFO:tasks.workunit.client.1.smithi174.stdout:2/952: dread d0/d1/d2/d4/dde/f12f [36864,57344] 0 2024-05-06T14:04:26.466 INFO:tasks.workunit.client.1.smithi174.stdout:7/857: dwrite d0/d1d/da4/d61/d28/d37/f4e [651264,4096] 0 2024-05-06T14:04:26.475 INFO:tasks.workunit.client.1.smithi174.stdout:0/983: dread d0/d4/d8/d25/d5c/d44/dd5/d38/f137 [524288,61440] 0 2024-05-06T14:04:26.475 INFO:tasks.workunit.client.1.smithi174.stdout:0/984: truncate d0/d4/d8/d25/d5c/d44/dd5/f106 349019 0 2024-05-06T14:04:26.476 INFO:tasks.workunit.client.1.smithi174.stdout:7/858: dread d0/d1d/da4/d61/d19/d24/f10 [1126400,114688] 0 2024-05-06T14:04:26.488 INFO:tasks.workunit.client.1.smithi174.stdout:3/979: fsync df/d2d/f31 0 2024-05-06T14:04:26.488 INFO:tasks.workunit.client.1.smithi174.stdout:2/953: fsync d0/d16/f5f 0 2024-05-06T14:04:26.489 INFO:tasks.workunit.client.1.smithi174.stdout:3/980: write df/d2d/d4e/db6/fc1 [1516228,1228] 0 2024-05-06T14:04:26.489 INFO:tasks.workunit.client.1.smithi174.stdout:3/981: rename df/d2d/d4e/d81/de3/ff6 to df/d2d/d5b/f12d 0 2024-05-06T14:04:26.489 INFO:tasks.workunit.client.1.smithi174.stdout:3/982: creat df/d10/d1b/d7e/f12e x:0 0 0 2024-05-06T14:04:26.489 INFO:tasks.workunit.client.1.smithi174.stdout:2/954: read d0/d1/d2/d4/d6/fcd [1958275,111921] 0 2024-05-06T14:04:26.489 INFO:tasks.workunit.client.1.smithi174.stdout:3/983: unlink df/d10/d1b/d7e/d5a/c6f 0 2024-05-06T14:04:26.489 INFO:tasks.workunit.client.1.smithi174.stdout:3/984: truncate df/d10/d1b/d7e/d5a/f108 748082 0 2024-05-06T14:04:26.489 INFO:tasks.workunit.client.1.smithi174.stdout:3/985: chown df/f55 3002 1 2024-05-06T14:04:26.489 INFO:tasks.workunit.client.1.smithi174.stdout:2/955: creat d0/d1/f134 x:0 0 0 2024-05-06T14:04:26.490 INFO:tasks.workunit.client.1.smithi174.stdout:0/985: dwrite d0/d3/d104/f22 [860160,32768] 0 2024-05-06T14:04:26.490 INFO:tasks.workunit.client.1.smithi174.stdout:0/986: chown d0/d36/d3f/cc1 6 1 2024-05-06T14:04:26.490 INFO:tasks.workunit.client.1.smithi174.stdout:0/987: symlink d0/d4/d8/d25/d5c/d44/dd5/d38/dcd/l149 0 2024-05-06T14:04:26.490 INFO:tasks.workunit.client.1.smithi174.stdout:7/859: dwrite d0/d1d/da4/d61/d19/d39/d90/da6/d101/f110 [585728,36864] 0 2024-05-06T14:04:26.490 INFO:tasks.workunit.client.1.smithi174.stdout:7/860: creat d0/d1d/da4/d61/d19/d24/d47/d70/d83/f127 x:0 0 0 2024-05-06T14:04:26.490 INFO:tasks.workunit.client.1.smithi174.stdout:7/861: chown d0/d1d/da4/d61/d28/lcc 60 1 2024-05-06T14:04:26.490 INFO:tasks.workunit.client.1.smithi174.stdout:3/986: dwrite df/d10/d1b/d59/f89 [135168,24576] 0 2024-05-06T14:04:26.519 INFO:tasks.workunit.client.1.smithi174.stdout:2/956: fsync d0/d1/d2/d1b/d10a/da2/db6/fd9 0 2024-05-06T14:04:26.522 INFO:tasks.workunit.client.1.smithi174.stdout:2/957: dread d0/d1/d2/d4/d18/d2d/d32/f47 [372736,65536] 0 2024-05-06T14:04:26.522 INFO:tasks.workunit.client.1.smithi174.stdout:7/862: unlink d0/d1d/d9c/dad/dda/l11c 0 2024-05-06T14:04:26.523 INFO:tasks.workunit.client.1.smithi174.stdout:2/958: creat d0/da/dcf/f135 x:0 0 0 2024-05-06T14:04:26.523 INFO:tasks.workunit.client.1.smithi174.stdout:7/863: getdents d0/d1d/da4/d61/d19/d39/d90/da6/d101 0 2024-05-06T14:04:26.523 INFO:tasks.workunit.client.1.smithi174.stdout:7/864: chown d0/d1d/da4/d61/l53 215807924 1 2024-05-06T14:04:26.523 INFO:tasks.workunit.client.1.smithi174.stdout:2/959: read d0/d16/f5f [793482,47327] 0 2024-05-06T14:04:26.523 INFO:tasks.workunit.client.1.smithi174.stdout:7/865: unlink d0/d1d/da4/d61/d28/ld4 0 2024-05-06T14:04:26.523 INFO:tasks.workunit.client.1.smithi174.stdout:2/960: link d0/d16/f19 d0/d1/d2/d4/d18/d2d/d32/f136 0 2024-05-06T14:04:26.523 INFO:tasks.workunit.client.1.smithi174.stdout:7/866: rmdir d0/d1d/d9c/dad/dda/de5 39 2024-05-06T14:04:26.523 INFO:tasks.workunit.client.1.smithi174.stdout:7/867: stat d0/d1d/da4/d61/d28/d59/da1/dcf 0 2024-05-06T14:04:26.524 INFO:tasks.workunit.client.1.smithi174.stdout:2/961: link d0/d24/f98 d0/d1/d2/d4/d6/dd8/f137 0 2024-05-06T14:04:26.524 INFO:tasks.workunit.client.1.smithi174.stdout:3/987: write df/d10/f16 [2960335,116777] 0 2024-05-06T14:04:26.524 INFO:tasks.workunit.client.1.smithi174.stdout:2/962: stat d0/d1/d2/d4/d6/l36 0 2024-05-06T14:04:26.524 INFO:tasks.workunit.client.1.smithi174.stdout:3/988: link df/d10/d1b/d59/fcc df/d2d/d5b/f12f 0 2024-05-06T14:04:26.524 INFO:tasks.workunit.client.1.smithi174.stdout:2/963: creat d0/da/d3f/f138 x:0 0 0 2024-05-06T14:04:26.570 INFO:tasks.workunit.client.1.smithi174.stdout:7/868: dwrite d0/d1d/f75 [626688,4096] 0 2024-05-06T14:04:26.571 INFO:tasks.workunit.client.1.smithi174.stdout:7/869: rename d0/d1d/da4/d61/d19/d24/d47/d64 to d0/d1d/d128 0 2024-05-06T14:04:26.571 INFO:tasks.workunit.client.1.smithi174.stdout:7/870: chown d0/d1d/da4/d61/d28/d37/f60 20932644 1 2024-05-06T14:04:26.571 INFO:tasks.workunit.client.1.smithi174.stdout:2/964: dwrite d0/d1/d2/d4/d6/dd8/f137 [1613824,49152] 0 2024-05-06T14:04:26.571 INFO:tasks.workunit.client.1.smithi174.stdout:7/871: write d0/d1d/da4/d61/d28/d37/fee [975870,38408] 0 2024-05-06T14:04:26.571 INFO:tasks.workunit.client.1.smithi174.stdout:2/965: link d0/d16/c9b d0/da/dcf/c139 0 2024-05-06T14:04:26.571 INFO:tasks.workunit.client.1.smithi174.stdout:3/989: dwrite df/d10/f16 [3330048,4096] 0 2024-05-06T14:04:26.571 INFO:tasks.workunit.client.1.smithi174.stdout:2/966: dread - d0/d1/d2/d4/d18/d2d/f120 zero size 2024-05-06T14:04:26.572 INFO:tasks.workunit.client.1.smithi174.stdout:3/990: unlink df/d2d/d4e/ca4 0 2024-05-06T14:04:26.572 INFO:tasks.workunit.client.1.smithi174.stdout:2/967: write d0/d1/d2/d4/d18/fa0 [995227,44071] 0 2024-05-06T14:04:26.622 INFO:tasks.workunit.client.1.smithi174.stdout:2/968: dwrite d0/da/d3f/f132 [36864,4096] 0 2024-05-06T14:04:26.630 INFO:tasks.workunit.client.1.smithi174.stdout:3/991: read df/d2d/d4e/db6/db8/f116 [357770,73655] 0 2024-05-06T14:04:26.630 INFO:tasks.workunit.client.1.smithi174.stdout:3/992: readlink df/dbc/leb 0 2024-05-06T14:04:26.630 INFO:tasks.workunit.client.1.smithi174.stdout:3/993: mknod df/d10/d1b/d59/c130 0 2024-05-06T14:04:26.630 INFO:tasks.workunit.client.1.smithi174.stdout:3/994: chown df/d10/c46 20861417 1 2024-05-06T14:04:26.632 INFO:tasks.workunit.client.1.smithi174.stdout:7/872: dread d0/d1d/da4/d61/d19/d24/d89/f94 [163840,16384] 0 2024-05-06T14:04:26.632 INFO:tasks.workunit.client.1.smithi174.stdout:7/873: chown d0/d1d/d128/d10c 32 1 2024-05-06T14:04:26.632 INFO:tasks.workunit.client.1.smithi174.stdout:7/874: creat d0/d1d/da4/d61/d28/db1/dc8/ddb/f129 x:0 0 0 2024-05-06T14:04:26.700 INFO:tasks.workunit.client.1.smithi174.stdout:3/995: dread df/d10/d1b/f33 [278528,118784] 0 2024-05-06T14:04:26.711 INFO:tasks.workunit.client.1.smithi174.stdout:7/875: fdatasync d0/d1d/d128/fbf 0 2024-05-06T14:04:26.711 INFO:tasks.workunit.client.1.smithi174.stdout:2/969: fsync d0/d1/d2/d4/d6/f88 0 2024-05-06T14:04:26.711 INFO:tasks.workunit.client.1.smithi174.stdout:7/876: dread - d0/d1d/da4/d61/d19/d24/d6f/fa0 zero size 2024-05-06T14:04:26.711 INFO:tasks.workunit.client.1.smithi174.stdout:7/877: dread - d0/d1d/da4/d61/d19/d39/d90/da6/db6/fd6 zero size 2024-05-06T14:04:26.712 INFO:tasks.workunit.client.1.smithi174.stdout:7/878: rmdir d0/d1d/da4/d61/d19/d39/d90/da6 39 2024-05-06T14:04:26.712 INFO:tasks.workunit.client.1.smithi174.stdout:7/879: stat d0/d1d/da4/d61/d19/d39/d90/da6/db6/ff1 0 2024-05-06T14:04:26.712 INFO:tasks.workunit.client.1.smithi174.stdout:2/970: mknod d0/d1/d2/d4/d18/d97/d11d/d108/d72/c13a 0 2024-05-06T14:04:26.712 INFO:tasks.workunit.client.1.smithi174.stdout:7/880: creat d0/d1d/da4/d61/d19/d24/d47/dc6/d106/f12a x:0 0 0 2024-05-06T14:04:26.712 INFO:tasks.workunit.client.1.smithi174.stdout:2/971: truncate d0/d1/d2/d4/d18/d97/d11d/d108/d72/d133/f2e 1602473 0 2024-05-06T14:04:26.712 INFO:tasks.workunit.client.1.smithi174.stdout:2/972: rmdir d0/d1/d2/d1b 39 2024-05-06T14:04:26.712 INFO:tasks.workunit.client.1.smithi174.stdout:7/881: link d0/d1d/da4/d61/d19/d24/d6f/fb5 d0/d1d/d9c/dad/dda/de5/f12b 0 2024-05-06T14:04:26.712 INFO:tasks.workunit.client.1.smithi174.stdout:3/996: dwrite df/d10/d1b/d7e/d5a/f99 [753664,40960] 0 2024-05-06T14:04:26.714 INFO:tasks.workunit.client.1.smithi174.stdout:3/997: write f7 [1008953,35827] 0 2024-05-06T14:04:26.715 INFO:tasks.workunit.client.1.smithi174.stdout:3/998: truncate df/d2d/f86 1455555 0 2024-05-06T14:04:26.715 INFO:tasks.workunit.client.1.smithi174.stdout:3/999: rmdir df/d2d/d5b 39 2024-05-06T14:04:26.770 INFO:tasks.workunit.client.1.smithi174.stdout:2/973: fsync d0/d1/d2/d4/d18/d97/d11d/d108/f7d 0 2024-05-06T14:04:26.770 INFO:tasks.workunit.client.1.smithi174.stdout:7/882: fdatasync d0/d1d/f2c 0 2024-05-06T14:04:26.770 INFO:tasks.workunit.client.1.smithi174.stdout:7/883: rename d0/d1d/da4/d61/d19/d39/d90/da6/db6/fd6 to d0/d1d/da4/d61/d19/d24/d6f/f12c 0 2024-05-06T14:04:26.773 INFO:tasks.workunit.client.1.smithi174.stdout:2/974: mkdir d0/d1/d2/d4/d18/de9/d13b 0 2024-05-06T14:04:26.776 INFO:tasks.workunit.client.1.smithi174.stdout:7/884: unlink d0/d1d/da4/f4b 0 2024-05-06T14:04:26.776 INFO:tasks.workunit.client.1.smithi174.stdout:7/885: write d0/d1d/da4/d61/d28/d37/f60 [594249,28699] 0 2024-05-06T14:04:26.781 INFO:tasks.workunit.client.1.smithi174.stdout:7/886: truncate d0/d1d/da4/d61/d19/d24/d47/dc6/fe3 722507 0 2024-05-06T14:04:26.781 INFO:tasks.workunit.client.1.smithi174.stdout:7/887: stat d0/d1d/da4/d61/d28/d37 0 2024-05-06T14:04:26.782 INFO:tasks.workunit.client.1.smithi174.stdout:7/888: write d0/d1d/da4/d61/d19/db7/fe7 [435650,108] 0 2024-05-06T14:04:26.782 INFO:tasks.workunit.client.1.smithi174.stdout:2/975: mkdir d0/d24/d77/d93/d9a/d13c 0 2024-05-06T14:04:26.782 INFO:tasks.workunit.client.1.smithi174.stdout:7/889: creat d0/d1d/da4/d61/d19/d24/d14/f12d x:0 0 0 2024-05-06T14:04:26.782 INFO:tasks.workunit.client.1.smithi174.stdout:2/976: write d0/d24/f98 [2352430,36760] 0 2024-05-06T14:04:26.782 INFO:tasks.workunit.client.1.smithi174.stdout:2/977: mknod d0/d24/d77/d93/d9a/d13c/c13d 0 2024-05-06T14:04:26.782 INFO:tasks.workunit.client.1.smithi174.stdout:2/978: creat d0/d24/d77/d93/d9a/f13e x:0 0 0 2024-05-06T14:04:26.782 INFO:tasks.workunit.client.1.smithi174.stdout:2/979: write d0/d1/d2/d4/d18/d2d/f102 [54509,18810] 0 2024-05-06T14:04:26.784 INFO:tasks.workunit.client.1.smithi174.stdout:7/890: dwrite d0/d1d/da4/d61/d19/f2d [1159168,28672] 0 2024-05-06T14:04:26.785 INFO:tasks.workunit.client.1.smithi174.stdout:7/891: rename d0/d1d/da4/d61/d19/d24/d47/d70/d67 to d0/d1d/da4/d61/d19/d39/d90/d12e 0 2024-05-06T14:04:26.785 INFO:tasks.workunit.client.1.smithi174.stdout:2/980: dwrite d0/d1/d2/d4/dde/f12f [892928,40960] 0 2024-05-06T14:04:26.785 INFO:tasks.workunit.client.1.smithi174.stdout:2/981: chown d0/d1/d2/d4/d6/f88 459 1 2024-05-06T14:04:26.785 INFO:tasks.workunit.client.1.smithi174.stdout:2/982: write d0/da/d3f/f71 [683593,64661] 0 2024-05-06T14:04:26.785 INFO:tasks.workunit.client.1.smithi174.stdout:2/983: mknod d0/da/c13f 0 2024-05-06T14:04:26.785 INFO:tasks.workunit.client.1.smithi174.stdout:2/984: chown d0/da/l11f 157 1 2024-05-06T14:04:26.785 INFO:tasks.workunit.client.1.smithi174.stdout:2/985: getdents d0/d1/d2/d4/d18/d97/d11d 0 2024-05-06T14:04:26.785 INFO:tasks.workunit.client.1.smithi174.stdout:2/986: dread d0/d1/d2/d4/d18/d97/d11d/d108/f7f [294912,114688] 0 2024-05-06T14:04:26.854 INFO:tasks.workunit.client.1.smithi174.stdout:7/892: dwrite d0/d1d/da4/d61/d19/d24/f126 [835584,81920] 0 2024-05-06T14:04:26.858 INFO:tasks.workunit.client.1.smithi174.stdout:0/988: sync 2024-05-06T14:04:26.858 INFO:tasks.workunit.client.1.smithi174.stdout:0/989: creat d0/d4/d80/d102/f14a x:0 0 0 2024-05-06T14:04:26.858 INFO:tasks.workunit.client.1.smithi174.stdout:0/990: rename d0/d4/f3d to d0/d3/f14b 0 2024-05-06T14:04:26.858 INFO:tasks.workunit.client.1.smithi174.stdout:0/991: stat d0/d4/d80/d93/dbe 0 2024-05-06T14:04:26.858 INFO:tasks.workunit.client.1.smithi174.stdout:0/992: creat d0/d4/d8/d25/d5c/d4a/da7/f14c x:0 0 0 2024-05-06T14:04:26.859 INFO:tasks.workunit.client.1.smithi174.stdout:2/987: dwrite d0/da/f74 [942080,73728] 0 2024-05-06T14:04:26.859 INFO:tasks.workunit.client.1.smithi174.stdout:0/993: creat d0/d4/d8/d25/d5c/d4a/da7/d10b/f14d x:0 0 0 2024-05-06T14:04:26.859 INFO:tasks.workunit.client.1.smithi174.stdout:0/994: truncate d0/d4/d8/d25/d5c/d4a/f95 877037 0 2024-05-06T14:04:26.859 INFO:tasks.workunit.client.1.smithi174.stdout:2/988: symlink d0/da/d3f/l140 0 2024-05-06T14:04:26.859 INFO:tasks.workunit.client.1.smithi174.stdout:0/995: dread d0/d36/d45/fc5 [311296,94208] 0 2024-05-06T14:04:26.859 INFO:tasks.workunit.client.1.smithi174.stdout:2/989: dread d0/d1/d2/d4/dde/f12f [450560,36864] 0 2024-05-06T14:04:26.904 INFO:tasks.workunit.client.1.smithi174.stdout:0/996: fdatasync d0/d3/dad/fa9 0 2024-05-06T14:04:26.904 INFO:tasks.workunit.client.1.smithi174.stdout:2/990: fsync d0/d1/d2/d4/d18/d2d/d32/fa1 0 2024-05-06T14:04:26.904 INFO:tasks.workunit.client.1.smithi174.stdout:2/991: write d0/d1/d2/d4/d18/d97/d11d/d108/f86 [854825,17908] 0 2024-05-06T14:04:26.907 INFO:tasks.workunit.client.1.smithi174.stdout:0/997: dread d0/d36/f3b [966656,32768] 0 2024-05-06T14:04:26.907 INFO:tasks.workunit.client.1.smithi174.stdout:2/992: mknod d0/d1/d2/d4/d18/d2d/d32/d89/c141 0 2024-05-06T14:04:26.907 INFO:tasks.workunit.client.1.smithi174.stdout:0/998: truncate d0/d36/d45/f4d 790828 0 2024-05-06T14:04:26.907 INFO:tasks.workunit.client.1.smithi174.stdout:0/999: truncate d0/d3/d104/f30 1844265 0 2024-05-06T14:04:26.907 INFO:tasks.workunit.client.1.smithi174.stdout:2/993: write d0/d1/d2/d2a/fca [2844726,98949] 0 2024-05-06T14:04:26.907 INFO:tasks.workunit.client.1.smithi174.stdout:2/994: getdents d0/d1/d2/d4/d51 0 2024-05-06T14:04:26.908 INFO:tasks.workunit.client.1.smithi174.stdout:2/995: rmdir d0/d1/d2/d4/d18/d2d/dd1 39 2024-05-06T14:04:26.908 INFO:tasks.workunit.client.1.smithi174.stdout:2/996: mkdir d0/d1/d2/d4/d18/d2d/d142 0 2024-05-06T14:04:26.908 INFO:tasks.workunit.client.1.smithi174.stdout:2/997: write d0/d1/d2/d4/d6/d105/f115 [812516,116470] 0 2024-05-06T14:04:26.908 INFO:tasks.workunit.client.1.smithi174.stdout:2/998: truncate d0/da/d3f/fac 2170754 0 2024-05-06T14:04:26.955 INFO:tasks.workunit.client.1.smithi174.stdout:2/999: write d0/d1/d2/d4/d18/d97/d11d/d108/d72/d133/f9e [620573,102056] 0 2024-05-06T14:04:27.088 INFO:tasks.workunit.client.1.smithi174.stdout:7/893: sync 2024-05-06T14:04:27.088 INFO:tasks.workunit.client.1.smithi174.stdout:7/894: chown d0/d1d/da4/d61/d28/d37/f4e 0 1 2024-05-06T14:04:27.089 INFO:tasks.workunit.client.1.smithi174.stdout:7/895: read - d0/d1d/da4/d61/d19/d24/d47/dc6/f107 zero size 2024-05-06T14:04:27.089 INFO:tasks.workunit.client.1.smithi174.stdout:7/896: read - d0/d1d/d128/fa9 zero size 2024-05-06T14:04:27.089 INFO:tasks.workunit.client.1.smithi174.stdout:7/897: link d0/d1d/da4/f97 d0/d1d/da4/f12f 0 2024-05-06T14:04:27.089 INFO:tasks.workunit.client.1.smithi174.stdout:7/898: creat d0/d1d/da4/d61/d19/d24/f130 x:0 0 0 2024-05-06T14:04:27.089 INFO:tasks.workunit.client.1.smithi174.stdout:7/899: dwrite d0/d1d/da4/d61/f38 [2568192,4096] 0 2024-05-06T14:04:27.089 INFO:tasks.workunit.client.1.smithi174.stdout:7/900: readlink d0/l11d 0 2024-05-06T14:04:27.089 INFO:tasks.workunit.client.1.smithi174.stdout:7/901: symlink d0/d1d/da4/d61/d19/d24/d47/dc6/d116/l131 0 2024-05-06T14:04:27.089 INFO:tasks.workunit.client.1.smithi174.stdout:7/902: creat d0/d1d/da4/d61/d19/d39/f132 x:0 0 0 2024-05-06T14:04:27.090 INFO:tasks.workunit.client.1.smithi174.stdout:7/903: symlink d0/d1d/d9c/dad/dda/l133 0 2024-05-06T14:04:27.090 INFO:tasks.workunit.client.1.smithi174.stdout:7/904: creat d0/d1d/da4/d61/d19/d39/d11e/f134 x:0 0 0 2024-05-06T14:04:27.090 INFO:tasks.workunit.client.1.smithi174.stdout:7/905: link d0/d1d/da4/d61/d28/db1/deb/f10f d0/d1d/da4/d61/d28/d37/f135 0 2024-05-06T14:04:27.090 INFO:tasks.workunit.client.1.smithi174.stdout:7/906: stat d0/d1d/da4/d61/d19/d24/d6f/d88/f95 0 2024-05-06T14:04:27.143 INFO:tasks.workunit.client.1.smithi174.stdout:7/907: dwrite d0/d1d/da4/d61/d28/db1/dc8/ddb/f129 [765952,12288] 0 2024-05-06T14:04:27.143 INFO:tasks.workunit.client.1.smithi174.stdout:7/908: creat d0/d1d/da4/d61/d19/d24/d47/d70/f136 x:0 0 0 2024-05-06T14:04:27.156 INFO:tasks.workunit.client.1.smithi174.stdout:7/909: dwrite d0/d1d/da4/d61/d19/db7/f10e [61440,65536] 0 2024-05-06T14:04:27.156 INFO:tasks.workunit.client.1.smithi174.stdout:7/910: stat d0/d1d/da4/d61/d28/d37/dfb 0 2024-05-06T14:04:27.156 INFO:tasks.workunit.client.1.smithi174.stdout:7/911: rmdir d0/d1d/da4/d61/d19/d24/d47/d70 39 2024-05-06T14:04:27.156 INFO:tasks.workunit.client.1.smithi174.stdout:7/912: truncate d0/d1d/da4/d61/d28/d37/fee 1832457 0 2024-05-06T14:04:27.157 INFO:tasks.workunit.client.1.smithi174.stdout:7/913: dread - d0/d1d/da4/f115 zero size 2024-05-06T14:04:27.157 INFO:tasks.workunit.client.1.smithi174.stdout:7/914: chown d0/d1d/d128/fa9 1188 1 2024-05-06T14:04:27.157 INFO:tasks.workunit.client.1.smithi174.stdout:7/915: write d0/d1d/da4/d61/d19/d24/fd9 [69756,96383] 0 2024-05-06T14:04:27.289 INFO:tasks.workunit.client.1.smithi174.stdout:7/916: sync 2024-05-06T14:04:27.289 INFO:tasks.workunit.client.1.smithi174.stdout:7/917: creat d0/d1d/da4/d61/d19/d39/d90/da6/d101/f137 x:0 0 0 2024-05-06T14:04:27.289 INFO:tasks.workunit.client.1.smithi174.stdout:7/918: stat d0/d1d/da4/d61/d28/db1/deb 0 2024-05-06T14:04:27.289 INFO:tasks.workunit.client.1.smithi174.stdout:7/919: chown d0/d1d/d9c/dad/dda/de5/dfa/f11f 0 1 2024-05-06T14:04:27.290 INFO:tasks.workunit.client.1.smithi174.stdout:7/920: symlink d0/d1d/d128/l138 0 2024-05-06T14:04:27.290 INFO:tasks.workunit.client.1.smithi174.stdout:7/921: creat d0/d1d/da4/d61/d28/d59/f139 x:0 0 0 2024-05-06T14:04:27.290 INFO:tasks.workunit.client.1.smithi174.stdout:7/922: creat d0/d3a/f13a x:0 0 0 2024-05-06T14:04:27.332 INFO:tasks.workunit.client.1.smithi174.stdout:7/923: fdatasync d0/d1d/da4/d61/d19/d24/d47/dc6/f107 0 2024-05-06T14:04:27.332 INFO:tasks.workunit.client.1.smithi174.stdout:7/924: stat d0/d1d/da4/d61/d28/d59/fe2 0 2024-05-06T14:04:27.332 INFO:tasks.workunit.client.1.smithi174.stdout:7/925: truncate d0/d1d/da4/d61/d28/db1/ff5 607710 0 2024-05-06T14:04:27.332 INFO:tasks.workunit.client.1.smithi174.stdout:7/926: rename d0/d1d/da4/d61/d28/db1/cd0 to d0/d1d/da4/d61/d19/d39/d90/da6/c13b 0 2024-05-06T14:04:27.340 INFO:tasks.workunit.client.1.smithi174.stdout:7/927: fdatasync d0/d1d/da4/d61/d19/d24/d47/fe0 0 2024-05-06T14:04:27.340 INFO:tasks.workunit.client.1.smithi174.stdout:7/928: write d0/d1d/da4/d61/f5c [1912069,129726] 0 2024-05-06T14:04:27.341 INFO:tasks.workunit.client.1.smithi174.stdout:7/929: dwrite d0/d1d/da4/d61/d19/d39/d90/d12e/f86 [311296,8192] 0 2024-05-06T14:04:27.341 INFO:tasks.workunit.client.1.smithi174.stdout:7/930: creat d0/d1d/da4/d61/d19/d39/d46/f13c x:0 0 0 2024-05-06T14:04:27.341 INFO:tasks.workunit.client.1.smithi174.stdout:7/931: rename d0/d1d/da4/d61/d19/d24/d47/d70/f136 to d0/d1d/da4/d61/d19/d24/d6f/d88/f13d 0 2024-05-06T14:04:27.360 INFO:tasks.workunit.client.1.smithi174.stdout:7/932: fdatasync d0/d1d/da4/d61/d19/d39/d46/f57 0 2024-05-06T14:04:27.360 INFO:tasks.workunit.client.1.smithi174.stdout:7/933: getdents d0/d1d/da4/d61/d19/d24 0 2024-05-06T14:04:27.361 INFO:tasks.workunit.client.1.smithi174.stdout:7/934: creat d0/d1d/da4/d61/d28/d37/f13e x:0 0 0 2024-05-06T14:04:27.361 INFO:tasks.workunit.client.1.smithi174.stdout:7/935: creat d0/d1d/d9c/dad/dda/f13f x:0 0 0 2024-05-06T14:04:27.361 INFO:tasks.workunit.client.1.smithi174.stdout:7/936: dwrite d0/d1d/da4/d61/d19/d24/d47/d70/d83/f127 [217088,32768] 0 2024-05-06T14:04:27.379 INFO:tasks.workunit.client.1.smithi174.stdout:7/937: dwrite d0/d1d/da4/d61/fb [425984,61440] 0 2024-05-06T14:04:27.380 INFO:tasks.workunit.client.1.smithi174.stdout:7/938: write d0/d1d/da4/d61/d19/d24/d14/f33 [677517,82936] 0 2024-05-06T14:04:27.380 INFO:tasks.workunit.client.1.smithi174.stdout:7/939: chown d0/d1d/da4/d61/d19/f7d 15429646 1 2024-05-06T14:04:27.380 INFO:tasks.workunit.client.1.smithi174.stdout:7/940: chown d0/d1d/l5f 24 1 2024-05-06T14:04:27.380 INFO:tasks.workunit.client.1.smithi174.stdout:7/941: write d0/d1d/da4/d61/d19/d39/d46/f81 [1494198,67296] 0 2024-05-06T14:04:27.399 INFO:tasks.workunit.client.1.smithi174.stdout:7/942: dwrite d0/f8e [647168,86016] 0 2024-05-06T14:04:27.400 INFO:tasks.workunit.client.1.smithi174.stdout:7/943: rmdir d0/d1d/da4/d61/d28/db1/dc8/d117 0 2024-05-06T14:04:27.433 INFO:tasks.workunit.client.1.smithi174.stdout:7/944: fsync d0/f8e 0 2024-05-06T14:04:27.433 INFO:tasks.workunit.client.1.smithi174.stdout:7/945: fdatasync d0/d1d/d9c/dad/dda/de5/dfa/f11f 0 2024-05-06T14:04:27.433 INFO:tasks.workunit.client.1.smithi174.stdout:7/946: fdatasync d0/d1d/da4/d61/d28/d37/f60 0 2024-05-06T14:04:27.434 INFO:tasks.workunit.client.1.smithi174.stdout:7/947: creat d0/d1d/da4/d61/d28/f140 x:0 0 0 2024-05-06T14:04:27.434 INFO:tasks.workunit.client.1.smithi174.stdout:7/948: mknod d0/d1d/d128/c141 0 2024-05-06T14:04:27.434 INFO:tasks.workunit.client.1.smithi174.stdout:7/949: chown d0/d1d/d9c/dad/dda/de5/cf2 240014391 1 2024-05-06T14:04:27.434 INFO:tasks.workunit.client.1.smithi174.stdout:7/950: creat d0/d1d/da4/d61/d19/d39/d90/da6/df7/f142 x:0 0 0 2024-05-06T14:04:27.434 INFO:tasks.workunit.client.1.smithi174.stdout:7/951: rmdir d0/d1d/da4/d61 39 2024-05-06T14:04:27.434 INFO:tasks.workunit.client.1.smithi174.stdout:7/952: creat d0/d1d/da4/d61/d19/d39/d90/da6/db6/f143 x:0 0 0 2024-05-06T14:04:27.435 INFO:tasks.workunit.client.1.smithi174.stdout:7/953: dwrite d0/d1d/da4/d61/d28/fec [573440,28672] 0 2024-05-06T14:04:27.435 INFO:tasks.workunit.client.1.smithi174.stdout:7/954: rename d0/d1d/da4/d61/d19/d39/d90/da6 to d0/d1d/da4/d61/d19/db7/d144 0 2024-05-06T14:04:27.435 INFO:tasks.workunit.client.1.smithi174.stdout:7/955: creat d0/d1d/da4/d61/d19/db7/f145 x:0 0 0 2024-05-06T14:04:27.435 INFO:tasks.workunit.client.1.smithi174.stdout:7/956: symlink d0/d1d/da4/d61/l146 0 2024-05-06T14:04:27.436 INFO:tasks.workunit.client.1.smithi174.stdout:7/957: creat d0/d1d/da4/d61/d19/d24/d6f/f147 x:0 0 0 2024-05-06T14:04:27.436 INFO:tasks.workunit.client.1.smithi174.stdout:7/958: rename d0/d1d/d9c/dad/dda/de5/dfa/ffd to d0/d1d/da4/d61/d19/d39/d90/d10b/f148 0 2024-05-06T14:04:27.436 INFO:tasks.workunit.client.1.smithi174.stdout:7/959: dread - d0/d1d/da4/d61/d19/db7/d144/db6/f143 zero size 2024-05-06T14:04:27.436 INFO:tasks.workunit.client.1.smithi174.stdout:7/960: mkdir d0/d3a/d149 0 2024-05-06T14:04:27.440 INFO:tasks.workunit.client.1.smithi174.stdout:7/961: fdatasync d0/d1d/da4/d61/d19/d24/d6f/f12c 0 2024-05-06T14:04:27.440 INFO:tasks.workunit.client.1.smithi174.stdout:7/962: dread d0/f34 [3653632,45056] 0 2024-05-06T14:04:27.440 INFO:tasks.workunit.client.1.smithi174.stdout:7/963: link d0/d1d/da4/d61/d19/db7/d144/db6/f143 d0/d1d/da4/d61/d28/db1/f14a 0 2024-05-06T14:04:27.440 INFO:tasks.workunit.client.1.smithi174.stdout:7/964: chown d0/d1d/da4/d61/d28/d59/da1/dcf 1 1 2024-05-06T14:04:27.440 INFO:tasks.workunit.client.1.smithi174.stdout:7/965: symlink d0/d1d/d9c/dad/l14b 0 2024-05-06T14:04:27.441 INFO:tasks.workunit.client.1.smithi174.stdout:7/966: read - d0/d1d/da4/d61/d19/d24/d6f/fc1 zero size 2024-05-06T14:04:27.441 INFO:tasks.workunit.client.1.smithi174.stdout:7/967: link d0/d1d/da4/d61/d19/d24/d6f/d88/f95 d0/d1d/da4/d61/d28/db1/dc8/ddb/f14c 0 2024-05-06T14:04:27.441 INFO:tasks.workunit.client.1.smithi174.stdout:7/968: dwrite d0/d3a/f13a [499712,36864] 0 2024-05-06T14:04:27.441 INFO:tasks.workunit.client.1.smithi174.stdout:7/969: stat d0/cf 0 2024-05-06T14:04:27.454 INFO:tasks.workunit.client.1.smithi174.stdout:7/970: dwrite d0/d1d/da4/d61/d19/d24/d47/dc6/fe3 [708608,110592] 0 2024-05-06T14:04:27.455 INFO:tasks.workunit.client.1.smithi174.stdout:7/971: chown d0/d3a/lba 4148194 1 2024-05-06T14:04:27.455 INFO:tasks.workunit.client.1.smithi174.stdout:7/972: mkdir d0/d1d/da4/d61/d19/d39/d90/d12e/d11a/d14d 0 2024-05-06T14:04:27.455 INFO:tasks.workunit.client.1.smithi174.stdout:7/973: dread d0/d1d/da4/d61/d19/d24/d47/d70/d83/f127 [86016,8192] 0 2024-05-06T14:04:27.470 INFO:tasks.workunit.client.1.smithi174.stdout:7/974: fdatasync d0/d1d/d9c/dad/dda/de5/dfa/f11f 0 2024-05-06T14:04:27.472 INFO:tasks.workunit.client.1.smithi174.stdout:7/975: mkdir d0/d1d/d128/d10c/d14e 0 2024-05-06T14:04:27.472 INFO:tasks.workunit.client.1.smithi174.stdout:7/976: mkdir d0/d3a/dd7/d14f 0 2024-05-06T14:04:27.472 INFO:tasks.workunit.client.1.smithi174.stdout:7/977: mknod d0/d1d/da4/d61/d19/db7/d144/df7/c150 0 2024-05-06T14:04:27.473 INFO:tasks.workunit.client.1.smithi174.stdout:7/978: chown d0/d1d/da4/d61/d28/d37/lca 66991728 1 2024-05-06T14:04:27.473 INFO:tasks.workunit.client.1.smithi174.stdout:7/979: chown d0/d1d/l30 2 1 2024-05-06T14:04:27.473 INFO:tasks.workunit.client.1.smithi174.stdout:7/980: write d0/d1d/da4/d61/d19/db7/ff8 [195757,21191] 0 2024-05-06T14:04:27.473 INFO:tasks.workunit.client.1.smithi174.stdout:7/981: write d0/d1d/d9c/dad/dda/f13f [1045340,32428] 0 2024-05-06T14:04:27.473 INFO:tasks.workunit.client.1.smithi174.stdout:7/982: dread - d0/d1d/d9c/dad/dda/de5/f12b zero size 2024-05-06T14:04:27.473 INFO:tasks.workunit.client.1.smithi174.stdout:7/983: symlink d0/d1d/d9c/dad/dda/l151 0 2024-05-06T14:04:27.473 INFO:tasks.workunit.client.1.smithi174.stdout:7/984: truncate d0/d1d/da4/d61/d19/db7/d144/d101/f110 891488 0 2024-05-06T14:04:27.473 INFO:tasks.workunit.client.1.smithi174.stdout:7/985: unlink d0/d1d/da4/d61/d19/d39/d46/f13c 0 2024-05-06T14:04:27.474 INFO:tasks.workunit.client.1.smithi174.stdout:7/986: creat d0/d1d/da4/d61/d19/d24/d47/dc6/d106/f152 x:0 0 0 2024-05-06T14:04:27.474 INFO:tasks.workunit.client.1.smithi174.stdout:7/987: unlink d0/d1d/da4/d61/d28/db1/deb/ff0 0 2024-05-06T14:04:27.474 INFO:tasks.workunit.client.1.smithi174.stdout:7/988: write d0/d1d/da4/d61/fb [2098288,45848] 0 2024-05-06T14:04:27.474 INFO:tasks.workunit.client.1.smithi174.stdout:7/989: unlink d0/d3a/fde 0 2024-05-06T14:04:27.474 INFO:tasks.workunit.client.1.smithi174.stdout:7/990: write d0/d1d/da4/d61/d28/d59/f139 [238243,61478] 0 2024-05-06T14:04:27.476 INFO:tasks.workunit.client.1.smithi174.stdout:7/991: dwrite d0/d1d/da4/d61/d19/d24/f1b [487424,81920] 0 2024-05-06T14:04:27.495 INFO:tasks.workunit.client.1.smithi174.stdout:7/992: dwrite d0/fe [3108864,65536] 0 2024-05-06T14:04:27.496 INFO:tasks.workunit.client.1.smithi174.stdout:7/993: write d0/d1d/da4/d61/d19/d24/d14/d52/f3e [370826,89303] 0 2024-05-06T14:04:27.496 INFO:tasks.workunit.client.1.smithi174.stdout:7/994: rename d0/d1d/da4/d61/d19/d24/d14/c3b to d0/d1d/da4/d61/d19/d39/d90/c153 0 2024-05-06T14:04:27.496 INFO:tasks.workunit.client.1.smithi174.stdout:7/995: rmdir d0/d1d/da4/d61/d19/d39/d46 39 2024-05-06T14:04:27.496 INFO:tasks.workunit.client.1.smithi174.stdout:7/996: write d0/d1d/da4/d61/d28/d59/f3f [2357416,74843] 0 2024-05-06T14:04:27.527 INFO:tasks.workunit.client.1.smithi174.stdout:7/997: dread d0/d1d/da4/d61/d28/f6e [352256,57344] 0 2024-05-06T14:04:27.535 INFO:tasks.workunit.client.1.smithi174.stdout:7/998: dwrite d0/d1d/da4/d61/d19/d24/d47/dc6/d106/f152 [16384,32768] 0 2024-05-06T14:04:27.535 INFO:tasks.workunit.client.1.smithi174.stdout:7/999: symlink d0/d1d/da4/d61/d19/d24/d14/l154 0 2024-05-06T14:04:27.538 INFO:tasks.workunit.client.1.smithi174.stderr:+ rm -rf -- ./tmp.8G8UPVvPKW 2024-05-06T14:04:27.588 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-06T14:04:27.588 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-05-06T14:04:27.819 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-05-06T14:04:27.819 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-05-06T14:04:28.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:28.511+0000 7f71b4865700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3135616195 2024-05-06T14:04:28.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:28.511+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-05-06T14:04:38.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:38.015+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 msgr2=0x7f7190006620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:38.015+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 0x7f7190006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-05-06T14:04:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:38.015+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:38.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:38.015+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-05-06T14:04:42.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-06T14:04:42.265 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-06T14:04:42.291 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-06T14:04:42.293 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404/remote/smithi123/crash 2024-05-06T14:04:42.294 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/crash -- . 2024-05-06T14:04:42.354 INFO:teuthology.orchestra.run.smithi123.stderr:tar: /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-06T14:04:42.354 INFO:teuthology.orchestra.run.smithi123.stderr:tar: Error is not recoverable: exiting now 2024-05-06T14:04:42.356 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404/remote/smithi174/crash 2024-05-06T14:04:42.357 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/crash -- . 2024-05-06T14:04:42.378 INFO:teuthology.orchestra.run.smithi174.stderr:tar: /var/lib/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-06T14:04:42.379 INFO:teuthology.orchestra.run.smithi174.stderr:tar: Error is not recoverable: exiting now 2024-05-06T14:04:42.380 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-06T14:04:42.381 DEBUG:teuthology.orchestra.run.smithi123:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-05-06T14:04:42.418 INFO:tasks.cephadm:Compressing logs... 2024-05-06T14:04:42.419 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-06T14:04:42.461 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-06T14:04:42.485 INFO:teuthology.orchestra.run.smithi123.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mgr.smithi123.vjztrj.log 2024-05-06T14:04:42.486 INFO:teuthology.orchestra.run.smithi123.stderr:: No such file or directory 2024-05-06T14:04:42.486 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.log 2024-05-06T14:04:42.486 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-06T14:04:42.486 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mgr.smithi123.vjztrj.log: /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi123.cuurje.log 2024-05-06T14:04:42.486 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-06T14:04:42.487 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-client.ceph-exporter.smithi123.log 2024-05-06T14:04:42.487 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi123.cuurje.log: /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-06T14:04:42.487 INFO:teuthology.orchestra.run.smithi123.stderr: 87.2% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-06T14:04:42.487 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-client.ceph-exporter.smithi123.log: gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-06T14:04:42.492 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mon.smithi123.log 2024-05-06T14:04:42.492 INFO:teuthology.orchestra.run.smithi123.stderr: 93.4%/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.0.log: -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-client.ceph-exporter.smithi123.log.gzgzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-06T14:04:42.492 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-05-06T14:04:42.492 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi123.wnupgd.log 2024-05-06T14:04:42.492 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mon.smithi123.log: /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.cephadm.log: 90.7% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-06T14:04:42.493 INFO:teuthology.orchestra.run.smithi123.stderr: 84.1% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-06T14:04:42.493 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-06T14:04:42.493 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi123.wnupgd.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-06T14:04:42.496 INFO:teuthology.orchestra.run.smithi174.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-client.ceph-exporter.smithi174.log 2024-05-06T14:04:42.497 INFO:teuthology.orchestra.run.smithi174.stderr:: No such file or directory 2024-05-06T14:04:42.497 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi174.hwhiyg.log 2024-05-06T14:04:42.497 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-client.ceph-exporter.smithi174.log: gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.log 2024-05-06T14:04:42.497 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi174.hwhiyg.log: gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-06T14:04:42.497 INFO:teuthology.orchestra.run.smithi174.stderr: 93.4% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-client.ceph-exporter.smithi174.log.gz 2024-05-06T14:04:42.497 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-06T14:04:42.498 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-06T14:04:42.498 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.audit.log: /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-06T14:04:42.498 INFO:teuthology.orchestra.run.smithi174.stderr: 87.1% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-06T14:04:42.498 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi174.rqlodw.log 2024-05-06T14:04:42.498 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mon.smithi174.log 2024-05-06T14:04:42.498 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi174.rqlodw.log: gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-06T14:04:42.499 INFO:teuthology.orchestra.run.smithi174.stderr: 94.1% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi174.hwhiyg.log.gz 2024-05-06T14:04:42.499 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mon.smithi174.log: 90.8% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-06T14:04:42.499 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-06T14:04:42.499 INFO:teuthology.orchestra.run.smithi174.stderr:gzip/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.cephadm.log: -5 --verbose -- /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mgr.smithi174.ybuavj.log 2024-05-06T14:04:42.499 INFO:teuthology.orchestra.run.smithi174.stderr: 83.3%/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-volume.log: -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-06T14:04:42.499 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-06T14:04:42.499 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mgr.smithi174.ybuavj.log: /var/log/ceph/cephadm.log: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-06T14:04:42.499 INFO:teuthology.orchestra.run.smithi174.stderr: 92.4% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mgr.smithi174.ybuavj.log.gz 2024-05-06T14:04:42.499 INFO:teuthology.orchestra.run.smithi174.stderr: 90.7% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-06T14:04:42.500 INFO:teuthology.orchestra.run.smithi174.stderr: 93.1% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi174.rqlodw.log.gz 2024-05-06T14:04:42.501 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-volume.log: 90.8% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-06T14:04:42.501 INFO:teuthology.orchestra.run.smithi123.stderr: 90.6% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi123.wnupgd.log.gz 2024-05-06T14:04:42.510 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/cephadm.log: 90.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-06T14:04:42.519 INFO:teuthology.orchestra.run.smithi123.stderr: 94.6% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi123.cuurje.log.gz 2024-05-06T14:04:42.572 INFO:teuthology.orchestra.run.smithi174.stderr: 93.3% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-06T14:04:42.577 INFO:teuthology.orchestra.run.smithi174.stderr: 92.6% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mon.smithi174.log.gz 2024-05-06T14:04:42.582 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-06T14:04:42.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.586+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190005ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:04:42.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.586+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:04:42.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.586+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 msgr2=0x7f7190006620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T14:04:42.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.586+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006240 0x7f7190006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T14:04:42.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.586+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 0x7f7190005660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:04:42.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.586+0000 7f71acff9700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190007080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T14:04:42.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.587+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0036f00 con 0x7f7190006ca0 2024-05-06T14:04:42.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.587+0000 7f71acff9700 1 -- 172.21.15.123:0/1314944135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0037040 con 0x7f71b0101dc0 2024-05-06T14:04:42.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.587+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:42.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.587+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:04:42.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.587+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190007080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:42.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.587+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190007080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T14:04:42.592 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mgr.smithi123.vjztrj.log.gz 2024-05-06T14:04:42.602 INFO:teuthology.orchestra.run.smithi174.stderr: 93.4% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-06T14:04:42.603 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-05-06T14:04:42.604 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m0.128s 2024-05-06T14:04:42.604 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m0.409s 2024-05-06T14:04:42.604 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m0.037s 2024-05-06T14:04:42.618 INFO:teuthology.orchestra.run.smithi123.stderr: 93.4% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-06T14:04:42.619 INFO:teuthology.orchestra.run.smithi123.stderr: 93.6% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-06T14:04:42.624 INFO:teuthology.orchestra.run.smithi123.stderr: 93.4% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-06T14:04:42.745 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/f22edd3c-0baf-11ef-bc97-c7b262605968/ceph-mon.smithi123.log.gz 2024-05-06T14:04:42.747 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-05-06T14:04:42.748 INFO:teuthology.orchestra.run.smithi123.stderr:real 0m0.273s 2024-05-06T14:04:42.748 INFO:teuthology.orchestra.run.smithi123.stderr:user 0m0.810s 2024-05-06T14:04:42.748 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m0.058s 2024-05-06T14:04:42.748 INFO:tasks.cephadm:Archiving logs... 2024-05-06T14:04:42.749 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404/remote/smithi123/log 2024-05-06T14:04:42.750 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-06T14:04:42.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.788+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:42.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.788+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:04:42.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.788+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190007080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:42.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:42.788+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190007080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T14:04:42.943 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404/remote/smithi174/log 2024-05-06T14:04:42.944 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-06T14:04:43.043 INFO:tasks.cephadm:Removing cluster... 2024-05-06T14:04:43.043 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 --force 2024-05-06T14:04:43.182 INFO:teuthology.orchestra.run.smithi123.stdout:Deleting cluster with fsid: f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T14:04:43.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:43.189+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:43.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:43.189+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:04:43.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:43.189+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190007080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:43.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:43.189+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190007080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T14:04:43.447 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f22edd3c-0baf-11ef-bc97-c7b262605968 --force 2024-05-06T14:04:43.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:43.527+0000 7f71b4865700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 msgr2=0x7f71a00760d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3135616195 2024-05-06T14:04:43.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:43.527+0000 7f71b4865700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:6800/3135616195,v1:172.21.15.123:6801/3135616195] conn(0x7f71b0100bc0 0x7f71a00760d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-05-06T14:04:43.588 INFO:teuthology.orchestra.run.smithi174.stdout:Deleting cluster with fsid: f22edd3c-0baf-11ef-bc97-c7b262605968 2024-05-06T14:04:43.853 INFO:tasks.cephadm:Removing cephadm ... 2024-05-06T14:04:43.854 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-06T14:04:43.869 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-06T14:04:43.884 INFO:tasks.cephadm:Teardown complete 2024-05-06T14:04:43.884 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-06T14:04:43.895 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-06T14:04:43.895 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-06T14:04:43.912 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-06T14:04:43.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:43.990+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:43.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:43.990+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:04:43.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:43.990+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190007080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:43.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:43.990+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190007080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T14:04:43.994 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-06T14:04:44.004 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-06T14:04:44.005 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T14:04:44.007 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T14:04:44.019 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-05-06T14:04:44.021 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-05-06T14:04:44.023 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-06T14:04:44.023 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-05-06T14:04:44.023 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 +1099us[+1128us] +/- 57ms 2024-05-06T14:04:44.023 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 -1586us[-1557us] +/- 66ms 2024-05-06T14:04:44.024 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +314us[ +314us] +/- 113ms 2024-05-06T14:04:44.024 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T14:04:44.025 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-06T14:04:44.025 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-05-06T14:04:44.025 INFO:teuthology.orchestra.run.smithi174.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 +1183us[+1237us] +/- 57ms 2024-05-06T14:04:44.026 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 -1500us[-1446us] +/- 66ms 2024-05-06T14:04:44.026 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +387us[ +442us] +/- 113ms 2024-05-06T14:04:44.026 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T14:04:44.026 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-06T14:04:44.036 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-06T14:04:44.037 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-06T14:04:44.047 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-06T14:04:44.134 DEBUG:teuthology.orchestra.run.smithi174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-06T14:04:44.197 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-06T14:04:44.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T14:04:44.224 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-06T14:04:44.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T14:04:44.250 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-06T14:04:44.262 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-06T14:04:44.273 INFO:teuthology.task.internal:Duration was 1060.454235 seconds 2024-05-06T14:04:44.273 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-06T14:04:44.284 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-06T14:04:44.284 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-06T14:04:44.287 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-06T14:04:44.320 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-06T14:04:44.327 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-06T14:04:44.643 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-06T14:04:44.644 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-05-06T14:04:44.644 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-06T14:04:44.703 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-05-06T14:04:44.704 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-06T14:04:44.727 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-06T14:04:44.727 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-06T14:04:44.745 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-06T14:04:44.792 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-06T14:04:44.792 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-06T14:04:44.810 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-06T14:04:45.141 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-06T14:04:45.154 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-06T14:04:45.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-06T14:04:45.178 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-06T14:04:45.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-06T14:04:45.215 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-06T14:04:45.221 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-06T14:04:45.240 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-05-06T14:04:45.264 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-05-06T14:04:45.276 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-06T14:04:45.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T14:04:45.306 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-06T14:04:45.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T14:04:45.336 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-06T14:04:45.349 INFO:teuthology.task.internal:Transferring archived files... 2024-05-06T14:04:45.350 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404/remote/smithi123 2024-05-06T14:04:45.350 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-06T14:04:45.391 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404/remote/smithi174 2024-05-06T14:04:45.391 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-06T14:04:45.425 INFO:teuthology.task.internal:Removing archive directory... 2024-05-06T14:04:45.426 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-06T14:04:45.428 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-06T14:04:45.475 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-06T14:04:45.489 INFO:teuthology.task.internal:Not uploading archives. 2024-05-06T14:04:45.489 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-06T14:04:45.500 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-06T14:04:45.501 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-06T14:04:45.503 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-06T14:04:45.515 INFO:teuthology.orchestra.run.smithi123.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 6 14:04 /home/ubuntu/cephtest 2024-05-06T14:04:45.529 INFO:teuthology.orchestra.run.smithi174.stdout: 262213 4 drwxr-xr-x 3 ubuntu ubuntu 4096 May 6 14:04 /home/ubuntu/cephtest 2024-05-06T14:04:45.529 INFO:teuthology.orchestra.run.smithi174.stdout: 545028 4 drwxr-xr-x 3 ubuntu ubuntu 4096 May 6 14:03 /home/ubuntu/cephtest/mnt.1 2024-05-06T14:04:45.529 INFO:teuthology.orchestra.run.smithi174.stdout: 545029 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 6 14:04 /home/ubuntu/cephtest/mnt.1/client.1 2024-05-06T14:04:45.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T14:04:45.530 INFO:teuthology.orchestra.run.smithi174.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-05-06T14:04:45.531 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi174 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-05-06T14:04:45.537 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-06T14:04:45.550 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-06T14:04:45.563 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi174 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-05-06T14:04:45.563 INFO:teuthology.nuke:Checking targets against current locks 2024-05-06T14:04:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:45.592+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:45.592+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:04:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:45.592+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190007080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:45.592+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190007080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T14:04:45.593 DEBUG:teuthology.nuke:shortname: smithi123 2024-05-06T14:04:45.594 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-06T14:04:45.618 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 13:41:28.469451', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEM7TqFYTn6jZl6NzBaN5kml7UKdGgr0nYLQBUkktArt3PDEdf2CgH5UroQ30mAKAL+TCOZBK4TFi9Ocqkeu4zU='} 2024-05-06T14:04:45.621 DEBUG:teuthology.nuke:shortname: smithi174 2024-05-06T14:04:45.621 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-06T14:04:45.640 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-04_03:08:13-upgrade-main-distro-default-smithi/7690404', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 13:41:28.468127', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJZLQFnblTUrCxwbEoGBe/6+Dt5sbmnxuyeLuXT1uGm4mYTt2ixPYLp7R2rj5qR8/OXEWu00W65W5Ile+YW28yo='} 2024-05-06T14:04:45.667 INFO:teuthology.orchestra.console.smithi123:Power off 2024-05-06T14:04:45.668 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-06T14:04:45.690 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2024-05-06T14:04:45.690 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T14:04:45.711 INFO:teuthology.orchestra.console.smithi174:Power off 2024-05-06T14:04:45.712 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-06T14:04:45.722 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2024-05-06T14:04:45.735 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2024-05-06T14:04:45.735 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T14:04:45.761 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-05-06T14:04:48.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:48.795+0000 7f71affff700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 msgr2=0x7f7190005660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-05-06T14:04:48.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:48.795+0000 7f71affff700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7190006ca0 0x7f7190005660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:04:48.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:48.795+0000 7f71b5066700 1 -- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 msgr2=0x7f7190007080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-05-06T14:04:48.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-05-06T14:04:48.795+0000 7f71b5066700 1 --2- 172.21.15.123:0/1314944135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71b0101dc0 0x7f7190007080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-06T14:04:49.370 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T14:04:49.723 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T14:04:49.763 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T14:04:49.835 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2024-05-06T14:04:49.875 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-05-06T14:04:53.838 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T14:04:53.875 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T14:04:53.949 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2024-05-06T14:04:53.986 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-05-06T14:04:57.954 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T14:04:57.987 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T14:04:58.066 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2024-05-06T14:04:58.099 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-05-06T14:04:58.167 INFO:teuthology.orchestra.console.smithi123:Power off completed 2024-05-06T14:04:58.200 INFO:teuthology.orchestra.console.smithi174:Power off completed 2024-05-06T14:04:58.306 INFO:teuthology.run:Summary data: description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1060.4542348384857 failure_reason: 'Command failed on smithi123 with status 128: ''rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 04416f48efe02891b265c07b4f38b46e422bbef9''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=279cf547906a427bb7f9139c76176570 status: fail success: false 2024-05-06T14:04:58.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-06T14:04:58.393 INFO:teuthology.run:FAIL